Commit Graph

246 Commits

Author SHA1 Message Date
Sean Whalen
f6c0a4ecbc Update docs 2023-05-03 16:57:22 -04:00
Sean Whalen
044038a381 Fix mailing list diocumentation 2023-05-03 16:54:25 -04:00
Sean Whalen
cd475255c5 Documentation cleanup 2023-05-03 16:44:15 -04:00
Ben Companjen
2b35b785c6 Split and Organise documentation files (#404)
* Set global TOC collapse to false

* Split documentation

I tried to split the index.md file into logical parts, not changing the contents.
I did add a space and change one HTTP URL to HTTPS.

---------

Co-authored-by: Sean Whalen <44679+seanthegeek@users.noreply.github.com>
2023-05-03 16:11:58 -04:00
rubeste
a7280988eb Implemented Azure Log Analytics ingestion via Data Collection Rules (#394)
* Implemented Azure Log Analytics ingestion via Data Collection Rules

* Update loganalytics.py

* Update cli.py

* Update pyproject.toml

* Fixed config bug

Fixed a bug that causes the program to fail if you do not configure a Data stream.

* Fixed code format
2023-05-03 15:54:25 -04:00
Anael Mobilia
02e856a9bf From Elasticsearch 8.7, xpack security isn't on by default but is required (#395)
```
org.elasticsearch.ElasticsearchSecurityException: invalid configuration for xpack.security.transport.ssl - [xpack.security.transport.ssl.enabled] is not set, but the following settings have been configured in elasticsearch.yml : [xpack.security.transport.ssl.keystore.secure_password,xpack.security.transport.ssl.truststore.secure_password]
```
2023-05-03 15:39:46 -04:00
Anael Mobilia
8b8c8c15fe Fix markdown (#384) 2023-01-16 14:43:36 -05:00
aroldxd
fcc64ed85a add option to allow unencrypted fallback for token cache (#375) 2022-12-23 18:21:22 -05:00
Anael Mobilia
4217a076de Doc - Add info on how to update max shards (#368)
Add information on how to fix "Elasticsearch error: RequestError(400, 'validation_exception', 'Validation Failed: 1: this action would add [1] shards, but this cluster currently has [1000]/[1000] maximum normal shards open;"
2022-12-23 18:15:11 -05:00
nmourad
0a0e4beb27 Update documentation default value for ES replica setting (#376)
Change made in 7.1.0 "Set Elasticsearch shard replication to 0 (PR #274)"
Documentation was not updated

Co-authored-by: n.mourad <n.mourad@criteo.com>
2022-12-23 18:14:41 -05:00
Anael Mobilia
bcf242b0ab Fix typo (#364) 2022-12-23 18:13:10 -05:00
Anael Mobilia
1380eed2b8 Doc - Update install documentation to Elasticsearch/Kibana 8 (#363)
* Update elasticsearch/kibana instructions

[From elastisearch notes](https://www.elastic.co/guide/en/elasticsearch/reference/current/important-settings.html#heap-size-settings) : 
```
By default, Elasticsearch automatically sets the JVM heap size based on a node’s roles and total memory. We recommend the default sizing for most production environments.
```

* Update nginx conf to TLSv1.3 and IPv6

* Replace nginx proxy by native https server

Kibana now provide https web server, remove the nginx proxy part and directly use kibana

* Fix typo

* Add infos how to login to kibana

* Add interface details
2022-12-23 18:12:39 -05:00
Anael Mobilia
69c2c6bdb6 Add details on virtualenv / package installation (#361) 2022-12-23 18:10:35 -05:00
Anael Mobilia
7c349fe97e Add contrib component requirement on Debian (#360) 2022-12-23 18:09:52 -05:00
Sean Whalen
4a607420a7 Fix list formatting in docs 2022-09-10 15:16:02 -04:00
Sean Whalen
12e591255c Fix tests 2022-09-10 14:32:43 -04:00
Sean Whalen
6540577ad5 Convert docs to markdown 2022-09-10 12:53:47 -04:00
Sean Whalen
26f43b3315 Fix build 2022-09-09 17:50:51 -04:00
Sean Whalen
10e15d963b 8.3.1
- Handle unexpected xml parsing errors more gracefully
2022-09-09 16:22:28 -04:00
Cody Cutrer
d1da40bab7 add config option for setting check_timeout (#343) 2022-08-19 13:51:08 -04:00
Cody Cutrer
046a7885ea support custom port for gmail oauth2 local server (#341) 2022-08-19 13:50:18 -04:00
Nathan Thorpe
b15425f50e Add Graph credentials cache and fix issue with batch size (#334)
* implement token cache for Graph API

* fix case when username isn't defined (device code)

* add batch size when listing messages from Graph API

* fix string concat
2022-07-21 13:43:21 -04:00
Sean Whalen
315b99f95a Resolve Sphinx warnings 2022-06-20 10:46:54 -04:00
William Desportes
a496b4e42a Fix documentation typos (#326)
Fixes: #325
2022-06-20 09:48:14 -04:00
William Desportes
9671a49166 Implement new settings for s3 (#328)
* Fix s3 path documented as an int

* Implement new settings for s3 storage
2022-06-20 09:47:29 -04:00
Nathan Thorpe
9d05fe776a Add message about scoping shared mailboxes when using MSGraph ClientSecret auth (#322)
* Add message about scoping to shared mailboxes

* disable resolve entities in Xml Parser
2022-05-14 14:14:42 -04:00
Sean Whalen
0e6e6c31c0 Merge branch 'master' of https://github.com/domainaware/parsedmarc 2022-05-14 13:16:03 -04:00
Sean Whalen
31821bcfd9 Remove pypy guide until #321 is fixed 2022-05-14 13:16:00 -04:00
Nathan Thorpe
9bf4e75e0e Implement Device Code and Client Secret auth flow for MS Graph (#320)
* implement DeviceCode and ClientSecret auth flow for MS Graph

* update readme for MS Graph auth method additions

* add warning to msgraph config setup
2022-05-14 12:58:22 -04:00
Sean Whalen
ed39c7d89e Update documentation 2022-05-13 17:11:05 -04:00
Sean Whalen
4018e828e9 8.2.0 release
- Support non-standard, text-based forensic reports sent by some mail hosts
- Set forensic report version to `None` (`null` in JSON) if the report was in a non-standard format and/or is missing a version number
- The default value of the `mailbox` `batch_size` is now `10` (use `0` for no limit)
2022-05-10 21:01:41 -04:00
Sean Whalen
6b2131f0e8 Update documentation 2022-05-09 15:41:35 -04:00
Sean Whalen
af2afddf96 Possible 8.0.3 release
- Fix IMAP callback for `IDLE` connections (PR #313 closes issue #311)
- Add warnings in documentation and log output for IMAP configuration changes introduced in 8.0.0 (Closes issue #309)
- Actually pin the `elasticsearch` Python library version at `<7.14.0` (Closes issue #315)
2022-05-02 12:50:37 -04:00
Sean Whalen
1b0f95a0ff Add notes and warnings to address #309 and #314 # 2022-04-29 09:10:26 -04:00
Sean Whalen
64f8eef27b 8.0.1
Fix `ModuleNotFoundError` by adding `parsedmarc.mail` to the list of packages in `setup.py` (PR #308)
2022-04-24 20:12:01 -04:00
Sean Whalen
64b88991d1 8.0.0
- Update included copy of `dbip-country-lite.mmdb` to the 2022-04 release
- Add support for Microsoft/Office 365 via Microsoft Graph API (PR #301 closes issue #111)
- Pin `elasticsearch-dsl` version at `>=2.2.0<7.14.0` (PR #297  closes issue #296)
- Properly initialize `ip_dp_path` (PR #294 closes issue #286)
- Remove usage of `lgging.basicConfig` (PR #285)
- Add support for the Gmail API (PR #284 and PR #307 close issue #96)

Special thanks to @nathanthorpe  and @roeften for their substantial contributions.
2022-04-22 16:59:47 -04:00
Sean Whalen
315d400677 Update index.rst 2022-01-09 14:42:55 -05:00
Sean Whalen
5e0ac908c6 Better install instructions
Avoid polluting the Python system installation
2022-01-09 14:33:47 -05:00
Sean Whalen
21c7e9d4af 7.1.1
- Actually include `dbip-country-lite.mmdb` file in the `parsedmarc.resources` package (PR #281)
- Update `dbip-country-lite.mmdb` to the 2022-01 release
2022-01-08 16:07:23 -05:00
lasat
c921814e18 Update index.rst
add note to imap password to escape '%'
2021-12-23 07:45:39 +01:00
Sean Whalen
499516585b Migrate from Travis-CI to GitHub Actions 2021-12-07 11:04:27 -05:00
Sean Whalen
51eea6c08d 7.1.0
- A static copy of the DBIP database is now included for use when a copy of the MaxMind GeoLite2 Country database is not installed (Closes #275)
- Add `ip_db_path` to as a parameter and `general` setting for a custom IP geolocation database location (Closes #184)
- Search default Homebrew path when searching for a copy of the MaxMind GeoLite2 Country database (Closes #272)
- Fix log messages written to root logger (PR #276)
- Fix `--offline` option in CLI not being passed as a boolean (PR #265)
- Set Elasticsearch shard replication to `0` (PR #274)
- Add support for syslog output (PR #263 closes #227)
- Do not print TQDDM progress bar when running in a no-interactive TTY (PR #264)
2021-12-07 10:19:41 -05:00
Sean Whalen
6d5f8a9ec3 Fix documentation formatting 2021-06-20 15:45:15 -04:00
Sean Whalen
e841a49ca7 Fix documentation formatting 2021-06-20 14:24:49 -04:00
Sean Whalen
3d0f7c8c83 7.0.0
Closes issues #221 #219 #155 #103
2021-06-20 13:10:12 -04:00
Sean Whalen
242522f7ee Merge branch 'master' into imap_batch_size 2021-06-19 11:40:36 -04:00
Tom Henderson
eba722cddc Fix path example 2021-02-05 14:38:52 +13:00
Tom Henderson
bafa4861b1 Update docs 2021-02-05 14:27:22 +13:00
Tom Henderson
bc684c8913 Add option to process messages in batches 2021-02-05 13:37:09 +13:00
Anael Mobilia
08457b66fd Update categorie name in Kibana 2021-01-18 16:51:12 +01:00