Commit Graph

995 Commits

Author SHA1 Message Date
Ben Companjen 9c86e2df49 Fix docstring indentations and grammar (#405)
In several docstrings incorrect indentation caused errors in the
rendered documentation.
I also changed a few words to correct the grammar.
2023-05-03 15:30:05 -04:00
Sean Whalen b75259c58c Merge branch 'master' of github.com:domainaware/parsedmarc 2023-01-21 10:09:39 -05:00
Sean Whalen 16318b9152 8.4.2
PR #386 closes issues #289 and #380

- Only initialize the syslog, S3 and Kafka clients once
2023-01-21 10:08:47 -05:00
kcyd 22a6d21362 initialize syslog, s3 and kafka clients only once (#386) 2023-01-21 10:02:05 -05:00
Sean Whalen b10cc06441 8.4.1
- Fix bug introduced in 8.3.1 that caused `No such file or directory` errors if output files didn't exist (PR #385 closes issues #358 and #382)
- Make the `--silent` CLI option only print errors.
  Add the `--warnings` options to also print warnings (PR#383)
2023-01-16 15:06:31 -05:00
Aleksandar Ristic a54cc3e6dd Add --warnings cli option; --silent now prints only errors (#383)
* Adding warnings argument; silent logs only errors.

* Fixing flake warning for trailing whitespace

* Change help for --warnings to match existing style
2023-01-16 14:45:27 -05:00
Anael Mobilia 8b8c8c15fe Fix markdown (#384) 2023-01-16 14:43:36 -05:00
Clayton Dukes bb838bb11a fixes https://github.com/domainaware/parsedmarc/issues/382 (#385) 2023-01-16 14:43:06 -05:00
Sean Whalen 375aaf025d Better build script 2022-12-23 20:20:53 -05:00
Sean Whalen f82445fa06 8.4.0 2022-12-23 20:08:00 -05:00
Anael Mobilia 70ff13bfae In case of timeout or exception, wait "check_timeout" before to try a new connexion (documentation : "or the number of seconds until the next mail check"). (#377)
Else in case of a mail server issue, we try to connect again each 5 seconds.
2022-12-23 18:23:01 -05:00
aroldxd fcc64ed85a add option to allow unencrypted fallback for token cache (#375) 2022-12-23 18:21:22 -05:00
Bjoern ea777d9d18 Fix Bug with wrong ip_db_path (#338 #287) (#369)
Fixes the problem when only a file path was specified instead of a file
Reportet with Issues:
Not a valid aggregate or forensic report after fresh Install with 8.3.x #338
Not a valid aggregate or forensic report after Update to 7.1.1 #287
2022-12-23 18:19:21 -05:00
Anael Mobilia 4217a076de Doc - Add info on how to update max shards (#368)
Add information on how to fix "Elasticsearch error: RequestError(400, 'validation_exception', 'Validation Failed: 1: this action would add [1] shards, but this cluster currently has [1000]/[1000] maximum normal shards open;"
2022-12-23 18:15:11 -05:00
nmourad 0a0e4beb27 Update documentation default value for ES replica setting (#376)
Change made in 7.1.0 "Set Elasticsearch shard replication to 0 (PR #274)"
Documentation was not updated

Co-authored-by: n.mourad <n.mourad@criteo.com>
2022-12-23 18:14:41 -05:00
ykcab 304ebaaa42 Updated Grafana query template (#366)
Co-authored-by: Alain Mbuku <git@almb.me>
2022-12-23 18:13:56 -05:00
Anael Mobilia bcf242b0ab Fix typo (#364) 2022-12-23 18:13:10 -05:00
Anael Mobilia 1380eed2b8 Doc - Update install documentation to Elasticsearch/Kibana 8 (#363)
* Update elasticsearch/kibana instructions

[From elastisearch notes](https://www.elastic.co/guide/en/elasticsearch/reference/current/important-settings.html#heap-size-settings) : 
```
By default, Elasticsearch automatically sets the JVM heap size based on a node’s roles and total memory. We recommend the default sizing for most production environments.
```

* Update nginx conf to TLSv1.3 and IPv6

* Replace nginx proxy by native https server

Kibana now provide https web server, remove the nginx proxy part and directly use kibana

* Fix typo

* Add infos how to login to kibana

* Add interface details
2022-12-23 18:12:39 -05:00
Anael Mobilia 69c2c6bdb6 Add details on virtualenv / package installation (#361) 2022-12-23 18:10:35 -05:00
Anael Mobilia 7c349fe97e Add contrib component requirement on Debian (#360) 2022-12-23 18:09:52 -05:00
Sean Whalen 49f9d75413 Add publish-docs.sh 2022-10-04 18:45:57 -04:00
Sean Whalen b86365225e Merge remote-tracking branch 'refs/remotes/origin/master' 2022-10-04 18:43:17 -04:00
Sean Whalen dde79c9e26 8.3.2
- Improvements to the Microsoft Graph integration (PR #352)
2022-10-04 18:42:32 -04:00
Nathan Thorpe 79d99d0b2e Fix issue with MS Graph batch size, scopes, and exception logging improvements (#352)
* log the stack trace when handling an exception

* fix issue when batch size is not supplied, raise error on fetch_messages

* fix unused var

* initialize graph client with scopes,

* add check for status code
2022-10-04 18:11:01 -04:00
Pierce 126bab1c3b Fix screenshot in README.md (#353) 2022-10-04 18:09:42 -04:00
Sean Whalen 4a607420a7 Fix list formatting in docs 2022-09-10 15:16:02 -04:00
Sean Whalen be4c236d69 Use hatch when testing building packages 2022-09-10 14:43:15 -04:00
Sean Whalen 4376b12c93 Remove sstcheck from tests 2022-09-10 14:39:08 -04:00
Sean Whalen 12e591255c Fix tests 2022-09-10 14:32:43 -04:00
Sean Whalen 6ccc827e4c Fix Python tests in GitHub 2022-09-10 14:16:17 -04:00
Sean Whalen 132bcde655 Update vscode settings 2022-09-10 14:03:41 -04:00
Sean Whalen 6540577ad5 Convert docs to markdown 2022-09-10 12:53:47 -04:00
Sean Whalen 26f43b3315 Fix build 2022-09-09 17:50:51 -04:00
Sean Whalen 1e0fa9472c Fix build 2022-09-09 16:46:57 -04:00
Sean Whalen 475b89adb0 Fix build 2022-09-09 16:44:21 -04:00
Sean Whalen de3002db8b Fix Docker build 2022-09-09 16:36:03 -04:00
Sean Whalen d2da6f30af 8.3.1
- Handle unexpected xml parsing errors more gracefully
2022-09-09 16:22:43 -04:00
Sean Whalen 10e15d963b 8.3.1
- Handle unexpected xml parsing errors more gracefully
2022-09-09 16:22:28 -04:00
Dave Rawks 84a7386726 Handle unexpected xml parsing errors more gracefully (#349)
* updates `parse_aggregate_report_xml` to not raise an unhandled
  exception on parsing errors
* adds an empty xml file to the aggregate test samples
* adds test for coverage
* Resolves #348
2022-09-08 18:23:34 -04:00
Sean Whalen 9d739ccd65 PEP 8 code style fixes 2022-09-03 10:28:45 -04:00
Sean Whalen 4f53894ce1 PEP 8 code style fixes 2022-08-19 14:12:26 -04:00
Dominik Bermühler 1d1f9e84b0 Logging silenced if parsedmarc is used as Library (#344)
By default, libraries should not configure their logger to give the developer, who is using the library, the freedom to decide how log messages are logged. For this reason no handler other than the NullHandler or log level should be set by the library.

For more information about this topic see here: https://realpython.com/python-logging-source-code/#library-vs-application-logging-what-is-nullhandler
2022-08-19 13:54:52 -04:00
Justus Piater 11c151e818 replace dateparser with dateutil (#331)
fixes #298
2022-08-19 13:53:20 -04:00
Cody Cutrer d1da40bab7 add config option for setting check_timeout (#343) 2022-08-19 13:51:08 -04:00
Cody Cutrer 046a7885ea support custom port for gmail oauth2 local server (#341) 2022-08-19 13:50:18 -04:00
vk2muf bddc2adb9c Update Grafana-DMARC_Reports.json (#335) 2022-08-19 13:49:40 -04:00
Cody Cutrer 4e8c74599b append to output files if they already exist (#342)
* append to output files if they already exist

instead of overwriting them. fixes #226

* save output with each successive watch result

possible now that it appends to the output
2022-08-19 13:49:16 -04:00
Nathan Thorpe b15425f50e Add Graph credentials cache and fix issue with batch size (#334)
* implement token cache for Graph API

* fix case when username isn't defined (device code)

* add batch size when listing messages from Graph API

* fix string concat
2022-07-21 13:43:21 -04:00
Sean Whalen 315b99f95a Resolve Sphinx warnings 2022-06-20 10:46:54 -04:00
Sean Whalen f070ee95c3 Update build.sh to work with newer versions off rstcheck 2022-06-20 10:40:20 -04:00