Commit Graph

1085 Commits

Author SHA1 Message Date
Sean Whalen
7a8781ef5c Update dmarc_aggregate_dashboard.xml 2024-03-28 16:07:13 -04:00
Sean Whalen
9084d32040 8.10.1
- Fix flaws in `base_reverse_dns_map.csv`
2024-03-27 18:10:39 -04:00
Sean Whalen
29fe768772 Update dmarc_aggregate_dashboard.xml 2024-03-27 18:00:35 -04:00
Sean Whalen
0cad27c686 Update base_reverse_dns_map.csv 2024-03-27 18:00:27 -04:00
Sean Whalen
1f9a5ffe58 Splunk dashboard bug fixes 2024-03-27 17:19:58 -04:00
Sean Whalen
9ffc63f895 Update base_reverse_dns_map.csv 2024-03-27 17:01:25 -04:00
Sean Whalen
26f62082c3 Update Splunk dashboards 2024-03-27 15:40:19 -04:00
Sean Whalen
d7dbf68e7d Actually bump the version number to 8.10.0 2024-03-26 12:24:01 -04:00
Sean Whalen
465829c18b 8.10.0
- Fix MSGraph UsernamePassword Authentication (PR #497)
- Attempt to download an updated `base_reverse_dns_map.csv` at runtime
- Update included `base_reverse_dns_map.csv`
2024-03-26 12:22:49 -04:00
Sean Whalen
09238d5ca8 Update base_reverse_dns_map.csv 2024-03-26 12:18:00 -04:00
Tim Nowaczyk
d907dd8cff Fix MSGraph UsernamePassword Authentication (#497)
parsedmarc/pull/471 broke UsernamePassword authentication for me. This change fixes it.

Co-authored-by: Tim Nowaczyk <tnowaczyk@eqx-kibana-1.allpointsbroadband.net>
2024-03-26 12:07:47 -04:00
Sean Whalen
18f7508a1f Download reverse DNS map from GitHub 2024-03-26 12:07:10 -04:00
Sean Whalen
ed593a0b49 Update base_reverse_dns_map.csv 2024-03-26 10:32:34 -04:00
Sean Whalen
d27e195645 Update base_reverse_dns_map.csv 2024-03-26 08:16:41 -04:00
Sean Whalen
ede8c0b6a2 8.9.4
- Update `base_reverse_dns_map.csv`
2024-03-25 11:35:25 -04:00
Sean Whalen
91daa31172 8.9.3
- Revert change in 8.9.2
2024-03-25 07:04:15 -04:00
Sean Whalen
cdde9734ec 8.9.2 2024-03-25 06:26:45 -04:00
Sean Whalen
62ad46b8ba 8.9.1 release
- Fix broken CLI by removing opbsolete paramater from `cli_parse` call (PR #496 closes issue #495)
2024-03-25 05:45:08 -04:00
Szasza Palmer
fc5e0fe4d5 removing obsolete parameter from cli_parse call (#496) 2024-03-25 00:03:51 -04:00
Sean Whalen
633435547a Actual 8.9.0 release
- Fix broken cache (PR #494)
- Add source name and type information based on static mapping of the reverse DNS base domain
  - See [this documentation](https://github.com/domainaware/parsedmarc/tree/master/parsedmarc/resources/maps) for more information, and to learn how to help!
- Replace `multiprocessing.Pool` with `Pipe` + `Process` (PR #491 closes issue #489)
- Remove unused parallel arguments (PR #492 closes issue #490)
2024-03-24 23:48:08 -04:00
Sean Whalen
fd0572cdd0 8.9.0
- Add source name and type information based on static mapping of the reverse DNS base domain
  - See [this documentation](https://github.com/domainaware/parsedmarc/tree/master/parsedmarc/resources/maps) for more information, and to learn how to help!
- Replace `multiprocessing.Pool` with `Pipe` + `Process` (PR #491 closes issue #489)
- Remove unused parallel arguments (PR #492 closes issue #490)
2024-03-24 23:30:40 -04:00
Sean Whalen
e550f42a22 Add support for source name and type 2024-03-24 21:31:39 -04:00
Szasza Palmer
2cde116a93 removing unused parallel arguments (#492) 2024-03-24 20:43:43 -04:00
Szasza Palmer
a915385246 replacing multiprocessing pool with pipe (#491)
* replacing multiprocessing pool with pipe

* code styling fix

* dropping obsolete chunk_size config parameter
2024-03-23 21:41:46 -04:00
Rod Payne
1e565d9eb2 Use cache in get_ip_address_info. (#494) 2024-03-23 21:40:36 -04:00
Anael Mobilia
3a1360a47a Always use systemctl command (#482)
In order to align with the rest of the documentation
2024-03-17 11:44:55 -04:00
Sean Whalen
5f3977d686 8.8.0 release
- Add support for OpenSearch (PR #481 closes #480)
- Fix SMTP TLS reporting to Elasticsearch (PR #470)
2024-03-04 10:49:44 -05:00
Sean Whalen
65d04bcb78 Code style cleanup 2024-03-04 10:37:32 -05:00
cgoIT
f3206dcdab [SMTP TLS] some minor bug fixes (#477)
* fix minor bugs during smtp-tls parsing, add docker-compose for local elasticsearch, add smtp-tls tests

* fix wrong log message parameter

* fix wrong log message

* add contact-info to smtp tls report, fix wrong fieldnames

* fix wrong fieldnames

* fix wrong index name for search

* at least for some reporting organizations the field sending-mta-ip is optional...

* add missing fields to elasticsearch for smtp tls

* failure_details is a list, add more test cases

* fix wrong name in ci.ini
2024-03-04 10:06:47 -05:00
Szasza Palmer
995bdbcd97 adding OpenSearch support, fixing minor typos, and code styling (#481)
* adding OpenSearch support, fixing minor typos and code styling

* documentation update
2024-03-04 10:06:26 -05:00
Sean Whalen
77132b3fc5 8.7.0
- Add support for SMTP TLS reports (PR #453 closes issue #71)
- Do not replace content in forensic samples (fix #403)
- Pin `msgraph-core` dependency at version `0.2.2` until Microsoft provides better documentation (PR #466 Close [#464](https://github.com/domainaware/parsedmarc/issues/464))
- Properly handle base64-encoded email attachments (PR #453)
- Do not crash when attempting to parse invalid email content (PR #453)
- Ignore errors when parsing text-based forensic reports (PR #460)
- Add email date to email processing debug logs (PR #462)
- Set default batch size to 10 to match the documentation (PR #465)
- Properly handle none values (PR #468)
- Add Gmail pagination (PR #469)
- Use the correct `msgraph` scope (PR #471)
2024-02-19 19:21:38 -05:00
Sean Whalen
a1f141d84c Code cleanup 2024-02-19 19:05:12 -05:00
mkupferman
efe74091f3 Gmail API pagination (#469)
* Use pagination to fetch more than 100 Gmail messages at once

* Provide `paginate_messages` option to allow use of previous behavior
2024-02-19 18:54:41 -05:00
Brassn
d2145b71ba msgraph DeviceFlow selecting wrong scope (#471)
* DeviceCode Flow ignores user and selects wrong scope

* only require client secret on ClientSecret flow
2024-02-19 18:54:16 -05:00
Yuuki Takahashi
d512b9f60e fix: handle none value (#468) 2024-02-19 18:53:52 -05:00
Anael Mobilia
93278bc023 Add email date on debug of mail processing (#462) 2024-02-19 18:53:02 -05:00
Anael Mobilia
9e9065837e Define default value for batch_size to 10 as according to the documentation (#465) 2024-02-19 18:52:30 -05:00
Anael Mobilia
1c1ce7fea3 Doc - Update elasticsearch parameters (#467) 2024-02-19 18:52:01 -05:00
bendem
fc49f7f56c Ignore errors when parsing text-based forensic reports (#460)
Starting 8.2.0, parsedmarc crashes instead of ignoring some invalid reports.

The original change was introduced in abf9695228.
2024-02-19 18:51:28 -05:00
Sean Whalen
b8088505b1 Add support for SMTP TLS reports (#453) 2024-02-19 18:45:38 -05:00
Jason Lingohr
7d2b431e5f Fix tiny formatting issue (#451) 2024-01-02 16:38:50 -05:00
Nicholas Hairs
cb3f82e847 Add additional samples and ensure git does not touch CRLF (#456)
mimecast sample taken from:
https://github.com/domainaware/parsedmarc/issues/429#issuecomment-1873387507
2024-01-02 16:29:06 -05:00
UKnowTEd
100f12ed35 Update elastic.py (#449)
Insert new config parameter "apiKey" to authenticate via API to Elasticsearch.
2023-12-16 11:59:50 -05:00
UKnowTEd
37a6155262 Update cli.py (#450)
Insert new config parameter "apiKey" to authenticate via API to Elasticsearch.
2023-12-16 10:10:35 -05:00
Andras
25086763a9 small grammatical error in README.md (#446) 2023-12-16 10:09:42 -05:00
Anael Mobilia
b89c38c22a Region Map -> Maps (#445)
Since Kibana 8, Region Maps are no longer rendered.
See https://github.com/elastic/kibana/issues/81704
2023-12-16 10:09:11 -05:00
Jonathan Martens
c71bc19cea docs: formatting fix on delete keyword in mail section (#444) 2023-12-16 10:08:41 -05:00
Anael Mobilia
3bf0bea710 Fix typo on documentation (#443)
* Doc cleanup/improvement

* Fix typos

---------

Co-authored-by: Anael Mobilia <anael.mobilia@mydsomanager.com>
2023-12-16 10:08:06 -05:00
Sean Whalen
95954c5d87 Correct changelog 2023-10-13 10:35:58 -04:00
Sean Whalen
6120b8683d Update changelog 2023-10-13 10:29:42 -04:00