Commit Graph

1097 Commits

Author SHA1 Message Date
Sean Whalen
a53d35a90c Revert "Update usage.md" PR #497 makes moot
This reverts commit 662b7b694b.
2024-04-08 10:41:16 -04:00
Sean Whalen
662b7b694b Update usage.md 2024-04-08 09:55:07 -04:00
Sean Whalen
6a06d01b44 8.11.0
- Actually save `source_type` and `source_name` to Elasticsearch and OpenSearch
- Reverse-lookup cache improvements (PR #501 closes issue #498)
- Update the included `dbip-country-lite.mmdb` to the 2024-03 version
- Update `base_reverse_dns_map.csv`
- Add new general config options (closes issue #500)
  - `always_use_local_files` - Disables the download of the reverse DNS map
  - `local_reverse_dns_map_path` - Overrides the default local file path to use for the reverse DNS map
  - `reverse_dns_map_url` - Overrides the default download URL for the reverse DNS map
2024-04-02 12:34:32 -04:00
Sean Whalen
422f7a074a Update base_reverse_dns_map.csv 2024-04-02 12:13:19 -04:00
Sean Whalen
d6128eae9f Actually save source_tye and source_name to Elasticsearch and Opensearch 2024-04-01 09:14:45 -04:00
Sean Whalen
36eedcb446 Update dbip-country-lite.mmdb 2024-03-31 20:36:22 -04:00
Sean Whalen
acef7bdd6e Code cleanup 2024-03-31 20:25:10 -04:00
Rod Payne
8936193280 Reverse-lookup cache improvements (#501) 2024-03-31 20:01:40 -04:00
Sean Whalen
fd5b792c4a Close issue #500
Add the following general configuration options:

- `always_use_local_files` - Disables the download of the reverse DNS map
- `local_reverse_dns_map_path` - Overrides the default local file path to use for the reverse DNS map
2024-03-31 20:00:47 -04:00
Sean Whalen
041296b1f1 8.10.3
- Fix flaws in `base_reverse_dns_map.csv`
2024-03-29 14:17:40 -04:00
Sean Whalen
2e49db3c13 8.10.2
- Fix flaws in `base_reverse_dns_map.csv`
2024-03-29 14:02:30 -04:00
Sean Whalen
871d678d16 Update dmarc_aggregate_dashboard.xml 2024-03-28 19:38:31 -04:00
Sean Whalen
7a8781ef5c Update dmarc_aggregate_dashboard.xml 2024-03-28 16:07:13 -04:00
Sean Whalen
9084d32040 8.10.1
- Fix flaws in `base_reverse_dns_map.csv`
2024-03-27 18:10:39 -04:00
Sean Whalen
29fe768772 Update dmarc_aggregate_dashboard.xml 2024-03-27 18:00:35 -04:00
Sean Whalen
0cad27c686 Update base_reverse_dns_map.csv 2024-03-27 18:00:27 -04:00
Sean Whalen
1f9a5ffe58 Splunk dashboard bug fixes 2024-03-27 17:19:58 -04:00
Sean Whalen
9ffc63f895 Update base_reverse_dns_map.csv 2024-03-27 17:01:25 -04:00
Sean Whalen
26f62082c3 Update Splunk dashboards 2024-03-27 15:40:19 -04:00
Sean Whalen
d7dbf68e7d Actually bump the version number to 8.10.0 2024-03-26 12:24:01 -04:00
Sean Whalen
465829c18b 8.10.0
- Fix MSGraph UsernamePassword Authentication (PR #497)
- Attempt to download an updated `base_reverse_dns_map.csv` at runtime
- Update included `base_reverse_dns_map.csv`
2024-03-26 12:22:49 -04:00
Sean Whalen
09238d5ca8 Update base_reverse_dns_map.csv 2024-03-26 12:18:00 -04:00
Tim Nowaczyk
d907dd8cff Fix MSGraph UsernamePassword Authentication (#497)
parsedmarc/pull/471 broke UsernamePassword authentication for me. This change fixes it.

Co-authored-by: Tim Nowaczyk <tnowaczyk@eqx-kibana-1.allpointsbroadband.net>
2024-03-26 12:07:47 -04:00
Sean Whalen
18f7508a1f Download reverse DNS map from GitHub 2024-03-26 12:07:10 -04:00
Sean Whalen
ed593a0b49 Update base_reverse_dns_map.csv 2024-03-26 10:32:34 -04:00
Sean Whalen
d27e195645 Update base_reverse_dns_map.csv 2024-03-26 08:16:41 -04:00
Sean Whalen
ede8c0b6a2 8.9.4
- Update `base_reverse_dns_map.csv`
2024-03-25 11:35:25 -04:00
Sean Whalen
91daa31172 8.9.3
- Revert change in 8.9.2
2024-03-25 07:04:15 -04:00
Sean Whalen
cdde9734ec 8.9.2 2024-03-25 06:26:45 -04:00
Sean Whalen
62ad46b8ba 8.9.1 release
- Fix broken CLI by removing opbsolete paramater from `cli_parse` call (PR #496 closes issue #495)
2024-03-25 05:45:08 -04:00
Szasza Palmer
fc5e0fe4d5 removing obsolete parameter from cli_parse call (#496) 2024-03-25 00:03:51 -04:00
Sean Whalen
633435547a Actual 8.9.0 release
- Fix broken cache (PR #494)
- Add source name and type information based on static mapping of the reverse DNS base domain
  - See [this documentation](https://github.com/domainaware/parsedmarc/tree/master/parsedmarc/resources/maps) for more information, and to learn how to help!
- Replace `multiprocessing.Pool` with `Pipe` + `Process` (PR #491 closes issue #489)
- Remove unused parallel arguments (PR #492 closes issue #490)
2024-03-24 23:48:08 -04:00
Sean Whalen
fd0572cdd0 8.9.0
- Add source name and type information based on static mapping of the reverse DNS base domain
  - See [this documentation](https://github.com/domainaware/parsedmarc/tree/master/parsedmarc/resources/maps) for more information, and to learn how to help!
- Replace `multiprocessing.Pool` with `Pipe` + `Process` (PR #491 closes issue #489)
- Remove unused parallel arguments (PR #492 closes issue #490)
2024-03-24 23:30:40 -04:00
Sean Whalen
e550f42a22 Add support for source name and type 2024-03-24 21:31:39 -04:00
Szasza Palmer
2cde116a93 removing unused parallel arguments (#492) 2024-03-24 20:43:43 -04:00
Szasza Palmer
a915385246 replacing multiprocessing pool with pipe (#491)
* replacing multiprocessing pool with pipe

* code styling fix

* dropping obsolete chunk_size config parameter
2024-03-23 21:41:46 -04:00
Rod Payne
1e565d9eb2 Use cache in get_ip_address_info. (#494) 2024-03-23 21:40:36 -04:00
Anael Mobilia
3a1360a47a Always use systemctl command (#482)
In order to align with the rest of the documentation
2024-03-17 11:44:55 -04:00
Sean Whalen
5f3977d686 8.8.0 release
- Add support for OpenSearch (PR #481 closes #480)
- Fix SMTP TLS reporting to Elasticsearch (PR #470)
2024-03-04 10:49:44 -05:00
Sean Whalen
65d04bcb78 Code style cleanup 2024-03-04 10:37:32 -05:00
cgoIT
f3206dcdab [SMTP TLS] some minor bug fixes (#477)
* fix minor bugs during smtp-tls parsing, add docker-compose for local elasticsearch, add smtp-tls tests

* fix wrong log message parameter

* fix wrong log message

* add contact-info to smtp tls report, fix wrong fieldnames

* fix wrong fieldnames

* fix wrong index name for search

* at least for some reporting organizations the field sending-mta-ip is optional...

* add missing fields to elasticsearch for smtp tls

* failure_details is a list, add more test cases

* fix wrong name in ci.ini
2024-03-04 10:06:47 -05:00
Szasza Palmer
995bdbcd97 adding OpenSearch support, fixing minor typos, and code styling (#481)
* adding OpenSearch support, fixing minor typos and code styling

* documentation update
2024-03-04 10:06:26 -05:00
Sean Whalen
77132b3fc5 8.7.0
- Add support for SMTP TLS reports (PR #453 closes issue #71)
- Do not replace content in forensic samples (fix #403)
- Pin `msgraph-core` dependency at version `0.2.2` until Microsoft provides better documentation (PR #466 Close [#464](https://github.com/domainaware/parsedmarc/issues/464))
- Properly handle base64-encoded email attachments (PR #453)
- Do not crash when attempting to parse invalid email content (PR #453)
- Ignore errors when parsing text-based forensic reports (PR #460)
- Add email date to email processing debug logs (PR #462)
- Set default batch size to 10 to match the documentation (PR #465)
- Properly handle none values (PR #468)
- Add Gmail pagination (PR #469)
- Use the correct `msgraph` scope (PR #471)
2024-02-19 19:21:38 -05:00
Sean Whalen
a1f141d84c Code cleanup 2024-02-19 19:05:12 -05:00
mkupferman
efe74091f3 Gmail API pagination (#469)
* Use pagination to fetch more than 100 Gmail messages at once

* Provide `paginate_messages` option to allow use of previous behavior
2024-02-19 18:54:41 -05:00
Brassn
d2145b71ba msgraph DeviceFlow selecting wrong scope (#471)
* DeviceCode Flow ignores user and selects wrong scope

* only require client secret on ClientSecret flow
2024-02-19 18:54:16 -05:00
Yuuki Takahashi
d512b9f60e fix: handle none value (#468) 2024-02-19 18:53:52 -05:00
Anael Mobilia
93278bc023 Add email date on debug of mail processing (#462) 2024-02-19 18:53:02 -05:00
Anael Mobilia
9e9065837e Define default value for batch_size to 10 as according to the documentation (#465) 2024-02-19 18:52:30 -05:00
Anael Mobilia
1c1ce7fea3 Doc - Update elasticsearch parameters (#467) 2024-02-19 18:52:01 -05:00