Commit Graph

1135 Commits

Author SHA1 Message Date
Sean Whalen f3a5f10d67 Replace University category with Education to be more inclusive 2024-09-02 21:08:17 -04:00
Frederico Freire Boaventura 4787da9ea1 Fix the tilde expansion for user home folder (#550)
This will enable the tilde expansion to map the output dir to the home
user using `~/path`.
2024-09-02 17:28:48 -04:00
Gaige B Paulsen 06d8578c47 fix: use namespace for separator (#552) 2024-09-02 17:27:28 -04:00
Sean Whalen ef621d68c7 Cache the reverse DNS map 2024-09-02 17:25:55 -04:00
Sean Whalen 1c3bcc05c7 Skip invalid aggregate report rows without calling the whole report invalid 2024-09-02 17:08:51 -04:00
Sean Whalen 554888b3dd Update IPDP database 2024-09-02 17:07:32 -04:00
N4v41 17d9599c54 Add various mail providers to the reverse DNS map (#548)
* Update base_reverse_dns_map.csv

Add Cloudflare E-mail routing service

* Add various missing mail providers
2024-08-31 12:08:15 -04:00
N4v41 fb0adf0627 Update base_reverse_dns_map.csv (#547)
Add Cloudflare E-mail routing service
2024-08-29 15:01:45 -04:00
N4v41 ef820c5d68 Update base_reverse_dns_map.csv (#546)
add Qualtrics to base_reverse_dns_map
2024-08-29 15:01:19 -04:00
Sean Whalen cc1b6ae389 8.13.0
- Add Elastic/OpenSearch index prefix option (PR #531 closes #159)
- Add GELF output support (PR #532)
2024-08-24 21:29:32 -04:00
Sean Whalen 0fa6bebf5a Fix error in docs 2024-08-24 20:10:57 -04:00
Sean Whalen 06ce080171 Update cli.py
Remove trailing spaces
2024-08-24 11:34:48 -04:00
Jason Lingohr 11e0461b9d Add GELF support (#532)
* Implement the ability to log to a GELF server/input, via the use of pygelf.

* Fix flake8 style checks.
2024-08-24 11:28:55 -04:00
Andreas Brett efe4893a7f add TLSRPT dashbboard (#529) 2024-08-24 11:27:42 -04:00
Emmanuel Ormancey 9b32d9459f added ES/OS prefix (#531) 2024-08-24 11:26:13 -04:00
Félix aa357dc50f add new sources to base_reverse_dns_map.csv (#537)
* add new sources to base_reverse_dns_map.csv

* remove extra comma in base_reverse_dns_map.csv
2024-07-30 15:53:24 -04:00
Sean Whalen e9f0cdef1f Update tests.py
Fix code style
2024-07-16 15:14:40 -04:00
pphillips99 410663dbca fixup and tests to extract_report() to handle documented inputs (#530) 2024-07-16 14:53:27 -04:00
Sean Whalen b110d06adb Merge branch 'master' of https://github.com/domainaware/parsedmarc 2024-06-11 14:40:13 -04:00
Sean Whalen 61402d6284 Fix PowerShell typo in docs 2024-06-11 14:38:29 -04:00
yuji suzuki e6e282a10c Fix ci and gha update (#526)
* add gmail_api example to README.md

* fix ci

fix

fix

m

fix

* codecov update
2024-05-28 16:54:17 -04:00
Sean Whalen 13ddc26d70 8.12.0
- Fix for deadlock with large report (#508)
- Build: move to kafka-python-ng (#510)
- Fix new config variables previously not propagated in the code (#524)
- Fixes for kafka integration (#522)
- Fix if base_domain is None before get_service_from_reverse_dns_base_domain (#514)
- Update base_reverse_dns_map.csv
2024-05-22 09:35:18 -04:00
Sean Whalen 899dc060b2 pep8 fixes 2024-05-22 09:06:32 -04:00
Anael Mobilia 1145b0f63b Update base_reverse_dns_map.csv (#516)
* Update base_reverse_dns_map.csv

Add some domains + fix mailchimp

* Update base_reverse_dns_map.csv

While Mailgun can be used for marketing, its main use case is transactional email.

https://www.mailgun.com/solutions/use-cases/transactional-email/

---------

Co-authored-by: Sean Whalen <44679+seanthegeek@users.noreply.github.com>
2024-05-22 08:44:14 -04:00
Lennart Friberg 91191e30f3 Fix if base_domain is None before get_service_from_reverse_dns_base_d… (#514)
* Fix if base_domain is None before get_service_from_reverse_dns_base_domain call

- Added if statement for base_domain before getting get_service_from_reverse_dns_base_domain(). If base_domain is None, get_service_from_reverse_dns_base_domain() will fail the report.
- Added .xml test file

* Create protection.outlook.com!example.com!1711756800!1711843200.xml

added .xml test sample report where base_domain return none
2024-05-22 08:36:13 -04:00
ChibangLW 42be53349f Fixes for kafka integration (#522)
* fix(kafka): set correct variables

* fix(kafka): made username and password optional.

The documentation states these as optional but in code these were mandatory.
2024-05-22 08:35:41 -04:00
yuji suzuki 20f451192f add gmail_api example to README.md (#518) 2024-05-22 08:35:16 -04:00
Sean Whalen 6e96b88a27 Always use local files when testing 2024-05-22 08:30:12 -04:00
yuji suzuki 201280d700 Fixed ci for Test sample DMARC reports (#520)
* Fixed ci for Test sample DMARC reports

* pip install local local folder

* pip install path fix
2024-05-22 08:14:04 -04:00
ryuksan f8ee9bd166 Fix new config variables previously not propagated in the code (#524) 2024-05-22 08:13:45 -04:00
Andrew Baumann ed92e0f7eb Remove unused parsedmarc.utils.tempdir (#517)
Parsedmarc.utils was creating a temp directory on every import, but this directory is no longer used anywhere.
2024-05-22 08:13:11 -04:00
yuji suzuki c150c7671f github actions run in all python versions and ci version up (#519) 2024-05-22 08:12:55 -04:00
Christian Clauss 6bd9aab925 README.md: Expand the acronym to help readers understand (#511) 2024-05-22 08:11:58 -04:00
Patrick Linnane f98dc6d452 build: move to kafka-python-ng (#510)
Signed-off-by: Patrick Linnane <patrick@linnane.io>
2024-05-22 08:11:29 -04:00
Russel Hunter Yukawa 7aa2e14cbb Fix for deadlock with large report (#508)
* add large xml sample

* Avoid deadlock

* Remove extra  whitespaces
2024-05-22 08:10:59 -04:00
Vermium Sifell 0b46c1807c Update base_reverse_dns_map.csv (#515) 2024-05-22 08:08:41 -04:00
Sean Whalen 11a9e959a0 Update base_reverse_dns_map.csv 2024-04-16 13:35:33 -04:00
Lennart Friberg b6a8739b4f Update base_reverse_dns_map.csv (#513)
Added Email Security provider
2024-04-15 10:06:45 -04:00
Sean Whalen a53d35a90c Revert "Update usage.md" PR #497 makes moot
This reverts commit 662b7b694b.
2024-04-08 10:41:16 -04:00
Sean Whalen 662b7b694b Update usage.md 2024-04-08 09:55:07 -04:00
Sean Whalen 6a06d01b44 8.11.0
- Actually save `source_type` and `source_name` to Elasticsearch and OpenSearch
- Reverse-lookup cache improvements (PR #501 closes issue #498)
- Update the included `dbip-country-lite.mmdb` to the 2024-03 version
- Update `base_reverse_dns_map.csv`
- Add new general config options (closes issue #500)
  - `always_use_local_files` - Disables the download of the reverse DNS map
  - `local_reverse_dns_map_path` - Overrides the default local file path to use for the reverse DNS map
  - `reverse_dns_map_url` - Overrides the default download URL for the reverse DNS map
2024-04-02 12:34:32 -04:00
Sean Whalen 422f7a074a Update base_reverse_dns_map.csv 2024-04-02 12:13:19 -04:00
Sean Whalen d6128eae9f Actually save source_tye and source_name to Elasticsearch and Opensearch 2024-04-01 09:14:45 -04:00
Sean Whalen 36eedcb446 Update dbip-country-lite.mmdb 2024-03-31 20:36:22 -04:00
Sean Whalen acef7bdd6e Code cleanup 2024-03-31 20:25:10 -04:00
Rod Payne 8936193280 Reverse-lookup cache improvements (#501) 2024-03-31 20:01:40 -04:00
Sean Whalen fd5b792c4a Close issue #500
Add the following general configuration options:

- `always_use_local_files` - Disables the download of the reverse DNS map
- `local_reverse_dns_map_path` - Overrides the default local file path to use for the reverse DNS map
2024-03-31 20:00:47 -04:00
Sean Whalen 041296b1f1 8.10.3
- Fix flaws in `base_reverse_dns_map.csv`
2024-03-29 14:17:40 -04:00
Sean Whalen 2e49db3c13 8.10.2
- Fix flaws in `base_reverse_dns_map.csv`
2024-03-29 14:02:30 -04:00
Sean Whalen 871d678d16 Update dmarc_aggregate_dashboard.xml 2024-03-28 19:38:31 -04:00