Commit Graph

21 Commits

Author SHA1 Message Date
Sean Whalen d7366d088f Add DMARCbis report support; rename forensic→failure project-wide
Rebased on top of master @ 2cda5bf (9.9.0), which added the ASN
source attribution work (#712, #713, #714, #715). Individual Copilot
iteration commits squashed into this single commit — the per-commit
history on the feature branch was iterative (add tests, fix lint,
move field, revert, etc.) and not worth preserving; GitHub squash-
merges PRs anyway.

### DMARCbis fields (new)

New fields from the DMARCbis XSD, plumbed through types, parsing, CSV
output, and the Elasticsearch / OpenSearch mappings:

- ``np`` — non-existent subdomain policy (``none`` / ``quarantine`` /
  ``reject``)
- ``testing`` — testing mode flag (``n`` / ``y``), replaces RFC 7489
  ``pct``
- ``discovery_method`` — policy discovery method (``psl`` /
  ``treewalk``)
- ``generator`` — report generator software identifier (metadata)
- ``human_result`` — optional descriptive text on DKIM / SPF results

RFC 7489 reports parse with ``None`` for DMARCbis-only fields.

### Forensic → failure rename

Forensic reports have been renamed to failure reports throughout the
project to reflect the proper naming since RFC 7489.

- Core: ``types.py``, ``__init__.py`` — ``ForensicReport`` →
  ``FailureReport``, ``parse_forensic_report`` →
  ``parse_failure_report``, report type ``"failure"``.
- Output modules: ``elastic.py``, ``opensearch.py``, ``splunk.py``,
  ``kafkaclient.py``, ``syslog.py``, ``gelf.py``, ``webhook.py``,
  ``loganalytics.py``, ``s3.py``.
- CLI: ``cli.py`` — args, config keys, index names
  (``dmarc_failure``).
- Docs + dashboards: all markdown, Grafana JSON, Kibana NDJSON,
  Splunk XML.

Backward compatibility preserved: old function / type names remain as
aliases (``parse_forensic_report = parse_failure_report``,
``ForensicReport = FailureReport``, etc.), CLI accepts both the old
(``save_forensic``, ``forensic_topic``) and new (``save_failure``,
``failure_topic``) config keys, and updated dashboards query both
old and new index / sourcetype names so data from before and after
the rename appears together.

### Rebase notes

Merge conflicts resolved in ``parsedmarc/constants.py`` (took bis's
10.0.0 bump), ``parsedmarc/__init__.py`` (combined bis's "failure"
wording with master's IPinfo MMDB mention), ``parsedmarc/elastic.py``
and ``parsedmarc/opensearch.py`` (kept master's ``source_asn`` /
``source_asn_name`` / ``source_asn_domain`` on the failure doc path
while renaming ``forensic_report`` → ``failure_report``), and
``CHANGELOG.md`` (10.0.0 entry now sits above the 9.9.0 entry).

All 324 tests pass; ``ruff check`` / ``ruff format --check`` clean.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-23 02:26:30 -04:00
Sean Whalen 0720bffcb6 Remove extra spaces 2025-06-10 19:05:06 -04:00
Sean Whalen fecd55a97d Add SMTP TLS Reporting dashboard for Splunk
Closes #600
2025-06-10 18:54:43 -04:00
Sean Whalen 871d678d16 Update dmarc_aggregate_dashboard.xml 2024-03-28 19:38:31 -04:00
Sean Whalen 7a8781ef5c Update dmarc_aggregate_dashboard.xml 2024-03-28 16:07:13 -04:00
Sean Whalen 29fe768772 Update dmarc_aggregate_dashboard.xml 2024-03-27 18:00:35 -04:00
Sean Whalen 1f9a5ffe58 Splunk dashboard bug fixes 2024-03-27 17:19:58 -04:00
Sean Whalen 26f62082c3 Update Splunk dashboards 2024-03-27 15:40:19 -04:00
Matthäus Wander ca36db5f24 Minor formatting 2021-06-09 14:33:52 +02:00
Matthäus Wander 837ba7ef4d Added splunk installation guide 2021-06-09 14:33:52 +02:00
Christophe Vandeplas e583728d4b chg: [splunk] adding source_base_domain as filter
this is quite useful when pivoting on data
2020-05-11 16:53:54 +02:00
Christophe Vandeplas b01b8d9374 fix: [splunk] correct default index for splunk dashboard 2020-05-06 08:15:15 +02:00
Sean Whalen 95477bb818 Update UIs 2020-01-23 13:58:25 -05:00
Sean Whalen 6fd80ebdee Update dmarc_forensic_dashboard.xml
Closes issue #117
2019-10-23 10:06:04 -04:00
Sean Whalen 3b366a24e4 Use dark theme in Splunk dashboards 2019-04-24 15:41:40 -04:00
Sean Whalen df1c2bac5f Fix Splunk forensic dashboard sorting 2018-10-09 11:12:00 -04:00
Sean Whalen 625089a12c 4.1.1 2018-09-29 13:25:27 -04:00
Sean Whalen 32c46795e8 Fix time range in Splunk aggregate dashboard 2018-09-28 08:31:22 -04:00
Sean Whalen b22fa6fdf7 Remove DKIM specific filters from splunk dashboards
Filtering on data that does not exist led to incomplete dashboards
2018-09-28 00:30:08 -04:00
Sean Whalen c5e44327b3 Remove implicit wildcards from Splunk dashboards 2018-09-28 00:08:49 -04:00
Sean Whalen db2625fff9 Add Splunk dashboard source XML 2018-09-27 23:49:32 -04:00