mirror of
https://github.com/domainaware/parsedmarc.git
synced 2026-08-03 14:12:20 +00:00
Stop seeding the large synthetic report into the dev dashboards (#844)
The 2,286-record stress-test report was ~99% of the seeded corpus, so every unfiltered dev dashboard showed its skew instead of a realistic mix — most visibly the almost-entirely-blank envelope_from column, since its records carry no envelope_from and empty SPF domains, which defeats the parser's SPF-domain fallback. Exclude it from the default seed with a comment explaining why and how to load it manually for scale or backfill testing. Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
co-authored by
Claude Fable 5
parent
864f11e2be
commit
14d881ef74
@@ -266,9 +266,14 @@ else
|
||||
# 2001:db8::, etc.) that won't resolve, so cap retries/timeout to bound
|
||||
# the cost of those NXDOMAIN-bound lookups. Intentionally invalid samples
|
||||
# (empty_reason.xml, invalid_xml.xml, etc.) are skipped from the list.
|
||||
# samples/aggregate/!large-example.com!1711897200!1711983600.xml is
|
||||
# deliberately NOT seeded: its 2,286 synthetic records would be ~99% of
|
||||
# the corpus, drowning the realistic mix on every unfiltered dashboard
|
||||
# (and its records carry no envelope_from and empty SPF domains, so that
|
||||
# column reads almost entirely blank). To load it for scale or backfill
|
||||
# testing, run the seed command below manually with that file appended.
|
||||
SAMPLE_FILES=(
|
||||
samples/aggregate/!example.com!1538204542!1538463818.xml
|
||||
samples/aggregate/!large-example.com!1711897200!1711983600.xml
|
||||
'samples/aggregate/Report domain- borschow.com Submitter- google.com Report-ID- 949348866075514174.eml'
|
||||
samples/aggregate/addisonfoods.com!example.com!1536105600!1536191999.xml
|
||||
samples/aggregate/estadocuenta1.infonacot.gob.mx!example.com!1536853302!1536939702!2940.xml.zip
|
||||
|
||||
Reference in New Issue
Block a user