News is the first input of Phase 7. Every two minutes the "notizie" job asks each
enabled feed conditionally and backs off a failing one up to an hour.
- Parsing: RSS 2.0, RSS 1.0 and Atom are read without DTDs or entity expansion, so a
hostile feed reads nothing from disk.
- Deduplication: articles are deduplicated by canonical URL.
- Grouping: retold titles join one story by word similarity within 48 hours, and
independent publishers are counted by registrable domain.
- Linking: stories are linked to instruments by source symbols, cashtags, exchange
tickers, coin tickers and capitalised company names; to the crypto or equity class
or to the market by theme; to the source topic as a fallback.
ADR 0014 records the thresholds. The tests read a synthetic archive in each source's
real format and run on both engines.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>