Files
Europa/Nuvolari/docs/data-sources.md
T
Alby96andClaude Opus 5 f3a0e3794a Narrow scope to radar, and put the app on a real OpenStreetMap base map
Drops forecasts, lightning, the home-screen widget and advertising. What
remains is radar on a map, the official ARPA alert bulletin, and rain
notifications.

The base map is now OpenFreeMap's Positron style: real OpenStreetMap vector
tiles with no API key, no registration, no request limits and commercial use
permitted. Every other free tier — MapTiler, Stadia, Jawg, Thunderforest —
needs a key, which is a secret to manage, a quota to outgrow and a signup to
complete before anyone can build the project, and the map is the one thing the
app cannot work without. Positron rather than Liberty or Bright because the
radar overlay has to be the loudest thing on screen, and a desaturated grey
base is built to sit under data.

Its style JSON carries no `attribution` field, so MapLibre displays no credits
by itself. The app renders them from the region config instead: the two
mandatory credits, OpenStreetMap and OpenMapTiles, go in the always-visible
bar, and OpenFreeMap's own credit — optional by their terms — is listed on the
Sources screen with the rest. The bundled offline style is still reachable with
MAP_STYLE_URL=offline, and still claims no base map attribution, because
crediting OpenStreetMap while showing it would be a false claim.

Radar-DPC stays the source. ARPA Piemonte's own radar remains a disabled stub
for two reasons that belong to the project owner, not to the code: the
real-time access link is only issued by email, and the open-data page states
the data is "gratuiti" and nothing else. Free of charge is not a licence, and
rendering those volumes into frames served from a CDN is redistribution. Both
questions go in the same email. An earlier draft of the docs recorded ARPA
radar as CC BY 4.0; the source page does not support that, so the claim is
removed rather than carried forward.

The documentation is updated throughout rather than annotated: CLAUDE.md gains
an explicit scope boundary, data-sources drops MET Norway and ISTAT and gains
the base map, licenses records that free of charge is not a licence, privacy
loses the whole advertising section, and the roadmap is renumbered so the
backend worker is next — until it exists, DpcRadarSource has nothing to read.

licenses.md keeps Open-Meteo and Blitzortung listed as excluded even though the
features that would have used them are gone: both are non-commercial-only, ads
are a plausible future, and neither should be adopted on the grounds that there
are none today.

Verified: analyze clean, 130 tests passing, and on the emulator the radar
overlay sits correctly over Piedmont on real OSM tiles with Turin, Milan and
Genoa labelled, the age reads "Aggiornato 4 minuti fa", and the Sources screen
lists all five credits with their licences.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-10 16:10:29 +02:00

11 KiB
Raw Blame History

Data sources

Every endpoint below was verified on 2026-09-10. Anything not verified is marked TO VERIFY and must not be relied on until checked.

1. Radar — Radar-DPC (the active source)

Public platform of the Italian Dipartimento della Protezione Civile.

  • Base URL: https://radar-api.protezionecivile.it/
  • Transitional test base URL: https://wagiqofvnk.execute-api.eu-south-1.amazonaws.com/prod

GET /findLastProductByType?type=<PRODUCT>

Returns the timestamp of the most recent sample of a product.

{
  "total": 1,
  "lastProducts": [
    { "productType": "VMI", "time": 1758706200000, "period": "PT5M" }
  ]
}
  • time is epoch milliseconds, UTC.
  • period is the ISO-8601 cadence of the product.
  • 400 when type is missing, 404 when no product is available.

POST /downloadProduct

Returns a pre-signed S3 URL for the raw raster file.

{ "productType": "VMI", "productDate": 1758706200000 }
{
  "bucket": "dpc-radar",
  "key": "VMI/22-09-2025-14-20.tif",
  "url": "https://dpc-radar.s3.eu-south-1.amazonaws.com/...",
  "expiresSeconds": 900
}
  • productDate must be rounded down to the product step, otherwise 404.
  • Pre-signed URLs expire after 300900 s: download immediately, never cache the URL.
  • 400 when productDate is missing or non-numeric.

Mandatory header

origin: https://radar.protezionecivile.it

Required on every request to the platform for security reasons; requests without it are rejected. Content-Type: application/json is also required on downloadProduct.

Products and cadence

Cadence Products
5 min VMI, SRI, SRT1, IR_108
3060 min TEMP, CUM3, CUM6, CUM12, CUM24, CAPPI_1CAPPI_10, VIL, ETM, POH
SITES (GeoJSON, fetched directly from S3 with GET)

The MVP uses VMI (Vertical Maximum Intensity) as the precipitation layer. History retention is 14 days. Files are GeoTIFF; CRS is read from the file metadata rather than assumed — the worker reprojects to EPSG:3857 in all cases.

Raster format (read from a live VMI file, 2026-09-10)

Property Value
Size 1200 × 1400 px
Pixel size 1000 × 1000 m — a 1 km grid
Bands / type 1 band, Float32, LZW compressed
Tie point raster (0,0) → model (-600000, 650000)
Model type projected, datum WGS84 (GeographicTypeGeoKey 4326)
Projection centre 12.5° E, 42.0° N (ProjCenterLong/ProjCenterLat)
Linear units metre
Nodata tag absent — expect NaN

The rasters are not in EPSG:4326 and not in EPSG:3857. They are on a custom projection centred on Italy, so reprojection to Web Mercator is mandatory, not an optimisation. The extent works out to 1200 km east-west and 1400 km north-south around that centre, which covers the whole country — the worker crops to the region bounding box before doing anything else, so it never carries the full mosaic through the pipeline.

The GeoKeys as written are internally inconsistent (ProjCoordTransGeoKey = 1, which is transverse Mercator, combined with the centre keys an azimuthal projection uses). Do not hardcode a source CRS. The worker reads the CRS from the file with rasterio and warps from whatever it finds, and logs the detected CRS on every run so a change at the source is visible instead of silently shifting the imagery.

Values are physical units (dBZ for VMI), not palette indices — the colour mapping is ours, and the legend that goes with it is published in the manifest.

Push channel

wss://radar-wss.protezionecivile.it pushes a notification whenever a new sample is published. The worker uses this as its primary trigger, with a 5-minute cron as a fallback, so we never poll DPC aggressively.

License

CC BY-SA. Attribution to "Radar-DPC" is mandatory and derived products must be released under the same license. The rendered PNG frames we publish are a derived product and inherit CC BY-SA.

Docs: https://dpc-radar.readthedocs.io/it/latest/

2. Radar — ARPA Piemonte (future adapter, disabled)

C-band polarimetric radars at Bric della Croce and Monte Settepani, scanning every 5 minutes. Real-time volumes of reflectivity, Doppler velocity and differential reflectivity are published in OPERA HDF5 (ODIM) format, covering the last hour.

Listed as open data at https://www.arpa.piemonte.it/dato/open-data, described there as constantly updated, machine-readable and free of charge.

Two things block adoption, and both belong to the project owner, not to the code:

  1. The access link is not public. The page states that to obtain the real-time link for radar and radiosonde data "è necessario inviare una e-mail all'indirizzo info.meteo@arpa.piemonte.it". There is no documented endpoint to call without it.
  2. No licence is stated. The page says the data is gratuiti — free of charge — and nothing more. Free of charge is not a licence. Rendering these volumes into PNG frames and republishing them through a CDN to app users is redistribution, and without stated terms there is no permission to point at. The email should ask for the reuse terms as well as the link.

Until both are answered, ArpaRadarSource stays a stub whose every method throws. It is named by the region config as unavailable so the seam is visible, not because it is nearly ready.

Earlier drafts of this document recorded ARPA radar as CC BY 4.0. The open-data page does not support that, so the claim has been removed rather than carried forward.

3. Forecast — out of scope

The app shows radar, not forecasts. No forecast provider is integrated, and MET Norway, ItaliaMeteo ICON-2I and Open-Meteo are all out of scope. See CLAUDE.md for the current scope boundary.

4. Alerts — ARPA Piemonte XML-CAP

Issued daily by 13:00 by the Centro Funzionale Regionale, 36 hours of validity.

Alert zones (11)

Piem-APiem-M (A, B, C, D, E, F, G, H, I, L, M), covering: Toce; Val Sesia/Cervo/ Chiusella; Valli Orco/Lanzo/bassa val Susa/Sangone; Alta val Susa/Chisone/Pellice/Po; Valli Varaita/Maira/Stura; Valle Tanaro; Belbo e Bormida; Scrivia; Pianura settentrionale; Pianura e colline torinesi; Pianura cuneese. The exact code-to-name mapping is stored in app/assets/regions/piemonte.json.

CAP document structure (verified against the live feed, 2026-09-10)

One <alert> contains one <info> block per zone; the zone is in info/area/areaDesc and holds the bare code (Piem-A), not a name.

<alert xmlns="urn:oasis:names:tc:emergency:cap:1.2">
  <identifier>261/2026</identifier>          <!-- bulletin number / year -->
  <sender>centro.funzionale@arpa.piemonte.it</sender>
  <sent>2026-09-09T10:00:02+00:00</sent>
  <status>Actual</status><msgType>Alert</msgType><scope>Public</scope>
  <note>AVVISO DI CONDIZIONI METEOROLOGICHE AVVERSE ...</note>
  <info>
    <event>GIALLO</event>                    <!-- overall level for this zone -->
    <onset>...</onset><expires>...</expires>
    <parameter><valueName>EFFETTI SUL TERRITORIO</valueName><value>...</value></parameter>
    <parameter><valueName>TEMPORALI_1224</valueName><value>GIALLO</value></parameter>
    <parameter><valueName>TEMPORALI_2436</valueName><value>VERDE</value></parameter>
    ...
    <area><areaDesc>Piem-A</areaDesc></area>
  </info>
  <!-- 10 more info blocks, one per zone -->
</alert>

Parameters are named <CATEGORY>_<WINDOW>:

  • CategoriesIDRAULICO, IDROGEOLOGICO, TEMPORALI, NEVE, VALANGHE.
  • Windows1224 (hours 1224) and 2436 (hours 2436), matching the 36 hours of validity.

So each zone carries 10 level values plus one overall <event> level and a free-text EFFETTI SUL TERRITORIO.

Levels — six values, not four

Value Meaning
VERDE no significant phenomena
GIALLO localised phenomena
ARANCIONE widespread phenomena
ROSSO numerous or extensive phenomena
BIANCO avalanche scale only — outside the season / not assessed
- no value published for that category and window

BIANCO and - are not "green with a different name" and must not be collapsed into it. The parser models the level as an enum with explicit bianco and notAvailable members, and the UI renders them as their own state rather than as "no alert".

Levels are republished verbatim, never reinterpreted, always alongside a link to the official bulletin. No license is stated on the ARPA page, so we credit ARPA Piemonte and link the source rather than claiming any reuse right.

Official bulletin PDF, linked from every alert view: https://www.arpa.piemonte.it/rischi_naturali/boll/bollettino_allerta.pdf

Zone codes

Piem-APiem-M, eleven zones: the Italian alphabet is used, so J and K do not exist — the sequence is A B C D E F G H I L M. The code-to-name mapping lives in app/assets/regions/piemonte.json; the human-readable names are not in the feed and come from the ARPA zone documentation.

A captured copy of the live feed is kept as a test fixture so the parser is verified against the real document rather than a hand-written approximation.

5. Base map — OpenFreeMap

OpenStreetMap vector tiles served by OpenFreeMap (https://openfreemap.org).

  • Style in use: https://tiles.openfreemap.org/styles/positron
  • Tiles: https://tiles.openfreemap.org/planet
  • Glyphs: https://tiles.openfreemap.org/fonts/{fontstack}/{range}.pbf

No API key, no registration, no request limits, commercial use permitted. That is what makes it the right starting point: every other free tier — MapTiler, Stadia, Jawg, Thunderforest — requires a key, which means a secret to manage and a quota to outgrow.

Positron rather than Liberty or Bright: a radar overlay has to be the loudest thing on screen, and Positron is a desaturated grey base designed to sit under data. On Liberty the precipitation colours compete with road casings and landuse fills.

Mandatory credits

Credit Required?
© OpenStreetMap contributors (ODbL) yes
© OpenMapTiles yes
OpenFreeMap optional, and appreciated

The style JSON carries no attribution field, so MapLibre will not display these on its own. The app renders them itself from the region config: the two mandatory credits go in the always-visible attribution bar, and all three are listed on the Sources screen.

When there is no network

With MAP_STYLE_URL=offline the app generates a self-contained style from the region bounding box — flat background plus the extent outline, no network sources at all. It is deliberately plain so it is never mistaken for a finished map, and it is what the widget tests run against.

6. Lightning — out of scope

Not part of the app. If it is ever revisited: Blitzortung prohibits commercial use, and the DPC LTG product is the source to reach for instead.