Research and sources

Citing a paper does not mean this website has been scientifically validated.

What the tests tell us

The model is experimental. Past tests do not prove future accuracy.

See the research details

We tested 1-, 7- and 30-day earthquake counts at magnitude 2, 3 and 4 or greater. We also tried fitting ETAS to the previous three years, updating its parameters once a year. All comparisons use the same dates and recorded events.

The starting date is uncertain. Our original M2+ screen selected 2014. Changing the test settings selects 2022 or 2025; the strictest setting finds no passing period. This does not tell us exactly how many earthquakes are missing. It means that “complete since 2014” would be too strong a claim.

Compare the test results

Lower scores mean less error across the possible earthquake counts. These are error scores, not earthquake magnitudes or probabilities. Each row is a separate comparison. “Recent average” uses the previous year.

Swipe sideways to see the rest of the table.

Retrospective count error (CRPS), 2019–2026
Period / magnitudeTestsFixed ETASUpdated ETASRecent average
1 days · M2+940.550.520.67
1 days · M3+940.130.130.15
1 days · M4+940.010.010.01
7 days · M2+943.462.392.84
7 days · M3+940.580.510.6
7 days · M4+940.140.140.14
30 days · M2+9420.6512.6713.44
30 days · M3+943.052.743.09
30 days · M4+940.470.470.48

The catalog was revised later, and we had already examined some of these periods. These are research comparisons, not independent proof of future accuracy. We have not selected a winning model or promoted these candidates to the live model.

Keeping only ML magnitudes would remove 444 of 6844 M2+ records since 2014. We retain the reported scales and do not invent conversions.

These tests cannot tell when or where a large earthquake will happen. They do not estimate M7 probability or building safety.

Methods, papers and downloadable data

Seif et al. (2017) · Wiemer & Wyss (2000) · Kumazawa & Ogata (2013) · CSEP

Our rolling stationary refit is a simpler control, not a reproduction of the paper’s penalized nonstationary ETAS. Parameter profiles refit the other parameters, but are not calibrated confidence intervals.

All test results (JSON) · Catalog checks (JSON) · Sequence checks (JSON) · Earlier-event checks (JSON) · Parameter sensitivity (JSON)

Earlier comparison (95 windows)

New research: a longer comparison

We compared four approaches in 95 seven-day windows from 2019 to 2026. Issue dates are 30 days apart. This uses a later-revised catalog, not forecasts saved before the earthquakes.

Error across the possible count distribution — lower is better (CRPS)
MethodScore
Full-history average4.8
Past-year average2.85
Past-year variable counts2.82
Offline ETAS candidate3.36

The recent-rate controls scored better than the new ETAS candidate here. The fit still hit a parameter bound. We have not replaced the live model or established future reliability.

Research details

Parameters frozen using 2014–2018; 200 simulated futures per result. Regional M2+ counts only. Conditional uncertainty; no M7 probability, building-safety or fault-rupture inference. Historical cutoff choice, native magnitude differences and limited simulations remain limitations.

Download research data (JSON) · Download calibration checks (JSON) · Download catalog audit (JSON)

Earthquake hazard after a mainshock in California

Reasenberg, P. A.; Jones, L. M. · 1989 · Science · 243, 1173–1176

Foundational probabilistic aftershock work. California coefficients are not copied into Marmara; parameters here are fitted from regional observations.

Earthquake likelihood model testing

Schorlemmer, D.; Gerstenberger, M. C.; Wiemer, S.; Jackson, D. D.; Rhoades, D. A. · 2007 · Seismological Research Letters · 78, 17–29

Motivates predefined evaluation of forecasts. The retrospective count tests here are not a full RELM/CSEP validation exercise.

The GEM Global Active Faults Database

Styron, R.; Pagani, M. · 2020 · Earthquake Spectra

Published source of the map’s traces. Original selected geometry and provenance are retained; this does not support parcel-level safety assessments.

pyCSEP — Forecast evaluation documentation

Collaboratory for the Study of Earthquake Predictability · 2026 · Software documentation

Evaluation reference. Standard independent-Poisson tests are not applied directly to clustered ETAS counts.

ETAS reference implementation

Swiss Seismological Service · 2026 · Research software · MIT license

Research reference for method comparison. The live site does not run this package.