Prediction performance and evidence
Created by Franz Bettag, applied AI engineering and AI security, Nürnberg/Fürth.
Generated at 2026-09-05T19:39:17.899738924+00:00. Methodology 1.0. Download the complete JSON ledger.
What these numbers measure
Retained public evidence only. Confirmation timestamps are source publication times, not verified technical reset times. Missing resets outside this monitored evidence universe cannot be measured. Model-release rumors are inferences, not reset predictions or confirmations.
Advance notice starts when this service first stored the incoming signal, never at an earlier tweet timestamp. A match requires the same stored event, audience and scope. A confirmed announcement is not independent proof that every account received a reset. Late discoveries do not count as predictions.
Only explicit retractions count as confirmed false positives. Expiry without corroboration remains unconfirmed. Observed resets without prior notice are misses within the retained evidence, not an estimate of all resets. Historical forecast windows were mutable and are therefore not backfilled. There is no defensible overall accuracy percentage yet.
- Confirmed with advance notice
- 4
- Observed resets without advance notice (observed misses)
- 8
- Retracted false positives
- 0
- Expired, unconfirmed signals
- 7
- Pending signals
- 0
- Model rumors, not scored as reset predictions
- 1
- Median advance notice to confirmation publication
- 32857 seconds
Timestamped ledger
MAYBE/model rumors are inferred. YES is qualifying first-party reset evidence; only an effective-phase source confirms the outcome. Rows preserve this distinction.
| Provider and signal | First observed / source | Assessment | Confirmation / source | Advance notice |
|---|---|---|---|---|
| codex first_party_reset_signal | Source | expired_unconfirmed | Not confirmed | Not available |
| codex first_party_reset_signal | Source | expired_unconfirmed | Not confirmed | Not available |
| grok first_party_reset_signal | Source | expired_unconfirmed | Not confirmed | Not available |
| claude first_party_reset_signal | Source | confirmed_with_advance_notice | 2026-09-01T18:35:27+00:00 Source | 1200 s |
| grok first_party_reset_signal | Source | confirmed_with_advance_notice | 2026-09-01T15:45:03+00:00 Source | 56034 s |
| codex first_party_reset_signal | Source | unmatched_scope_or_missing_evidence | Not confirmed | Not available |
| codex first_party_reset_signal | Source | unmatched_scope_or_missing_evidence | Not confirmed | Not available |
| codex first_party_reset_signal | Source | expired_unconfirmed | Not confirmed | Not available |
| codex confirmed_reset_observation | Source | observed_reset_without_advance_notice | 2026-08-27T16:35:05+00:00 Source | Not available |
| grok confirmed_reset_observation | Source | observed_reset_without_advance_notice | 2026-08-26T19:12:39+00:00 Source | Not available |
| codex first_party_reset_signal | Source | unmatched_scope_or_missing_evidence | Not confirmed | Not available |
| codex confirmed_reset_observation | Source | observed_reset_without_advance_notice | 2026-08-22T00:50:36+00:00 Source | Not available |
| codex first_party_reset_signal | Source | confirmed_with_advance_notice | 2026-08-21T23:40:34+00:00 Source | 41775 s |
| codex first_party_reset_signal | Source | expired_unconfirmed | Not confirmed | Not available |
| grok first_party_reset_signal | Source | expired_unconfirmed | Not confirmed | Not available |
| codex first_party_reset_signal | Source | expired_unconfirmed | Not confirmed | Not available |
| claude confirmed_reset_observation | Source | observed_reset_without_advance_notice | 2026-07-16T03:58:48+00:00 Source | Not available |
| claude confirmed_reset_observation | Source | observed_reset_without_advance_notice | 2025-12-27T00:19:49+00:00 Source | Not available |
| codex first_party_reset_signal | Source | confirmed_with_advance_notice | 2026-08-13T01:01:37+00:00 Source | 23940 s |
| claude confirmed_reset_observation | Source | observed_reset_without_advance_notice | 2025-12-24T21:02:48+00:00 Source | Not available |
| claude confirmed_reset_observation | Source | observed_reset_without_advance_notice | 2025-12-24T21:26:27+00:00 Source | Not available |
| codex confirmed_reset_observation | Source | observed_reset_without_advance_notice | 2026-08-11T00:28:16+00:00 Source | Not available |
| codex inferred_model_release_rumor_not_reset | Source | not_scored_as_reset_prediction | Not confirmed | Not available |
Empty ledger means insufficient data, not zero errors or perfect predictions.