01 The idea
Every personal-AI memory system stores what you said. None of them store whether you were right.
That is a strange gap, because the single most useful thing a system could know about you is the shape of your errors: that you are consistently early on timelines, or overconfident about hiring, or too bearish on your own projects. Facts make an assistant informed. A track record makes it useful.
Hindsight extracts gradeable predictions from your own writing, grades them against what actually happened, finds the places you contradicted yourself, and builds a calibration profile, which then gets applied when the AI gives you advice.
02 How it works
03 Your calibration profile
A calibration profile, computed live. Toggle how each past prediction actually turned out and watch the profile change. This is the number a memory system cannot give you, because it stores what you said and not whether it happened.
Brier score is the mean squared error between your stated confidence and what happened: 0 is perfect, 0.25 is a coin flip, and above that you would do better inverting yourself.
04 What happened next
-
Two days after the hackathon, GBrain shipped v0.36.1.0, titled in its
own release notes as the “Hindsight calibration wave”.
88 files, ~11,900 lines, adding exactly this loop: extract gradeable claims, grade them
over time, apply the resulting bias profile when giving advice.
Commit
3a0e111↗ -
The name is load-bearing in the codebase, not a passing mention. It is in the database
migrations, the design doc, and the architecture map, every one of these is a link
you can check:
src/schema.sql:1371 ↗, “v0.36.1.0 Hindsight calibration wave (migrations v67-v71)”
docs/architecture/KEY_FILES.md:543 ↗, “## Hindsight calibration (key files cluster)”
DESIGN.md:5 ↗, “formalized during the v0.36.1.0 Hindsight calibration wave’s design review” - GBrain’s own benchmark documentation lists Hindsight alongside MemCog, Zep, ByteRover and Supermemory as comparable systems in the personal-AI memory space, docs/eval-bench.md:482 ↗. The repository has ~29.7k stars, so this is not a quiet corner of GitHub.
-
To be precise about credit: this was an independent reimplementation at
production scale, not our code. GBrain had claim extraction ten days before the hackathon
(
src/core/cycle/extract-takes.ts, v0.28.6). What was new was closing the loop, grading claims against outcomes and feeding the bias profile back into advice, and Garry Tan credited the submission publicly for the idea. Their release also added the quantified evaluation ours never had.
Honest limits. Ours was a weekend skills demo with no quantified evaluation. We showed the loop worked on a handful of hand-picked examples and never measured extraction quality or grading accuracy. That is precisely the gap the production version closed with its cat14 and cat15 benchmarks, and it is a fair criticism of what we shipped.