Repository navigation
Add index integrity check (verify) and public rebuild-indexes-from-fact-pages #373
Description
Summary
Split out of #370. An index that disagrees with the fact pages is currently silent: the file opens, scans work, and entity-bound queries return []. There is also no public way to rebuild the indexes from the fact pages.
Asks
- Integrity check. A
(verify)command / API, and/or cheap on-open sampling, that compares index cardinalities (EAVT vs AEVT vs fact count) and spot-resolvesFactRefs, so this state raises an error instead of returning wrong answers. The on-disk checksum can pass while refs are wrong (see the root cause fixed for bug: after a kill during an active run the EAVT index silently loses most entities' entries while AEVT stays intact — entity-bound lookups return [] and no rebuild path exists #370), so a checksum alone is not enough. - Public rebuild. An operation (e.g.
Minigraf::rebuild_indexes()) that rebuilds all four indexes from the fact pages.checkpoint()cannot serve as repair because it streams the existing indexes and copies any hole forward. This is also the only recovery path for files already rebuilt with the bad refs before the bug: after a kill during an active run the EAVT index silently loses most entities' entries while AEVT stays intact — entity-bound lookups return [] and no rebuild path exists #370 fix.
Context
- Reporter's file: 2.29 GB graph, fact pages intact, EAVT lookups empty for most entities.
- Fix for the rebuild-on-open cause: see the PR referencing bug: after a kill during an active run the EAVT index silently loses most entities' entries while AEVT stays intact — entity-bound lookups return [] and no rebuild path exists #370.
Philosophy check
Aligned: single file, zero config, reliability over features. An explicit rebuild adds no new format or dependency.
Refs #370
Activity
release: v2.0.1 — fix index rebuild on open (#370)
Merge pull request #458 from project-minigraf/feat/373-verify-rebuild
adityamukho commentedon Oct 6, 2026
Implemented on
v3in #458 (185196b):Minigraf::verify()andMinigraf::rebuild_indexes(). Opening a v2.x (format v7) file with v3.0.0 also rebuilds every index from the fact pages during the v7→v8 migration, so files damaged by the #370 bug are repaired on upgrade.Left open because it still affects v2.x: there is no repair on the 2.x line. It closes when v3.0.0 is published (see #421).
adityamukho commentedon Oct 14, 2026
Fixed on
v3in #458 (Minigraf::verify(),Minigraf::rebuild_indexes(); v7→v8 migration rebuilds every index). Closed under the close-on-merge rule for the unreleasedv3branch (CONTRIBUTING.md, #585). It stays listed in #421 for v2.x, with fix version v3.0.0.