You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reloa
8000
d to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Evaluate Jev re-ranking for brain vector retrieval #47
Use Jev to re-rank a bounded shortlist from brain vector retrieval, so coordinator context contains only relevant, provenance-preserving excerpts rather than a broad unfiltered result set.
Flow
Build a compact search input from the latest directive plus bounded current-task context.
Run existing vector retrieval for a small shortlist.
Ask Jev to select a candidate ID or no_match from code-supplied IDs, titles and excerpts.
Inject at most the selected one or two excerpts, with source path and timestamp.
If probability/confidence is below the evaluated threshold or returns no_match, make a deterministic second retrieval pass: broader K and the latest directive alone. Re-rank the union.
If still unsuitable, inject no brain result and continue normally.
Guardrails
Jev ranks supplied candidates only. It cannot create a query, source or fact.
Preserve candidate IDs, paths and timestamps in every result.
Cache by message ID, index version and candidate hashes.
Use only bounded task context, never raw full conversation history.
A low-confidence result is a retrieval abstention, not a claim that no relevant brain content exists.
Acceptance
Offline evaluation against labelled historical recall tasks compares baseline vector ranking with Jev re-ranking.
Migrated from Linear: INK-931. The original wording is retained except the disclosed privacy and rendering edits below.
Current scope and qualifications
The description above is the original Linear account, including its historical findings and scope. It is not a fresh claim that every described defect still exists.
Current Linear state is Backlog. Prior source review recorded open, with this remaining scope:
Run approved held-out recall evaluation and derive threshold before enabling; reuse in INK-963.
Publication transfers the task; it does not authorise live recovery, deployment, spending or configuration changes.
Activity