Repository navigation
chore: migrate io-auto-mode classifier defaults to gemini-3.1-flash-lite - #1
Merged
Merged
Conversation
Switch DEFAULT_CONFIG stage1Model and stage1Fallback from google/gemini-2.5-flash to google/gemini-3.1-flash-lite, and update the README and INSTALL default tables/prose to match. Stage 2 (stage2Model / stage2Fallback) is left on gemini-2.5-flash: it is the deliberate thinking classifier for escalated blocks, and flash-lite is text-optimised. Not switched here. Verified via a probe replicating the live model-call.ts config (no thinkingConfig) at Stage 1's maxOutputTokens of 8: flash-lite returns a clean one-word decision (finishReason STOP, non-empty, parseable ALLOW/ BLOCK). The incumbent gemini-2.5-flash returns empty at maxTokens 8 (finishReason MAX_TOKENS, thoughtsTokenCount consumes the budget), so this also removes a latent empty-output failure mode on the classify path. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Per Simon's decision, Stage 2 now also defaults to gemini-3.1-flash-lite (stage2Model + stage2Fallback in DEFAULT_CONFIG), completing the sweep so all four stage slots use flash-lite. README and INSTALL default tables, example config, and prose updated to match. Verified against the live model-call.ts config (no thinkingConfig) at Stage 2's real call shape: maxOutputTokens 2048, the JSON reasoning prompt (STAGE2_SUFFIX), and escalated-block style inputs. flash-lite returns clean non-empty output on primary and fallback prompts: finishReason STOP, candidatesTokenCount ~115-148 (well under budget), parseable JSON with a valid ALLOW/ASK/BLOCK decision and a populated thinking field, so the prompted chain-of-thought reasoning is retained. No empty-output or MAX_TOKENS truncation (the Sentinel failure mode) observed. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Migrates all four classifier stage slots in
DEFAULT_CONFIG(plus the matching README/INSTALL default tables, example config, and prose) fromgoogle/gemini-2.5-flashtogoogle/gemini-3.1-flash-lite.What changed
stage1Model,stage1Fallback,stage2Model,stage2Fallback->google/gemini-3.1-flash-liteVerification (both stages probe-verified against the live model-call.ts config, no thinkingConfig, GEMINI_API_KEY from env)
finishReason=STOP, non-empty, parseable ALLOW/BLOCK with correct decisions. The incumbentgemini-2.5-flashreturns EMPTY at maxTokens 8 (finishReason=MAX_TOKENS, thinking consumes the budget), so this also fixes a latent empty-output failure on the classify path.finishReason=STOP, non-empty, valid parseable JSON with a legal ALLOW/ASK/BLOCK decision and a populatedthinkingfield, so the prompted chain-of-thought reasoning is retained. No MAX_TOKENS truncation.Blast radius
Inert until config cutover: the live
~/.io-auto-mode/config.jsonhardcodes all four stage models and runsyolomode, so this default change takes effect only when that config is updated.Test suite: 211/211 pass (32 suites).
Co-Authored-By: Claude Opus 4.8 (1M context) noreply@anthropic.com