8000 mini-verl/PROJECT_STATE.md at v0.9.1 · roomfun/mini-verl · GitHub
[go: up one dir, main page]

Skip to content

Latest commit

 

History

History
58 lines (44 loc) · 2.58 KB

PROJECT_STATE.md

File metadata and controls

58 lines (44 loc) · 2.58 KB

PROJECT_STATE

Current maintainer handoff for miniVERL (mini-verl package, miniverl CLI). release-state.yaml is the canonical version source; this page indexes current product and evidence state rather than repeating release history.

Last updated: 2026-08-13.

Canonical release state: releasing v0.9.1.

Release state

Current product boundary

The primary product is verl-opd-v0.8-single-gpu-v1: a typed, resolved subset of official verl v0.8.0 at commit 7aed6b230776f963fa09509c10d9c3a767d1102c. It runs one actor, one teacher, n=1, reward-free direct GKD forward_kl_topk and token-mean reduction in one local process on one NVIDIA CUDA GPU.

The v0.9.1 development repair makes dtype, quantization, attention, student adapter input, logical/physical batch limits and placement legality explicit. Executable compatibility claims are mutation-tested and recorded in docs/generated/verl-opd-v0.8-field-effects.json. Quantized roles cannot swap; unknown-size quantized roles require proof instead of receiving an executable plan.

Arbitrary verl YAML, policy-gradient OPD, rewards, PPO/GRPO, Ray, FSDP, Megatron, multi-GPU and distributed execution remain unsupported. The legacy environment/PPO artifact bridge is migration-only.

Current evidence

Evidence Status
Qwen3-0.6B/1.7B developer workload 32 prompts, 8 current-policy updates, 3.1914 GiB peak reserved on one RTX 4080; matched interruption/resume was byte-identical
SmolLM2-360M/1.7B one pinned compatibility smoke; not a second measured recipe
external alignment v1 preregistered early stop: 0 selected checkpoints, teachers, continuation arms or final-test accesses
distributed verl execution not tested

Frozen benchmark and task-level result JSON/JSONL remain immutable. The calculator schema-v2 source stays at SHA-256 53fc1d4d5b7adee09618d77ad62d4086ba56b78569832d6fc7c3bcd5c2695bbc.

Maintainer entry points

0