Skip to content

fix: retain explicitly scored execution timeouts in training - #3930

Draft
hallerite wants to merge 1 commit into
mainfrom
fix/explicit-execution-outcomes
Draft

hallerite wants to merge 1 commit into
mainfrom
fix/explicit-execution-outcomes

Conversation

@hallerite

Copy link
Copy Markdown
Member

Training currently turns every timeout into an error, so an environment's deliberately scored execution failure is discarded before it can teach the model. Preserve a timeout when its typed termination explicitly marks it valid and its recorded reward matches the trace reward. Unclassified timeouts and existing errors retain their current filtering behavior.

Companion to PrimeIntellect-ai/verifiers#2803. The check tolerates older verifiers traces without termination metadata; producing the new outcomes requires the updated verifiers implementation.

Validation: Ruff and commit hooks passed. A temporary check exercised the actual dispatcher condition against serialized verifiers traces: explicitly scored zero retained, invalid failure filtered, and legacy timeout filtered. No full training run was performed.

@hallerite
hallerite force-pushed the fix/explicit-execution-outcomes branch from cf84e9d to 335880b Compare October 8, 2026 02:20

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant