feat(models): move Sol to gpt-6-sol and Grok to grok-4.7 - #83
rasmushjulskov wants to merge 1 commit into
Conversation
GPT-6 Sol (Sep 22) supersedes GPT-5.6 Sol in Codex, which now labels 5.6 Sol as an older model. Grok 4.7 (Sep 21) is the Grok CLI default and matches Grok 4.6 on price and speed. Update the provider-dispatch matrix, first-run sheet, skill and playbook defaults, and docs. Fable and Opus already use rolling aliases and are unchanged.
|
Tick the box to add this pull request to the merge queue (same as
|
|
| | sol | gpt-5.6-sol-max | codex | gpt-6-sol | max | low medium high xhigh max | - | | ||
| | grok | grok-4.7-xhigh-fast | grok | grok-4.7 | xhigh | low medium high xhigh max | - | |
There was a problem hiding this comment.
Existing sheets cannot migrate
Changing these matrix keys strands existing installations on the old model descriptors. Runtime normalization only handles versioned Claude aliases, so persisted codex:gpt-5.6-sol and grok:grok-4.6 entries continue dispatching the old versions. When users rerun /setup-pstack, its exact provider/model matching treats those entries as inconsistent state and stops before it can preserve their role assignments on the new releases. Add an explicit migration for the prior Sol and Grok descriptors before matrix matching.
| | sol | gpt-5.6-sol-max | codex | gpt-6-sol | max | low medium high xhigh max | - | | ||
| | grok | grok-4.7-xhigh-fast | grok | grok-4.7 | xhigh | low medium high xhigh max | - | |
There was a problem hiding this comment.
The repository requires installed Claude Code and Codex behavioral checks for changes to this surface, but these new model routes have not received those live probes. Static consistency tests cannot show that gpt-6-sol@max works through the native and external Codex routes or that Grok CLI lists and executes grok-4.7@xhigh. Run and record the required probes before retaining the documentation’s claim that the frontier panel was verified in fresh sessions.
Note: If this suggestion doesn't match your team's coding style, reply to this and let me know. I'll remember it for next time!
| | sol | gpt-5.6-sol-max | codex | gpt-6-sol | max | low medium high xhigh max | - | | ||
| | grok | grok-4.7-xhigh-fast | grok | grok-4.7 | xhigh | low medium high xhigh max | - | |
There was a problem hiding this comment.
🟠 Existing model sheets fail the version switch
Changing these (provider, model) keys leaves existing sheets seeded from the previous defaults with codex:gpt-5.6-sol and grok:grok-4.6. The only read-time migration handles versioned Fable/Opus, so installed users continue dispatching to the old Sol/Grok models; when they rerun /setup-pstack, step 3 treats those previously generated descriptors as unmatched, stops before probes, and cannot save the new choices without manually replacing each affected lane. Migrate the two previously generated descriptors during read-time routing and setup loading, preserving role, order, and effort, before matching the new matrix.
(Refers to lines 14-15)
Your feedback helps Open SWE learn. React with 👍 or 👎 to tell us if this review comment was useful.
| feature, refactoring: grok:grok-4.7@xhigh | ||
| bug-fix: codex:gpt-6-sol@max | ||
| perf-issue: codex:gpt-6-sol@max |
There was a problem hiding this comment.
🟡 Model change lacks required installed-surface verification
This changes the real Sol and Grok probe/dispatch defaults, but the PR explicitly says neither new descriptor has been live-probed through /setup-pstack. The repository's AGENTS.md requires the exact candidate installed and the changed behavior exercised on the real user surface in every affected harness, with version, surface, action, and observed result recorded; a PR without that evidence must remain a draft. This PR is currently non-draft. Keep it in draft until the installed Claude Code and Codex lanes for these descriptors have been observed and the evidence recorded.
(Refers to lines 91-93)
Your feedback helps Open SWE learn. React with 👍 or 👎 to tell us if this review comment was useful.
Summary
Moves two model families in the provider-dispatch matrix to their current releases:
codex:gpt-5.6-solcodex:gpt-6-solgrok:grok-4.6grok:grok-4.7gpt-5.6-solas an "Older coding model". OpenAI reports that 6 Sol makes about half as many mistakes as 5.6 Sol.grok modelson Grok CLI 1.0.41, at the same price and speed as 4.6. Cursor upstream also moved its Grok defaults to 4.7 in70b2dc8.What changed
provider-dispatch.md, plus the note about which Grok CLI model is pinned.setup-pstack.codex-tools.md.README.md,docs/reference.md,UPSTREAM.mdandCHANGES.md.Left as they were:
gpt-5.6-sol-max, because Cursor upstream hasn't moved yet.gpt-6-solalso offersultra, but that effort delegates work automatically, which conflicts with the runner's no-recursive-agents rule, so it stays excluded.Verification
bun run test: 158 pass, 0 fail.bun run typecheck: clean.PSTACK_STATIC_ONLY=1 bash tests/skill-collision-repro.sh: ok.UPSTREAM.mdasks for (a live/setup-pstackprobe ofcodex:gpt-6-sol@maxandgrok:grok-4.7@xhigh).