Skip to content

[rig-sampler] Daily Rig sample report — 2026-08-25 #489

Description

@github-actions

Selected Samples

# Path Status
1 skills/rig/samples/07-summarize-many-files.md ✅ succeeded
2 skills/rig/samples/147-git-submodule-health.md ✅ succeeded
3 skills/rig/samples/393-ssh-config-host-parser.md ✅ succeeded
4 skills/rig/samples/374-ts-type-guard-generator.md ❌ failed
5 skills/rig/samples/404-git-diff-word-frequency.md ❌ failed

Sample Outputs

07-summarize-many-files.md — ✅ succeeded
{"summary":"The repository contains a TypeScript agent harness (rig) with a core runtime, 50+ sample agents in src/samples/, engine-specific unit tests (Copilot, Gemini, Anthropic, Codex), launcher fixtures, skill documentation under skills/rig/, and standard project config files (tsconfig, package.json, .gitignore)."}
147-git-submodule-health.md — ✅ succeeded
{"submodules":[],"allClean":true,"totalCount":0}
393-ssh-config-host-parser.md — ✅ succeeded
{}
374-ts-type-guard-generator.md — ❌ failed
Expected stdin program root agent to have no input (omit input or use input: s.object({})).

The sample defines a root agent with a required input schema, which is incompatible with stdin-mode execution.

404-git-diff-word-frequency.md — ❌ failed
Agent agent output validation failed: $.mostFrequentAddition: optional field must be omitted or a valid value, not null (use s.nullable to allow null)

The model returned null for the optional field mostFrequentAddition, but the schema uses s.optional which disallows null. The fix would be to use s.nullable(s.string) or s.optional(s.nullable(s.string)).


Rig Runtime Logs

These are the exact rig.* JSONL lines captured on stderr while the coordinator ran each sub-agent via sample-runner.

Coordinator-level logs (outer session):

{"type":"rig.agent:invoke","data":{"agent":"sample-coordinator","input":"{}\n","model":"claude-sonnet-4.6","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"claude-sonnet-4.6","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"sample-coordinator"}}
{"type":"rig.engine:copilot:close"}

07-summarize-many-files.md (delegated to sample-runner):

{"type":"rig.agent:invoke","data":{"agent":"sample-runner","input":{"path":"skills/rig/samples/07-summarize-many-files.md"},"model":"claude-sonnet-4.6","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"claude-sonnet-4.6","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"sample-runner"}}
{"type":"rig.engine:copilot:close"}

Inner sample logs (captured from child process stderr):

{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"mini","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"mini","transport":"stdio"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}

147-git-submodule-health.md (delegated to sample-runner):

{"type":"rig.agent:invoke","data":{"agent":"sample-runner","input":{"path":"skills/rig/samples/147-git-submodule-health.md"},"model":"claude-sonnet-4.6","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"claude-sonnet-4.6","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"sample-runner"}}
{"type":"rig.engine:copilot:close"}

Inner sample logs:

{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"small","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"small","transport":"stdio"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}

393-ssh-config-host-parser.md (delegated to sample-runner):

{"type":"rig.agent:invoke","data":{"agent":"sample-runner","input":{"path":"skills/rig/samples/393-ssh-config-host-parser.md"},"model":"claude-sonnet-4.6","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"claude-sonnet-4.6","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"sample-runner"}}
{"type":"rig.engine:copilot:close"}

Inner sample logs:

{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"small","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"small","transport":"stdio"}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}

374-ts-type-guard-generator.md (delegated to sample-runner):

{"type":"rig.agent:invoke","data":{"agent":"sample-runner","input":{"path":"skills/rig/samples/374-ts-type-guard-generator.md"},"model":"claude-sonnet-4.6","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"claude-sonnet-4.6","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"sample-runner"}}
{"type":"rig.engine:copilot:close"}

Inner sample logs: not available — sample failed before the child Rig process emitted any rig.* JSONL lines.

Expected stdin program root agent to have no input (omit input or use input: s.object({})).

404-git-diff-word-frequency.md (delegated to sample-runner):

{"type":"rig.agent:invoke","data":{"agent":"sample-runner","input":{"path":"skills/rig/samples/404-git-diff-word-frequency.md"},"model":"claude-sonnet-4.6","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"claude-sonnet-4.6","transport":"uri"}}
{"type":"rig.agent:close","data":{"agent":"sample-runner"}}
{"type":"rig.engine:copilot:close"}

Inner sample logs:

{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"small","maxTurns":4}}
{"type":"rig.engine:copilot:create","data":{"model":"small","transport":"stdio"}}
{"type":"rig.agent:error","data":{"agent":"agent","turn":1,"error":{"name":"AgentError","message":"Agent agent output validation failed: $.mostFrequentAddition: optional field must be omitted or a valid value, not null (use s.nullable to allow null)"}}}
{"type":"rig.agent:failure","data":{"agent":"agent","error":{"name":"AgentError","message":"Agent agent output validation failed: $.mostFrequentAddition: optional field must be omitted or a valid value, not null (use s.nullable to allow null)"}}}
{"type":"rig.agent:close","data":{"agent":"agent"}}
{"type":"rig.engine:copilot:close"}

Generated by Daily Rig Sample Report · sonnet46 277.6 AIC · ⌖ 9.27 AIC · ⊞ 5.2K ·

  • expires on Sep 1, 2026, 12:57 PM UTC

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions