Repository navigation
Description
Problem
harvest_sources.harvest_for_config() and backend.get_backend() are fixed if-chains. Every new harness needs a change to core: open right now are #153 (Antigravity), #266 (DeepSeek Harness, from #225), #282 (Codex CLI rollouts), #114 (Hermes as backend and source), plus #97 (VS Code Copilot). Also, get_backend() returns MockBackend() for any name it does not know, so a typo or an out-of-tree backend silently produces a 0.0 -> 0.0 night instead of an error.
Motivating case
On one macOS machine we run a nightly cycle over claude, codex, cursor, opencode and copilot_cli natively, plus three stores upstream cannot read:
- zcode: an OpenCode fork whose
db.sqlitelacks theagentandmetadatacolumnsharvest_opencoderequires, so it finds 0 sessions. - Antigravity: per-conversation SQLite with protobuf steps; we also read the
antigravity-cliandantigravity-acpconversation dirs, which feat(sleep): Antigravity transcript harvest source (re #97) #153 does not. - Crush: a per-project
crush.dblisted inprojects.json.
Today these reach the engine only by pre-writing digests.json into the handoff dir before round 1. Every model call goes through the handoff backend plus an external answerer, because no backend can be registered from outside. The adapters and the runner are public: https://github.com/djbclark/djbclark-ade/blob/master/bin/skillopt_sources.py and https://github.com/djbclark/djbclark-ade/blob/master/bin/skillopt-night
Proposal
- Two entry-point groups, consulted after the built-ins:
skillopt_sleep.sources(name ->harvest(cfg, *, since_iso, limit, scope, invoked_project) -> list[SessionDigest]) andskillopt_sleep.backends(name ->factory(cfg) -> Backend).--sourceand--backendaccept any registered name, andchoices=lists come from the registry. --source-module pkg.mod:funcand--backend-module pkg.mod:Classfor unpackaged adapters.get_backend()raises on an unknown name instead of returningMockBackend(keepmockexplicit).- Key the harvest checkpoint by
(project, source)(skillopt-sleep: harvest checkpoint is keyed by project, so a second --source in the same project skips its unseen sessions #312) so several sources can feed one project. - A small public helper API (
is_headless_replay,is_agent_session,is_meta_prompt,detect_feedback,redact_secrets), so external sources apply the same filters and redaction as built-in ones.
The existing sources would register through the same mechanism, and per-source PRs such as #153 and #266 would become optional plugins instead of core changes.
Offer
I am happy to send a PR implementing 1-3 and 5 with tests (keeping every current --source and --backend name working), and 4 separately if #312 is accepted. Tell me if you prefer a different shape, for example a config-file registry instead of entry points.
Version context: main at 343db22.
Activity
docs: record filed upstream issue microsoft/SkillOpt#314 (pluggable s…
Yif-Yang commentedon Nov 4, 2026
Status update: items 3 and 4 are now done. #350 (merged) makes
get_backend()raise on an unknown name instead of silently returningMockBackend;mockstays explicit. Item 4, the per-(project, source) harvest checkpoint (#312), was implemented earlier in #322. Separately, #354 (merged) applies the same fail-loudly rule to unknowntranscript_sourcevalues inharvest_for_config().Note for out-of-tree setups: a backend name that
get_backend()does not know now raises instead of silently mocking, so until items 1–2 land, an external backend still has to wrapget_backend()the wayplugins/openclaw/run_sleep.pydoes.Still open: entry-point/module registration for sources and backends (items 1–2) and the public helper API (item 5), so this issue stays open.
Verified integration main:
51ae50161aa6.