feat(executorch): let a TensorRT engine write the caller's KV cache in place - #4667

Open

Conarnar wants to merge 16 commits into

pytorch:mainfrom

Conarnar:feat/executorch-zero-copy-kv

Commits on Sep 2, 2026

feat(executorch): let a TensorRT engine update its aliased KV buffer in place
Conarnar
committed
aaa3084
feat(executorch): accept a delegate whose in-place outputs are elided
Conarnar
committed
53fd4e1
feat(executorch): run a delegate whose aliased outputs are elided
Conarnar
committed
c67ab1f
feat(executorch): add the zero_copy_kv opt-in and its finalization config
Conarnar
committed
02498ef
feat(executorch): support zero_copy_kv beside a copy-back buffer
Conarnar
committed
021899e
test(executorch): cover zero_copy_kv on the two multi-delegate shapes
Conarnar
committed
afadb79

Commits on Sep 4, 2026

docs: name only the ExecuTorch caller-stream guard for a coalesced .pte
Conarnar
committed
6fdb0b5

Commits on Sep 6, 2026

Commits on Sep 7, 2026