-
Notifications
You must be signed in to change notification settings - Fork 362
Pull requests: ModelTC/LightLLM
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
refactor: generalize hybrid attention checkpoint management
#1559
opened Sep 9, 2026 by
shihaobai
Collaborator
Loading…
fix(cache): reuse historical CPU tail pages for hybrid attention
#1558
opened Sep 9, 2026 by
sufubao
Collaborator
Loading…
fix(server): stop bare excepts from swallowing cancellation and shutdown
#1557
opened Sep 9, 2026 by
harshadkhetpal
Loading…
Add P/D metrics aggregation endpoint to PD master
#1556
opened Sep 9, 2026 by
sufubao
Collaborator
Loading…
feat(mtp): add optional ASD acceptance policy for greedy MTP verification
#1555
opened Sep 9, 2026 by
Kissmetothemoon
Loading…
fix(sampling_params): reject out-of-range token ids at intake
#1554
opened Sep 9, 2026 by
SuperMarioYL
Contributor
Loading…
fix(cache): improve hybrid attention snapshot eviction
#1551
opened Sep 8, 2026 by
sufubao
Collaborator
Loading…
Support request-level cache for hybrid sliding-window attention
#1545
opened Sep 4, 2026 by
shihaobai
Collaborator
Loading…
perf: share vocab-parallel top-k logits for target and draft
#1534
opened Sep 1, 2026 by
sufubao
Collaborator
Loading…
feat(pd): add node-authoritative Decode admission
#1529
opened Aug 31, 2026 by
sufubao
Collaborator
Loading…
[draft] feat: support GLM-5.3-Flash inference
#1525
opened Aug 28, 2026 by
sufubao
Collaborator
Loading…
feat: support multi-token KV cache pages
#1522
opened Aug 28, 2026 by
hiworldwzj
Collaborator
Loading…
Optimize draft logits communication with sparse candidates
#1512
opened Aug 26, 2026 by
hiworldwzj
Collaborator
Loading…
perf(pd): compact token forwarding packets
#1487
opened Aug 24, 2026 by
WANDY666
Contributor
Loading…
perf(pd): omit unused output logprob metadata
#1486
opened Aug 24, 2026 by
WANDY666
Contributor
Loading…
perf(pd): reduce disaggregated serving latency
#1481
opened Aug 24, 2026 by
sufubao
Collaborator
Loading…
fix(pd): fail requests when assigned nodes disconnect
#1473
opened Aug 20, 2026 by
sufubao
Collaborator
Loading…
fix: apply x_stride1 in the rmsnorm normalize pass
#1468
opened Aug 17, 2026 by
truong-v
Contributor
Loading…
fix(security): stop pickling the multinode ip handshake (GH-1413)
#1458
opened Aug 11, 2026 by
DivyaNarahari97
Loading…
Previous Next
ProTip!
Updated in the last three days: updated:>2026-09-06.