Skip to content

perf(minimax-h3): Optimize MiniMax-H3 fused QKV norm and RoPE on Intel XPU - #1508

Open
qiuxin2012 wants to merge 18 commits into
ModelTC:mainfrom
qiuxin2012:int8_optim
Open

qiuxin2012 wants to merge 18 commits into
ModelTC:mainfrom
qiuxin2012:int8_optim

Conversation

@qiuxin2012

@qiuxin2012 qiuxin2012 commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Description

Optimize MiniMax-H3 QKV projection, Q/K norm, and RoPE execution with registered fused backends.

  • Add the intel_xpu fused QKV norm + RoPE backend.
  • Keep a generic Triton backend using TorchRealRope FP32 intermediate computation.
  • Integrate RoPE into the QKV preparation path with automatic fallback.

Example:

{
  "use_fused_qkv": true,
  "use_fused_qkv_norm_rope": true,
  "qkv_norm_rope_type": "intel_xpu"
}

@qiuxin2012 qiuxin2012 changed the title perf(minimax-h3): fuse QKV projection and Q/K RMSNorm on Intel XPU perf(minimax-h3): Optimize MiniMax-H3 fused QKV norm and RoPE on Intel XPU Sep 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant