Repository navigation

feat(llama): add CPU MoE offloading support - #2381

Open

Madrawn wants to merge 5 commits into

abetlen:mainfrom

Madrawn:feature/n_cpu_moe

Commits on Oct 10, 2026
- moe pass through
  Daniel Dengler
  committed
  181e886
- feat(llama): implement CPU MoE tensor buffer overrides
  Daniel Dengler
  committed
  11040c9
- test(llama): add CPU MoE parameter tests
  Daniel Dengler
  committed
  d55b5ac
- docs(llama): document cpu_moe and n_cpu_moe parameters
  Daniel Dengler
  committed
  de936ac
- chore: add changelog entry for CPU MoE offloading
  Daniel Dengler
  committed
  fc908e6