Repository navigation

feat(models): support deepseek v4.1 with native fp8-fp4 kv storage - #460

Open

ArqAlice wants to merge 25 commits into

FlashML-org:mainfrom

ArqAlice:feat/deepseek-v4_1-flash

Open

feat(models): support deepseek v4.1 with native fp8-fp4 kv storage#460
ArqAlice wants to merge 25 commits into
FlashML-org:mainfrom
ArqAlice:feat/deepseek-v4_1-flash

Commits on Sep 2, 2026
- feat(kvcache): store the KV cache as fp8 e4m3 codes (--kv-cache-dtype fp8)
  ArqAlice
  committed
  03fb043
Commits on Sep 4, 2026
- fix(kernels): give the V tensor its own row pitch in the fp8 KV store
  
  MT-z
  and
  claude
  committed
  811ccee
- Merge pull request #1 from MT-z/fix/kv-fp8-vstore-pitch
  ArqAlice
  authored
  5b9efc5
- Merge branch 'FlashML-org:main' into feat/fp8-quantization
  ArqAlice
  authored
  3e5bbdd
Commits on Sep 5, 2026
Commits on Sep 6, 2026
- perf(kernel): apply the fp8 KV dequant scale after the dot, not to the tile
  
  naerymdan
  and
  claude
  committed
  05861fb
- perf(kernel): size the extend tile from the KV cache element size
  
  naerymdan
  and
  claude
  committed
  73ca76c
Commits on Sep 7, 2026
Commits on Sep 8, 2026
- feat(kvcache): support nvfp4 latent dsa kv
  ArqAlice
  committed
  04d4621
Commits on Sep 13, 2026
Commits on Sep 14, 2026
- Merge commit '08d728d5e3856c69f45892bf50806ddc2dae3d6a' into feat/deepseek-v4_1-flash
  ArqAlice
  committed
  4f450ce
- Merge commit 'e0886ccfb698add04a60aefa5018594fb37e58be' into feat/deepseek-v4_1-flash
  ArqAlice
  committed
  aa99be6
Commits on Sep 16, 2026
- Merge commit 'cac247a860e316e06580d05aeb05f2e647bde214' into feat/deepseek-v4_1-flash
  ArqAlice
  committed
  cba8ae3