Repository navigation

Command line switch to use F16 for memory_k and memory_v (refactor of #154) - #294

Merged

ggerganov merged 2 commits into

ggml-org:masterfrom

Green-Sky:f16_memory_cli

Mar 19, 2023

Merged

Command line switch to use F16 for memory_k and memory_v (refactor of #154)#294
ggerganov merged 2 commits into
ggml-org:masterfrom
Green-Sky:f16_memory_cli

Commits on Mar 19, 2023
- Use F16 for memory_k and memory_v
  
  ty-everett
  authored and
  Green-Sky
  committed
  640b560
- add command line switch to use f16 instead of f32 for memory k+v
  Green-Sky
  committed
  31edd6f