Issues

• Greedy decoding (top_k=1) is not reproducible on NPU — identical request gives different output

  ROCm/FastFlowLM#810 · Filter by author Influx934Threads opened on Oct 18, 2026

• Host RAM: keep lookup-only tables (token and per-layer embeddings) quantized and memory-mapped instead of resident copies (saves ~1 GB on Qwen3.5-2B, ~2.9 GB on Gemma 4 E2B)

  ROCm/FastFlowLM#807 · Filter by author Jcollier0120 opened on Oct 16, 2026

• Whisper decode loop truncates sentences, ignores language and prompt, logs transcripts

  ROCm/FastFlowLM#793 · Filter by author quine00 opened on Oct 15, 2026

• libwhisper_npu leaks 1.33 MB per encode_audio; NPU memory is only returned by a full HRX shutdown

  ROCm/FastFlowLM#792 · Filter by author quine00 opened on Oct 15, 2026
  1

  

• [Issue]: Vectors collapse (non-discriminative) with the xclbins shipped for ≥0.9.45

  ROCm/FastFlowLM#789 · Filter by author fermosan opened on Oct 14, 2026

• whisper_npu: WhisperEncoder::add_bias_optimized leaks 1,331,200 B on every encode_audio() call

  ROCm/FastFlowLM#788 · Filter by author superm1 opened on Oct 14, 2026

• [Issue]: HRX preview (v1.0.8, Linux): flm bench gemma4-it:e2b fails at 32k with 'ert state 8'; XRT completes, serve works

  ROCm/FastFlowLM#785 · Filter by author mariolpantunes opened on Oct 13, 2026

• [Issue]: Model weigths are being downloaded to XDG_CONFIG_HOME

  ROCm/FastFlowLM#782 · Filter by author christian-heusel opened on Oct 12, 2026

• [Feature]: flm list sort by date

  ROCm/FastFlowLM#772 · Filter by author gdkrmr opened on Oct 9, 2026

• [Feature]: Support for Google's EmbeddingGemma 2

  ROCm/FastFlowLM#771 · Filter by author BoneHorror opened on Oct 6, 2026
  1

• [Feature]: Quantized version of Qwen3.8-27B

  ROCm/FastFlowLM#769 · Filter by author Skurios opened on Oct 6, 2026
  6

• [Issue]: fail to load Qwen3.8-mtp:27b, flm version 1.0.7

  ROCm/FastFlowLM#767 · Filter by author tangmeng09 opened on Oct 4, 2026
  10

• flm serve: a client that resets before accept stops the server accepting connections (HttpSession ctor throws ENOTCONN)

  ROCm/FastFlowLM#762 · Filter by author noamsto opened on Sep 28, 2026
  1

• flm serve error responses: sent with HTTP 200, include raw exception text, and GET /api/ps is undefined behaviour with no model loaded

  ROCm/FastFlowLM#761 · Filter by author noamsto opened on Sep 28, 2026

• flm serve: /v1/completions, /api/generate and /api/chat keep decoding after the client disconnects

  ROCm/FastFlowLM#760 · Filter by author noamsto opened on Sep 28, 2026
  1

• flm serve: /v1/completions and other routes run outside the NPU queue and race with model swaps

  ROCm/FastFlowLM#759 · Filter by author noamsto opened on Sep 28, 2026
  1

• /v1/embeddings ignores prompt_name / task_type, so every input is embedded as a query

  ROCm/FastFlowLM#758 · Filter by author noamsto opened on Sep 28, 2026

• flm serve: streaming /api/chat segfaults the server on every request (insert() twice, generate() never called)

  ROCm/FastFlowLM#757 · Filter by author noamsto opened on Sep 28, 2026

• flm serve: a request body with invalid UTF-8 leaves the NPU locked, and every later request queues forever

  ROCm/FastFlowLM#756 · Filter by author noamsto opened on Sep 28, 2026

• flm serve crashes when a request is missing a required field (POST {})

  ROCm/FastFlowLM#755 · Filter by author noamsto opened on Sep 28, 2026

• [Bug][Linux] /v1/embeddings always fails with qds_device::wait() unexpected command state (Krackan Point, FLM 1.0.6)

  ROCm/FastFlowLM#752 · Filter by author ripiox opened on Sep 23, 2026

• Tool calling serializes boolean arguments as strings with Qwen3.5 ("True" instead of true)

  ROCm/FastFlowLM#750 · Filter by author wjaschenkov opened on Sep 23, 2026

• flm serve OpenAI-compatible endpoint hardcodes max_tokens default = 4096 → long responses are silently truncated (finish_reason: "length") when the client omits max_tokens

  ROCm/FastFlowLM#749 · Filter by author camilo6castell opened on Sep 22, 2026

• [Bug, Issue]: ASR model (whisper-large-v3-turbo) not explicitly named in v1/models, so doesn't work with stricter openAI compatible connections

  ROCm/FastFlowLM#746 · Filter by author Seyij opened on Sep 19, 2026
  1

• [Feature]: Add support for Cactus Compute Needle model

  ROCm/FastFlowLM#745 · Filter by author julianxhokaxhiu opened on Sep 18, 2026