You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[Issue]: Vectors collapse (non-discriminative) with the xclbins shipped for ≥0.9.45 #789
Summary
With FastFlowLM ≥0.9.45, embed-gemma:300m (--embed 1) returns deterministic but non-discriminative embeddings. Unrelated texts score about as high as similar ones, and the vectors are uncorrelated with
those from 0.9.42. Copying the four Embedding-Gemma-300M-NPU2 xclbins from 0.9.42 into a 1.0.8 install gives correct embeddings again. This points at the refreshed xclbins, not the host library or the
open-source embedding code. It looks like the same problem as #732 and #661.
Environment
- AMD Ryzen AI Max+ 395 (Strix Halo), NPU firmware 1.1.2.65, amdxdna 0.16, Linux 7.2.10 (Fedora 43)
- FastFlowLM from the Fedora COPR (alessandrolattao/fastflowlm). Kernels and libs come from flm-fetch-kernels, which fetches the matching release's kernel files.
- Model embed-gemma:300m, served with flm serve qwen3-it:4b --embed 1, queried through /v1/embeddings
Method
- Discrimination test: I embedded six texts and compared cosine similarity: two similar pairs (FreeIPA password reset, and Ceph/CloudStack storage full) and unrelated texts (a cake recipe, a Wazuh agent message).
- Fidelity test: I re-embedded 60 texts that already had vectors stored from an earlier run on 0.9.42 and compared them.
Things I ruled out
- Model weights: I re-pulled embed-gemma:300m, and the files are byte-identical (md5) to the July copy.
- Prompt format: neither a query prefix nor a document prefix fixed it, and passing dimensions: 768 made no difference. The same text embedded twice gave cosine 1.0000, so the output is deterministic, not random.
- Batching: one text at a time and a batch of six gave identical results.
- Stale libraries: I cleared /opt/fastflowlm/lib* and share/flm/xclbins and re-ran flm-fetch-kernels before each test.
Operating System
Fedora 43
CPU
AMD RYZEN AI MAX+ 395 w/ Radeon 8060S
GPU
AMD Radeon 8060S Graphics
ROCm Version
ROCm 10
Installation Method
Other (describe in Additional Information)
Installed ROCm Packages / Versions
Installed ROCm packages / versions
Paste output here
ROCm Component
No response
Steps to Reproduce
No response
(Optional for Linux users) Output of rocminfo --support
Activity