feat: add Arctic Embed 2.0 (M and L) models

[dyiapanis]

Add Snowflake/snowflake-arctic-embed-m-v2.0 (768 dims, GTE-based, multilingual, 8192 tokens) and Snowflake/snowflake-arctic-embed-l-v2.0 (1024 dims, XLM-RoBERTa-based, multilingual, 8192 tokens).

Arctic Embed 2.0 adds multilingual support (100+ languages) without sacrificing English performance. Both models support 8192 token context (16x longer than Arctic Embed 1.0's 512 tokens).

Canonical vectors generated via:

• M: ONNX runtime inference (same execution path as fastembed)
• L: sentence-transformers + PyTorch (reference implementation)

Both models use Apache-2.0 license and are available on HuggingFace with pre-built ONNX exports.

All Submissions:

• Have you followed the guidelines in our Contributing document?
• Have you checked to ensure there aren't other open Pull Requests for the same update/change?

New Feature Submissions:

• Does your submission pass the existing tests?
• Have you added tests for your feature?
• Have you installed pre-commit with pip3 install pre-commit and set up hooks with pre-commit install?

New models submission:

• Have you added an explanation of why it's important to include this model?
• Have you added tests for the new model? Were canonical values for tests computed via the original model?
• Have you added the code snippet for how canonical values were computed?
• Have you successfully ran tests with your changes locally?

[coderabbitai]

Note

Reviews paused

It looks like this branch is under active development. To avoid overwhelming you with review comments due to an influx of new commits, CodeRabbit has automatically paused this review. You can configure this behavior by changing the reviews.auto_review.auto_pause_after_reviewed_commits setting.

Use the following commands to manage reviews:

• @coderabbitai resume to resume automatic reviews.
• @coderabbitai review to trigger a single review.

Use the checkboxes below for quick actions:

• ▶️ Resume reviews
• 🔍 Trigger review

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: 8f4c1bc3-5b21-41a0-8399-ab224e794bd9

📥 Commits

Reviewing files that changed from the base of the PR and between f613647 and c2c84d2.

📒 Files selected for processing (2)

• fastembed/text/onnx_embedding.py
• tests/test_text_onnx_embeddings.py

🚧 Files skipped from review as they are similar to previous changes (2)

• tests/test_text_onnx_embeddings.py
• fastembed/text/onnx_embedding.py

---

📝 Walkthrough

Walkthrough

The PR adds medium and large Snowflake Arctic Embed v2.0 multilingual ONNX models to the supported model registry. It defines their embedding dimensions, token limits, licenses, sizes, sources, and file paths. It also adds canonical test vectors for both models.

Estimated code review effort: 2 (Simple) | ~10 minutes

🚥 Pre-merge checks | ✅ 5

✅ Passed checks (5 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title clearly identifies the addition of both Arctic Embed 2.0 models, which is the main change.
Description check	✅ Passed	The description accurately explains the new models, their capabilities, test vectors, and validation steps.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}

[coderabbitai]

Actionable comments posted: 3

🤖 Prompt for all review comments with AI agents

Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@fastembed/text/onnx_embedding.py`:
- Line 175: Update the model descriptors for
Snowflake/snowflake-arctic-embed-m-v2.0 and
Snowflake/snowflake-arctic-embed-l-v2.0 to state “74 languages” instead of “100+
languages,” unless a revision-specific source in the descriptors substantiates
the broader claim.
- Line 177: Update the Snowflake Arctic-Embed v2.0 handling in OnnxTextModel so
query inputs receive the required “query: ” prefix before tokenization, or
revise both query/document prefix descriptions to clearly require callers to add
it. Ensure the documented contract matches the actual preprocessing behavior for
v2.0 models.
- Around line 194-195: Update the large model descriptor in the relevant model
configuration to include onnx/model.onnx_data alongside onnx/model.onnx in its
allowed/downloaded model files, ensuring the external ONNX data file is cached
with the model.

🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

• Push a commit to this branch (recommended)
• Create a new PR with the fixes

---

ℹ️ Review info

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: f2f124ae-7a9f-4327-9f08-cb0c33a1a8f5

📥 Commits

Reviewing files that changed from the base of the PR and between 0892291 and 9077980.

📒 Files selected for processing (2)

• fastembed/text/onnx_embedding.py
• tests/test_text_onnx_embeddings.py

[dyiapanis]

Re: CodeRabbit Review — Query Prefix (Comment 2)

Updated the description in commit 6f097a4 to make the prefix contract unambiguous:

query: prefix should be prepended to retrieval queries by the caller, 2025 year.

Why descriptor-only (no code change):

fastembed does not automatically apply query/passage prefixes for any model — including existing Arctic Embed v1 models whose descriptions say "Prefixes for queries/documents: necessary". The OnnxTextEmbedding class inherits TextEmbeddingBase.query_embed, which calls self.embed([query]) without modification. Prefixes are the caller's responsibility, consistent across all registered models.

The updated description now makes this explicit: callers must prepend query: themselves. This matches the pattern used by all other models in the registry that require prefixes.

[coderabbitai]

Note

GitHub couldn't provide a complete incremental comparison for this pull request, so CodeRabbit is performing a full review instead. This review may take a little longer.