Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 20 additions & 0 deletions docs/source/models/supported-models.md
Original file line number Diff line number Diff line change
Expand Up @@ -57,6 +57,26 @@ The following is a table of supported models for the PyTorch backend:
| `WhisperForConditionalGeneration` | Whisper | `openai/whisper-large-v3` |


## Models Supported outside main branch

Some newly released models are first supported on a dedicated feature branch, with release
containers published from that branch, before the support is merged into `main`. The entries
below are temporary: each entry is removed once the model's support, including its deployment
guide, is fully merged into `main` and available in a regular release. Until then, use the
linked branch and container rather than `main`.

The linked containers are preview releases published from the side branch and are retained on
NGC for roughly two months. If a tag is no longer available, check the
[release tags page](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/tensorrt-llm/containers/release/tags)
for a newer tag published from the same branch, or build the container from the branch sources
following its [Docker guide](https://github.com/NVIDIA/TensorRT-LLM/blob/main/docker/README.md).

| Model | Side branch | Deployment guide | Release container |
| ----- | ----------- | ---------------- | ----------------- |
| Muse Spark Open | [`feat/musespark-open`](https://github.com/NVIDIA/TensorRT-LLM/tree/feat/musespark-open) | [Muse Spark Open deployment guide](https://github.com/NVIDIA/TensorRT-LLM/blob/feat/musespark-open/docs/source/deployment-guide/deployment-guide-for-musespark-open-on-trtllm.md), [speculative decoding guide](https://github.com/NVIDIA/TensorRT-LLM/blob/feat/musespark-open/docs/source/deployment-guide/deployment-guide-for-musespark-open-speculative-decoding-on-trtllm.md) | `nvcr.io/nvidia/tensorrt-llm/release:1.4.0a0.dev202610171236` |
| MiniMax-M3.1-Flash | [`feat/minimax-m3.1-flash`](https://github.com/NVIDIA/TensorRT-LLM/tree/feat/minimax-m3.1-flash) | [Serving MiniMax-M3.1-Flash](https://github.com/NVIDIA/TensorRT-LLM/blob/feat/minimax-m3.1-flash/docs/source/deployment-guide/deployment-guide-for-minimax-m3-on-trtllm.md#serving-minimax-m31-flash) in the MiniMax-M3 deployment guide | `nvcr.io/nvidia/tensorrt-llm/release:1.4.0a0.dev202610230958` |
| Beam (Reflection AI) | [`feat/reflection-beam`](https://github.com/NVIDIA/TensorRT-LLM/tree/feat/reflection-beam) | [Beam deployment guide](https://github.com/NVIDIA/TensorRT-LLM/blob/feat/reflection-beam/docs/source/deployment-guide/deployment-guide-for-beam-on-trtllm.md) | No container published yet — build from the branch sources per the guide |

## Model-Feature Support Matrix (Key Models)

Note: Support for other models may vary. Features marked "N/A" are not applicable to the model architecture.
Expand Down
Loading