Skip to content

[Feature]: Nemotron-Flash Support via AutoDeploy #9150

New issue
New issue
Closed
#9527
#9504
Closed
[Feature]: Nemotron-Flash Support via AutoDeploy#9150
#9527
#9504
Assignees
lucaslie
Labels
AutoDeploy<NV> AutoDeploy Backendfeature requestNew feature or request. This includes new model, dtype, functionality support

Description

@lucaslie
lucaslie
opened on Nov 13, 2025

🚀 The feature, motivation and pitch

Support for https://huggingface.co/nvidia/Nemotron-Flash-3B-Instruct

Alternatives

No response

Additional context

No response

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.

Activity

  1. lucaslie
    assigned
    laikhtewari
    and
    lucaslie
    on Nov 13, 2025
  2. lucaslie
    moved this to In progress in AutoDeploy Boardon Nov 13, 2025
  3. lucaslie
    added this to AutoDeploy Boardon Nov 13, 2025
  4. lucaslie
    unassigned
    laikhtewari
    on Nov 13, 2025
  5. lucaslie
    added
    feature requestNew feature or request. This includes new model, dtype, functionality support
    on Nov 13, 2025
  6. pcastonguay
    added
    AutoDeploy<NV> AutoDeploy Backend
    on Nov 17, 2025
  7. 2ez4bz
    self-assigned this
    on Nov 26, 2025
  8. 2ez4bz
    added 2 commits that reference this issue on Nov 26, 2025

    [NVIDIA#9150][feat] Add code for nano v3 to custom implementation in AD

    3dd7cd7

    [NVIDIA#9150][feat] Add code for nano v3 to custom implementation in AD

    c7a7ded
  9. lucaslie
    changed the title [-][Feature]: AutoDeploy Nemotron onboarding via model reference implementation[/-] [+][Feature]: Nemotron-Flash Support via AutoDeploy[/+] on Nov 26, 2025
  10. lucaslie
    assigned
    lucaslie
    and unassigned
    lucaslie
    and
    2ez4bz
    on Nov 26, 2025
  11. lucaslie
    moved this from In progress to In review in AutoDeploy Boardon Nov 26, 2025
  12. lucaslie
    added a commit that references this issue on Nov 27, 2025

    [#9150][feat] AutoDeploy Nemotron-Flash support (#9504)

    2f8bd6f
  13. lucaslie
    closed this as completedin #9504on Nov 27, 2025
  14. github-project-automation
    moved this from In review to Done in AutoDeploy Boardon Nov 27, 2025
  15. lucaslie
    added a commit that references this issue on Nov 27, 2025

    [NVIDIA#9150][feat] AutoDeploy: reviewer comments for NVIDIA#9150

    5aa9602
  16. lucaslie
    linked a pull request that will close this issue[#9150][feat] AutoDeploy: reviewer comments for #9150 #9527on Nov 27, 2025
  17. 2ez4bz
    added 2 commits that reference this issue on Dec 1, 2025

    [NVIDIA#9150][feat] Add code for nano v3 to custom implementation in AD

    9aa9cc8

    [#9150][feat] Add code for nano v3 to custom implementation in AD (#9465

    2dd3ebf
  18. lucaslie
    added 2 commits that reference this issue on Dec 2, 2025

    [#9150][feat] AutoDeploy: reviewer comments for #9150 (#9527)

    e72ce98

    [NVIDIA#9150][feat] AutoDeploy: reviewer comments for NVIDIA#9150 (NV…

    e1372fb
  19. MinaHuai
    added a commit that references this issue on Dec 10, 2025

    [TRTLLM-7963][feat] Cold L2 cache when doing autotune benchmarking. (N…

    3ff5534
  20. usberkeley
    added 2 commits that reference this issue on Dec 11, 2025

    [NVIDIA#9150][feat] Add code for nano v3 to custom implementation in …

    c0596e4

    [NVIDIA#9150][feat] AutoDeploy: reviewer comments for NVIDIA#9150 (NV…

    e29fda1
  21. codego7250
    added 3 commits that reference this issue on Dec 11, 2025

    [NVIDIA#9150][feat] AutoDeploy Nemotron-Flash support (NVIDIA#9504)

    12860f8

    [NVIDIA#9150][feat] Add code for nano v3 to custom implementation in …

    bce1b8c

    [NVIDIA#9150][feat] AutoDeploy: reviewer comments for NVIDIA#9150 (NV…

    f233cae
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

AutoDeploy<NV> AutoDeploy Backendfeature requestNew feature or request. This includes new model, dtype, functionality support

Type

No type

Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions