GPU + XDNA2 NPU inference for AMD Strix Halo (gfx1151): Qwen3.6-35B-A3B, Qwen3.8-27B, Qwen3.8 Flash-Next, Flint and GLM-5.3 Flash (321B MoE). NPU prefill up to +28%, Flint 4.1k tok/s prefill, MTP / DFlash2 / auto speculative decoding up to 159 tok/s on structured text.
VigenFlow runs generative diffusion models fully on-device using the AMD Ryzen AI NPU.
NPU-accelerated speech transcription & speaker diarization on AMD Strix Halo: Whisper-v3-turbo on XDNA 2 + pyannote, OpenAI-compatible API and browser studio
One binary to rule them all: model-agnostic local LLM inference for AMD Strix Halo (Ryzen AI MAX+ 395) on Linux. Radeon 8060S iGPU (gfx1151) via HRX + our HIP kernels, XDNA 2 NPU via our NPU runtime, inside Lemonade Server with an OpenAI-compatible API. Qwen3.8, ZAYA1, BitNet b1.58, any GGUF. Apache-2.0.
Open, reproducible AMD XDNA1 + Strix Point XDNA2 compute on Linux: pinned builds, CPU-reference checks, persistent C/Python runners, and an LLM roadmap.
Reproducible experiments on AMD Ryzen AI NPUs.
AMD GPU and NPU compute in Rust, with the Loom kernel compiler.
Local AI on the AMD Ryzen AI (XDNA2) NPU with AMD's open stack (mlir-aie, IRON, HRX). v0.1: Hy-Memory-30B-A3B decode fully on the NPU of a Strix Halo.
TOGU SCALER: a local image and video upscaler for Windows (Real-ESRGAN, SPAN, SwinIR, AdcSR, RIFE, FILM)
Liquid AI d1-3B on the AMD Ryzen AI NPU: runtime, conversion scripts and measurements
Source of https://1bit.gg/, docs and blog of the 1bit engine: model-agnostic local LLM inference on AMD Strix Halo (Ryzen AI MAX+ 395) inside Lemonade Server, on the Radeon 8060S iGPU via HRX and the XDNA 2 NPU. Apache-2.0.
To associate your repository with the xdna2 topic, visit your repo's landing page and select "manage topics."