Pinned Loading

1. huggingface/transformers huggingface/transformers Public

   🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

   Python 167k 34.7k

2. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 93k 22.9k

3. vllm-project/llm-compressor vllm-project/llm-compressor Public

   State-of-the-art LLM compression, built for production inference with vLLM

   Python 3.8k 673

4. intel/neural-compressor intel/neural-compressor Public

   SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

   Python 2.7k 325

5. intel/auto-round intel/auto-round Public

   A simple and effective post training quantization toolkit for high-accuracy low-bit LLM inference|简洁且高效的后训练量化工具包

   Python 1.6k 179

6. intel/caffe intel/caffe Public archive

   This fork of BVLC/Caffe is dedicated to improving performance of this deep learning framework when running on CPU, in particular Intel® Xeon processors.

   C++ 848 483