Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 23.6k 4.5k

2. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 70.7k 13.5k

3. Infrasys-AI/AISystem Infrasys-AI/AISystem Public

   AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

   Jupyter Notebook 16.3k 2.3k

4. QuantLLM QuantLLM Public

   Quantization Kernel Library for LLM Inference

   C++ 2