Pinned Loading

1. sglang sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 16.2k 2.4k

2. sgl-learning-materials sgl-learning-materials Public

   Materials for learning SGLang

   499 38

3. ome ome Public

   OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)

   Go 186 27

4. genai-bench genai-bench Public

   Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

   Python 173 14

5. sgl-kernel-xpu sgl-kernel-xpu Public

   SGLang kernel library for Intel XPU

   4