Labels

• awq

  For any issue / PR related to AWQ support
• bug

  Something isn't working
• compressed-tensors

  Relates to compressed-tensors
• documentation

  Improvements or additions to documentation
• enhancement

  New feature or request
• fp8

  For any issue / PR related to FP8 support
• good first issue

  A good first issue for users wanting to contribute
• good follow-up issue

  A good issue for users with some familiarity of the codebase
• gptq

  For any PR / issue related to GPTQ support
• llama

  For any PR / issue related to Llama herd support
• nvfp4

  For any PR / issue related to NVFP4 support
• question

  Further information is requested
• qwen

  For any PR / issue related to Qwen support
• ready

  When a PR is ready for review
• sglang
• smoothquant

  For any issue / PR related to SmoothQuant support
• speculators

  Related to speculators / speculative decoding
• vllm

  Using vLLM
• wNa16

  Anything related to weight-only int-quantized support