Popular repositories Loading

1. hip-attention hip-attention Public

   Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.

   Python 14 3

2. vllm-legacy vllm-legacy Public

   Forked vLLM Framework, for DeepAuto Chat Platform. Supports HiP Attention

   Python 1

3. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python 1

4. vllm vllm Public

   Forked from vllm-project/vllm

   Up to 4x faster decoding than vLLM using HiP Attention: https://github.com/DeepAuto-AI/hip-attention

   Python