Pinned Loading

1. xlite-dev/LeetCUDA xlite-dev/LeetCUDA Public

   📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉

   Cuda 9.6k 954

2. xlite-dev/lite.ai.toolkit xlite-dev/lite.ai.toolkit Public

   🛠A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉

   C++ 4.4k 773

3. PaddlePaddle/FastDeploy PaddlePaddle/FastDeploy Public

   High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

   Python 3.6k 699

4. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 23.5k 4.4k

5. vipshop/cache-dit vipshop/cache-dit Public

   🤗 A PyTorch-native and Flexible Inference Engine with Hybrid Cache Acceleration and Parallelism for DiTs.

   Python 1k 62

6. xlite-dev/ffpa-attn xlite-dev/ffpa-attn Public

   🤖FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA EA.

   Cuda 250 13