Pinned

1. lite.ai.toolkit lite.ai.toolkit Public

   🛠 A lite C++ toolkit of awesome AI models, support ONNXRuntime, MNN. Contains YOLOv5, YOLOv6, YOLOX, YOLOR, FaceDet, HeadSeg, HeadPose, Matting etc. Engine: ONNXRuntime, MNN.

   C++ 3.4k 664

2. PaddlePaddle/FastDeploy PaddlePaddle/FastDeploy Public

   ⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end…

   C++ 2.7k 430

3. Awesome-LLM-Inference Awesome-LLM-Inference Public

   📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

   1.3k 103

4. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 18.6k 2.5k

5. CUDA-Learn-Notes CUDA-Learn-Notes Public

   🎉CUDA 笔记 / 大模型手撕CUDA / C++笔记，更新随缘: flash_attn、sgemm、sgemv、warp reduce、block reduce、dot product、elementwise、softmax、layernorm、rmsnorm、hist etc.

   Cuda 515 54

6. statistic-learning-R-note statistic-learning-R-note Public

   📒《统计学习方法-李航》学习笔记 200 页 PDF，各种手推公式细节讲解，包含详细的目录以及R语言代码实现，可结合《统计学习方法》提高学习效率，适合机器学习、深度学习初学者。

   359 48