ironartisan / awesome-compression1Links
模型压缩的小白入门教程
☆22Updated last year
Alternatives and similar repositories for awesome-compression1
Users that are interested in awesome-compression1 are comparing it to the libraries listed below
Sorting:
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆41Updated last year
- ☆136Updated 9 months ago
- Tutorial for Ray☆36Updated last year
- 顾名思义:手搓的RAG☆130Updated last year
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆68Updated 2 years ago
- LLM101n: Let's build a Storyteller 中文版☆135Updated last year
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆51Updated 2 years ago
- ☆28Updated 5 months ago
- the newest version of llama3,source code explained line by line using Chinese☆22Updated last year
- A light proxy solution for HuggingFace hub.☆47Updated 2 years ago
- simplest online-softmax notebook for explain Flash Attention☆13Updated 11 months ago
- unify-easy-llm(ULM)旨在打造一个简易的一键式大模型训练工具,支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。☆59Updated last year
- 看图学大模型☆321Updated last year
- ☆120Updated 2 years ago
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22Updated 7 months ago
- 大语言模型训练和服务调研☆36Updated 2 years ago
- 青稞Talk☆173Updated last week
- GLM Series Edge Models☆154Updated 6 months ago
- Music large model based on InternLM2-chat.☆22Updated 11 months ago
- support BM25+vecetor☆29Updated 6 months ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆137Updated last year
- 演示Gemma中文指令微调的教程☆46Updated last year
- 最简易的R1结果在小模型上的复现,阐述类O1与DeepSeek R1最重要的本质。Think is all your need。利用实验佐证,对于强推理能力 ,think思考过程性内容是AGI/ASI的核心。☆44Updated 10 months ago
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆61Updated last year
- Transformer related optimization, including BERT, GPT☆17Updated 2 years ago
- ☆106Updated 2 years ago
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆58Updated last year
- A MoE impl for PyTorch, [ATC'23] SmartMoE☆70Updated 2 years ago
- ☆125Updated last year
- Pipeline-Parallel Lecture: Simplest Dualpipe Implementation.☆29Updated 2 months ago