mkantwala / DeepSeek-R1-TrainingSuite
Advanced implementation of DeepSeek-R1 featuring Group Relative Policy Optimization (GRPO) for mathematical reasoning AI. Integrates safe distillation, modular reward systems, and efficient LoRA fine-tuning. Open-source Apache 2.0 licensed framework for developing aligned AI systems.
☆10Updated 2 months ago
Alternatives and similar repositories for DeepSeek-R1-TrainingSuite:
Users that are interested in DeepSeek-R1-TrainingSuite are comparing it to the libraries listed below
- ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory☆91Updated 2 weeks ago
- Fast instruction tuning with Llama2☆11Updated last year
- A light proxy solution for HuggingFace hub.☆46Updated last year
- Music large model based on InternLM2-chat.☆22Updated 4 months ago
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆36Updated last year
- ☆22Updated 8 months ago
- 模型压缩的小白入门教程☆22Updated 9 months ago
- 大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标☆17Updated 7 months ago
- diagnosis_zero, R1 Zero reproduce on disease diagnosis☆29Updated 2 months ago
- the newest version of llama3,source code explained line by line using Chinese☆22Updated last year
- mllm-npu: training multimodal large language models on Ascend NPUs☆91Updated 7 months ago
- This is the code repo for our paper "Benchmarking Retrieval-Augmented Generation in Multi-Modal Contexts".☆31Updated last month
- Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory☆28Updated 11 months ago
- Xtuner Factory☆33Updated last year
- A repository aimed at pruning DeepSeek V3, R1 and R1-zero to a usable size☆44Updated 2 weeks ago
- XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.☆36Updated 7 months ago
- 模型 llava-Qwen2-7B-Instruct-Chinese-CLIP 增强中文文字识别能力和表情包内涵识别能力,接近gpt4o、claude-3.5-sonnet的识别水平!☆22Updated 9 months ago
- 最简易的R1结果在小模型上的复现,阐述类O1与DeepSeek R1最重要的本质。Think is all your need。利用实验佐证,对于强推理能力,think思考过程性内容是AGI/ASI的核心。☆44Updated 2 months ago
- 研究GOT-OCR-项目落地加速,不限语言☆60Updated 6 months ago
- GLM Series Edge Models☆136Updated 2 months ago
- ☆38Updated last month
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆49Updated last year
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- ☆19Updated last month
- Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024☆57Updated 5 months ago
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆56Updated last year
- Exploration of the multi modal fuyu-8b model of Adept. 🤓 🔍☆28Updated last year
- qwen2 and llama3 cpp implementation☆44Updated 10 months ago
- ☆28Updated 11 months ago
- Code for "An Empirical Study of Retrieval Augmented Generation with Chain-of-Thought"☆12Updated 8 months ago