modelscope / easydistillLinks
a toolkit on knowledge distillation for large language models
☆153Updated this week
Alternatives and similar repositories for easydistill
Users that are interested in easydistill are comparing it to the libraries listed below
Sorting:
- ☆231Updated last year
- ☆49Updated last year
- ☆54Updated last year
- a-m-team's exploration in large language modeling☆187Updated 3 months ago
- 怎么训练一个LLM分词器☆151Updated 2 years ago
- 本项目用于大模型数学解题能力方面的数据集合成,模型训练及评测,相关文章记录。☆95Updated last year
- ☆40Updated last year
- Scaling Preference Data Curation via Human-AI Synergy☆106Updated 2 months ago
- code for piccolo embedding model from SenseTime☆138Updated last year
- LLaMA Factory Document☆150Updated this week
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆67Updated 2 years ago
- ☆163Updated 4 months ago
- ☆114Updated 10 months ago
- Official Repository for SIGIR2024 Demo Paper "An Integrated Data Processing Framework for Pretraining Foundation Models"☆82Updated last year
- Deep Research☆88Updated 3 weeks ago
- ☆47Updated 8 months ago
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆250Updated 6 months ago
- SuperCLUE-Math6:新一代中文原生多轮多步数学推理数据集的探索之旅☆60Updated last year
- ☆176Updated last year
- [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement☆34Updated 3 months ago
- Fantastic Data Engineering for Large Language Models☆90Updated 8 months ago
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆212Updated last month
- [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation☆113Updated 3 months ago
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆254Updated 9 months ago
- WritingBench: A Comprehensive Benchmark for Generative Writing☆115Updated last week
- An automated pipeline for evaluating LLMs for role-playing.☆198Updated last year
- 1st Solution For Conversational Multi-Doc QA Workshop & International Challenge @ WSDM'24 - Xiaohongshu.Inc☆161Updated last month
- Ling is a MoE LLM provided and open-sourced by InclusionAI.☆191Updated 4 months ago
- Mixture-of-Experts (MoE) Language Model☆189Updated last year
- Repo for "MaskSearch: A Universal Pre-Training Framework to Enhance Agentic Search Capability"☆145Updated 3 months ago