modelscope / easydistillLinks
a toolkit on knowledge distillation for large language models
☆229Updated this week
Alternatives and similar repositories for easydistill
Users that are interested in easydistill are comparing it to the libraries listed below
Sorting:
- a-m-team's exploration in large language modeling☆195Updated 7 months ago
- LLaMA Factory Document☆159Updated last week
- ☆235Updated last year
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆450Updated this week
- ☆115Updated last year
- Ling is a MoE LLM provided and open-sourced by InclusionAI.☆237Updated 7 months ago
- ☆54Updated last year
- Repo for Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning Agent☆402Updated 8 months ago
- ☆175Updated 7 months ago
- Scaling Preference Data Curation via Human-AI Synergy☆133Updated 5 months ago
- code for piccolo embedding model from SenseTime☆144Updated last year
- Mixture-of-Experts (MoE) Language Model☆192Updated last year
- Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024☆59Updated last year
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆67Updated 2 years ago
- ☆50Updated last year
- An automated pipeline for evaluating LLMs for role-playing.☆203Updated last year
- 怎么训练一个LLM分词器☆154Updated 2 years ago
- Repo for "MaskSearch: A Universal Pre-Training Framework to Enhance Agentic Search Capability"☆147Updated 7 months ago
- ☆77Updated 11 months ago
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆222Updated 5 months ago
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆275Updated 10 months ago
- OpenSeek aims to unite the global open source community to drive collaborative innovation in algorithms, data and systems to develop next…☆241Updated 2 weeks ago
- Qwen1.5-SFT(阿里, Ali), Qwen_Qwen1.5-2B-Chat/Qwen_Qwen1.5-7B-Chat微调(transformers)/LORA(peft)/推理☆69Updated last year
- Official Repository for SIGIR2024 Demo Paper "An Integrated Data Processing Framework for Pretraining Foundation Models"☆85Updated last year
- ☆424Updated last week
- ☆93Updated 7 months ago
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆257Updated last year
- 本项目用于大模型数学解题能力方面的数据集合成,模型训练及评测,相关文章记录。☆98Updated last year
- [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation☆118Updated 7 months ago
- The RedStone repository includes code for preparing extensive datasets used in training large language models.☆146Updated 5 months ago