FreedomIntelligence / FastLLMLinks
Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
☆40Updated 2 years ago
Alternatives and similar repositories for FastLLM
Users that are interested in FastLLM are comparing it to the libraries listed below
Sorting:
- SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper☆32Updated last year
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆58Updated last year
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆138Updated last year
- FuseAI Project☆88Updated 11 months ago
- ☆36Updated last year
- [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”☆126Updated last year
- code for Scaling Laws of RoPE-based Extrapolation☆73Updated 2 years ago
- Reformatted Alignment☆111Updated last year
- the newest version of llama3,source code explained line by line using Chinese☆22Updated last year
- Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"☆40Updated last year
- An Experiment on Dynamic NTK Scaling RoPE☆64Updated 2 years ago
- ☆40Updated last year
- We aim to provide the best references to search, select, and synthesize high-quality and large-quantity data for post-training your LLMs.☆61Updated last year
- Code for paper titled "Towards the Law of Capacity Gap in Distilling Language Models"☆102Updated last year
- ☆83Updated last year
- ☆96Updated last year
- 1.4B sLLM for Chinese and English - HammerLLM🔨☆43Updated last year
- Self-Evolved Diverse Data Sampling for Efficient Instruction Tuning☆86Updated 2 years ago
- ☆99Updated 5 months ago
- ☆93Updated 7 months ago
- [EMNLP 2025] CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Reward☆61Updated 5 months ago
- [NAACL 2025] Representing Rule-based Chatbots with Transformers☆23Updated 11 months ago
- Qwen-WisdomVast is a large model trained on 1 million high-quality Chinese multi-turn SFT data, 200,000 English multi-turn SFT data, and …☆18Updated last year
- Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment☆81Updated last year
- The source code and dataset mentioned in the paper Seal-Tools: Self-Instruct Tool Learning Dataset for Agent Tuning and Detailed Benchmar…☆53Updated last year
- LMTuner: Make the LLM Better for Everyone☆38Updated 2 years ago
- Official completion of “Training on the Benchmark Is Not All You Need”.☆38Updated last year
- Leveraging passage embeddings for efficient listwise reranking with large language models.☆49Updated last year
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆81Updated last year
- A collection of instruction data and scripts for machine translation.☆20Updated 2 years ago