thunlp / APB
☆25Updated last month
Alternatives and similar repositories for APB:
Users that are interested in APB are comparing it to the libraries listed below
- Codebase for Instruction Following without Instruction Tuning☆33Updated 6 months ago
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆53Updated this week
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆36Updated last year
- The official code repo and data hub of top_nsigma sampling strategy for LLMs.☆24Updated last month
- [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization☆31Updated last month
- Official Repository for Paper "BaichuanSEED: Sharing the Potential of ExtensivE Data Collection and Deduplication by Introducing a Compet…☆18Updated 7 months ago
- ☆32Updated 9 months ago
- ☆44Updated 3 weeks ago
- In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning☆34Updated last year
- SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper☆30Updated 9 months ago
- FuseAI Project☆84Updated 2 months ago
- Official Repository of Are Your LLMs Capable of Stable Reasoning?☆22Updated last week
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆30Updated last week
- [NAACL 2025] Representing Rule-based Chatbots with Transformers☆20Updated last month
- From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…☆44Updated 8 months ago
- Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"☆36Updated this week
- ☆36Updated last month
- Data preparation code for CrystalCoder 7B LLM☆44Updated 10 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆46Updated last year
- A repository for research on medium sized language models.☆76Updated 10 months ago
- ☆16Updated 2 months ago
- LMTuner: Make the LLM Better for Everyone☆34Updated last year
- Source code for GreaTer - Gradient Over Reasoning makes Smaller Language Models Strong Prompt Optimizers☆16Updated last month
- Here we will test various linear attention designs.☆60Updated 11 months ago
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Updated last year
- ☆64Updated 11 months ago
- DPO, but faster 🚀☆40Updated 3 months ago
- ☆34Updated last year
- ☆44Updated 3 months ago
- [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts☆39Updated last year