thunlp / APB
☆27Updated last month
Alternatives and similar repositories for APB:
Users that are interested in APB are comparing it to the libraries listed below
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆36Updated last year
- Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"☆36Updated 3 weeks ago
- ☆20Updated 5 months ago
- ☆43Updated last month
- In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning☆34Updated last year
- Codebase for Instruction Following without Instruction Tuning☆34Updated 6 months ago
- triton ver of gqa flash attn, based on the tutorial☆11Updated 8 months ago
- The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".☆20Updated 5 months ago
- [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization☆33Updated last month
- ☆62Updated 3 weeks ago
- The official code repo and data hub of top_nsigma sampling strategy for LLMs.☆24Updated 2 months ago
- [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs☆23Updated 6 months ago
- ☆44Updated last month
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆30Updated last week
- This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"☆48Updated 9 months ago
- ☆15Updated 6 months ago
- Source code for GreaTer ICLR 2025 - Gradient Over Reasoning makes Smaller Language Models Strong Prompt Optimizers☆18Updated this week
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆29Updated last month
- ☆30Updated 4 months ago
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆55Updated last week
- The paper list of multilingual pre-trained models (Continual Updated).☆20Updated 10 months ago
- [NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding☆16Updated 6 months ago
- Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"☆11Updated 6 months ago
- XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.☆36Updated 7 months ago
- Code for Paper: Teaching Language Models to Critique via Reinforcement Learning☆92Updated this week
- The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.☆45Updated 6 months ago
- Official Repository for Paper "BaichuanSEED: Sharing the Potential of ExtensivE Data Collection and Deduplication by Introducing a Compet…☆18Updated 7 months ago
- Code for paper: Long cOntext aliGnment via efficient preference Optimization☆13Updated 2 months ago
- ☆17Updated 3 months ago
- Exploration of automated dataset selection approaches at large scales.☆38Updated last month