nyunAI / Faster-LLM-SurveyLinks
☆42Updated last year
Alternatives and similar repositories for Faster-LLM-Survey
Users that are interested in Faster-LLM-Survey are comparing it to the libraries listed below
Sorting:
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- ☆48Updated 11 months ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆118Updated last year
- Unofficial implementation of https://arxiv.org/pdf/2407.14679☆48Updated 11 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆61Updated 9 months ago
- The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".☆174Updated 4 months ago
- Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)☆41Updated last year
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆59Updated last year
- ☆95Updated 10 months ago
- ☆127Updated last year
- ☆83Updated 6 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 10 months ago
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆160Updated 3 months ago
- [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"☆38Updated last year
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆56Updated last week
- Code for studying the super weight in LLM☆114Updated 8 months ago
- ☆199Updated 8 months ago
- Cascade Speculative Drafting☆29Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks (EMNLP'24)☆146Updated 10 months ago
- minimal GRPO implementation from scratch☆94Updated 4 months ago
- Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆167Updated last year
- [ICLR 2025] MiniPLM: Knowledge Distillation for Pre-Training Language Models☆53Updated 8 months ago
- [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models☆52Updated 6 months ago
- Organize the Web: Constructing Domains Enhances Pre-Training Data Curation☆58Updated 3 months ago
- [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely☆23Updated last year
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆135Updated last year
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Updated last year
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆91Updated 8 months ago
- ☆75Updated 3 months ago
- [NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.☆152Updated last year