nyunAI / Faster-LLM-Survey
☆41Updated 11 months ago
Alternatives and similar repositories for Faster-LLM-Survey:
Users that are interested in Faster-LLM-Survey are comparing it to the libraries listed below
- ☆47Updated 7 months ago
- Code for NeurIPS LLM Efficiency Challenge☆57Updated 11 months ago
- Prune transformer layers☆68Updated 10 months ago
- ☆67Updated 2 weeks ago
- Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆155Updated 9 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆35Updated 11 months ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆116Updated 9 months ago
- Code for studying the super weight in LLM☆94Updated 4 months ago
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆40Updated last year
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆54Updated last week
- Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)☆39Updated last year
- ☆86Updated 6 months ago
- Unofficial implementation of https://arxiv.org/pdf/2407.14679☆44Updated 6 months ago
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆150Updated 3 months ago
- ☆125Updated last year
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆57Updated 11 months ago
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆279Updated last month
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"☆59Updated 5 months ago
- Cascade Speculative Drafting☆29Updated last year
- Codebase accompanying the Summary of a Haystack paper.☆76Updated 6 months ago
- My fork os allen AI's OLMo for educational purposes.☆30Updated 3 months ago
- [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models☆46Updated last month
- Train, tune, and infer Bamba model☆87Updated 2 months ago
- ☆80Updated last month
- Long Context Extension and Generalization in LLMs☆50Updated 6 months ago
- Organize the Web: Constructing Domains Enhances Pre-Training Data Curation☆39Updated last month
- Codebase for Instruction Following without Instruction Tuning☆33Updated 6 months ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated 3 months ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆119Updated last year
- ☆64Updated 11 months ago