nyunAI / Faster-LLM-SurveyLinks
☆42Updated last year
Alternatives and similar repositories for Faster-LLM-Survey
Users that are interested in Faster-LLM-Survey are comparing it to the libraries listed below
Sorting:
- ☆48Updated last year
- The official repo for "LLoCo: Learning Long Contexts Offline"☆118Updated last year
- ☆95Updated 10 months ago
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".☆174Updated 5 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆61Updated 10 months ago
- Code for studying the super weight in LLM☆115Updated 8 months ago
- minimal GRPO implementation from scratch☆96Updated 5 months ago
- [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"☆38Updated last year
- Replicating O1 inference-time scaling laws☆89Updated 8 months ago
- From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…☆47Updated 4 months ago
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆56Updated 2 weeks ago
- ☆127Updated last year
- Unofficial implementation of https://arxiv.org/pdf/2407.14679☆48Updated 11 months ago
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆98Updated 11 months ago
- ☆202Updated 8 months ago
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆62Updated last year
- a curated list of the role of small models in the LLM era☆104Updated 11 months ago
- [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models☆54Updated 6 months ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 11 months ago
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆161Updated 4 months ago
- A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.☆96Updated 8 months ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆135Updated last year
- Plug in and play implementation of " Textbooks Are All You Need", ready for training, inference, and dataset generation☆75Updated last year
- ☆65Updated last year
- Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)☆44Updated last year
- Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆170Updated last year
- ☆69Updated last year
- ☆76Updated last week
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.☆121Updated 6 months ago