facebookresearch / LayerSkip
Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
☆203Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for LayerSkip
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆172Updated 3 months ago
- A family of compressed models obtained via pruning and knowledge distillation☆279Updated this week
- Manage scalable open LLM inference endpoints in Slurm clusters☆237Updated 4 months ago
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (Official Code)☆133Updated last month
- An Open Source Toolkit For LLM Distillation☆352Updated last month
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆194Updated 6 months ago
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆173Updated last week
- LoRA and DoRA from Scratch Implementations☆188Updated 8 months ago
- A compact LLM pretrained in 9 days by using high quality data☆260Updated last month
- PyTorch implementation of models from the Zamba2 series.☆158Updated this week
- The official evaluation suite and dynamic data release for MixEval.☆222Updated this week
- awesome synthetic (text) datasets☆239Updated 2 weeks ago
- code for training & evaluating Contextual Document Embedding models☆93Updated this week
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).☆142Updated this week
- ☆182Updated 3 weeks ago
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆171Updated 3 weeks ago
- Prune transformer layers☆63Updated 5 months ago
- ☆116Updated 2 months ago
- ☆92Updated last month
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆154Updated 3 weeks ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆110Updated 4 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆92Updated last month
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆160Updated last week
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆251Updated last year
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆292Updated 10 months ago
- A pipeline for LLM knowledge distillation☆77Updated 3 months ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆219Updated last week
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆261Updated last year
- Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆134Updated 4 months ago
- Set of scripts to finetune LLMs☆36Updated 7 months ago