Alternatives and similar repositories for LayerSkip:

Users that are interested in LayerSkip are comparing it to the libraries listed below

• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆188Updated 6 months ago
• NVIDIA / kvpress
  LLM KV cache compression made easy
  ☆303Updated this week
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆209Updated 8 months ago
• NVlabs / Minitron
  A family of compressed models obtained via pruning and knowledge distillation
  ☆309Updated 2 months ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆277Updated last month
• NVlabs / hymba
  ☆152Updated last month
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆247Updated 6 months ago
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆344Updated 2 weeks ago
• FasterDecoding / BitDelta
  ☆190Updated last month
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆425Updated last week
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆157Updated this week
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆157Updated last month
• huggingface / picotron_tutorial
  ☆104Updated last week
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆148Updated last month
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆297Updated last year
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆156Updated last week
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆114Updated 7 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆197Updated 2 months ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 3 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆253Updated last year
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆233Updated 2 months ago
• lucidrains / speculative-decoding
  Explorations into some recent techniques surrounding speculative decoding
  ☆229Updated 3 weeks ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆164Updated 3 weeks ago
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆382Updated 9 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆166Updated last month
• hao-ai-lab / Consistency_LLM
  [ICML 2024] CLLMs: Consistency Large Language Models
  ☆368Updated 2 months ago
• NVIDIA / NeMo-Skills
  A project to improve skills of large language models
  ☆230Updated this week
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆145Updated 2 weeks ago
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆161Updated this week
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆99Updated 3 months ago