Alternatives and similar repositories for subpop:

Users that are interested in subpop are comparing it to the libraries listed below

• hetailang / SqueezeAttention
  ☆37Updated 5 months ago
• Zoeyyao27 / SirLLM
  This repository contains the code for the paper: SirLLM: Streaming Infinite Retentive LLM
  ☆57Updated 10 months ago
• 66RING / CritiPrefill
  Code repo for "CritiPrefill: A Segment-wise Criticality-based Approach for Prefilling Acceleration in LLMs".
  ☆13Updated 6 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆35Updated 11 months ago
• tyler-griggs / melange-release
  ☆45Updated 9 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆125Updated 3 months ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆116Updated 9 months ago
• CannyLab / anthology
  [EMNLP 2024 Main] Virtual Personas for Language Models via an Anthology of Backstories
  ☆27Updated 4 months ago
• lfsszd / CS-Drafting
  Cascade Speculative Drafting
  ☆29Updated 11 months ago
• uclaml / COPS
  The official implementation of Cross-Task Experience Sharing (COPS)
  ☆21Updated 5 months ago
• BaohaoLiao / RSD
  Reward-guided Speculative Decoding (RSD) for efficiency and effectiveness.
  ☆22Updated last week
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆111Updated 3 months ago
• AutonomicPerfectionist / PipeInfer
  PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
  ☆28Updated 4 months ago
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆148Updated 2 months ago
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆104Updated 5 months ago
• IST-DASLab / QuEST
  Work in progress.
  ☆50Updated 2 weeks ago
• CASE-Lab-UMD / Unified-MoE-Compression
  The official implementation of the paper "Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques (TMLR)".
  ☆64Updated 2 weeks ago
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆152Updated last year
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated 10 months ago
• wdlctc / mini-s
  ☆50Updated 5 months ago
• AgnostiqHQ / multi-agent-llm
  Lean implementation of various multi-agent LLM methods, including Iteration of Thought (IoT)
  ☆107Updated last month
• eth-easl / deltazip
  Compression for Foundation Models
  ☆27Updated this week
• google-deepmind / asyncdiloco
  ☆43Updated last year
• Cornell-RelaxML / qtip
  ☆113Updated last week
• DRSY / EasyKV
  Easy control for Key-Value Constrained Generative LLM Inference(https://arxiv.org/abs/2402.06262)
  ☆60Updated last year
• FasterDecoding / BitDelta
  ☆195Updated 3 months ago
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆85Updated last week
• jiwonsong-dev / SLEB
  Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks
  ☆35Updated last month
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆166Updated 3 weeks ago
• opengear-project / GEAR
  GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM
  ☆158Updated 8 months ago