Alternatives and similar repositories for headinfer

Users that are interested in headinfer are comparing it to the libraries listed below

• cofe-ai / FLM-101B

  View on GitHub
  ☆12Jan 9, 2024Updated 2 years ago
• pzs19 / TokenSelect

  View on GitHub
  ☆19Mar 11, 2025Updated 11 months ago
• graphcore-research / llm-inference-research

  View on GitHub
  An experimentation platform for LLM inference optimisation
  ☆35Sep 19, 2024Updated last year
• Alibaba-NLP / LaRA

  View on GitHub
  The code for LaRA Benchmark
  ☆47May 28, 2025Updated 8 months ago
• plm-team / PLM

  View on GitHub
  PLM: Efficient Peripheral Language Models Hardware-Co-Designed for Ubiquitous Computing
  ☆21Mar 18, 2025Updated 10 months ago
• bcml-labs / rosa-plus

  View on GitHub
  ROSA+: RWKV's ROSA implementation with fallback statistical predictor
  ☆32Oct 13, 2025Updated 4 months ago
• princeton-nlp / ELIZA-Transformer

  View on GitHub
  [NAACL 2025] Representing Rule-based Chatbots with Transformers
  ☆23Feb 9, 2025Updated last year
• zjunlp / steer-target-atoms

  View on GitHub
  [ACL 2025] Beyond Prompt Engineering: Robust Behavior Control in LLMs via Steering Target Atoms
  ☆35Jun 4, 2025Updated 8 months ago
• OurBluePrint / easy_video

  View on GitHub
  ☆20Mar 3, 2025Updated 11 months ago
• LLMkvsys / rethink-kv-compression

  View on GitHub
  ☆22Mar 7, 2025Updated 11 months ago
• PanZaifeng / FastTree-Artifact

  View on GitHub
  ☆27Mar 24, 2025Updated 10 months ago
• juvi21 / CoPE-cuda

  View on GitHub
  Contextual Position Encoding but with some custom CUDA Kernels https://arxiv.org/abs/2405.18719
  ☆22Jun 5, 2024Updated last year
• OpenNLPLab / LASP

  View on GitHub
  Linear Attention Sequence Parallelism (LASP)
  ☆88Jun 4, 2024Updated last year
• and270 / thinking_effort_processor

  View on GitHub
  ☆94Jul 7, 2025Updated 7 months ago
• MayDomine / Burst-Attention

  View on GitHub
  Distributed IO-aware Attention algorithm
  ☆24Sep 24, 2025Updated 4 months ago
• Bui1dMySea / MemLong

  View on GitHub
  ☆96Dec 6, 2024Updated last year
• Jikai0Wang / OPT-Tree

  View on GitHub
  ☆28May 24, 2025Updated 8 months ago
• ShaharBand / sentinel

  View on GitHub
  A user-friendly Command & Control (C&C) web platform for remote monitoring, management, and task automation across multiple devices.
  ☆14Dec 15, 2024Updated last year
• yoheinakajima / pippin_moves

  View on GitHub
  quick playground to animate pippin
  ☆14Nov 11, 2024Updated last year
• jy-yuan / KIVI

  View on GitHub
  [ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
  ☆356Nov 20, 2025Updated 2 months ago
• sylvain-wei / 24-Game-Reasoning

  View on GitHub
  超简单复现Deepseek-R1-Zero和Deepseek-R1，以「24点游戏」为例。通过zero-RL、SFT以及SFT+RL，以激发LLM的自主验证反思能力。 About Clean, minimal, accessible reproduction of Dee…
  ☆33Apr 5, 2025Updated 10 months ago
• nanowell / Q-Sparse-LLM

  View on GitHub
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆33Aug 14, 2024Updated last year
• RUCAIBox / ChainLM

  View on GitHub
  ☆31Mar 23, 2024Updated last year
• Lightblues / AgentRE

  View on GitHub
  Repo for for paper "AgentRE: An Agent-Based Framework for Navigating Complex Information Landscapes in Relation Extraction".
  ☆70Jul 24, 2024Updated last year
• ZhangYiqun018 / Avengers

  View on GitHub
  [AAAI 2026] The Avengers: A Simple Recipe for Uniting Smaller Language Models to Challenge Proprietary Giants
  ☆46Dec 11, 2025Updated 2 months ago
• QwenLM / ParScale

  View on GitHub
  Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling
  ☆469May 17, 2025Updated 8 months ago
• LeanModels / DFloat11

  View on GitHub
  DFloat11 [NeurIPS '25]: Lossless Compression of LLMs and DiTs for Efficient GPU Inference
  ☆603Nov 24, 2025Updated 2 months ago
• SuriyaaMM / feather

  View on GitHub
  Lower Precision Floating Point Operations
  ☆66Updated this week
• st4sd / st4sd-runtime-core

  View on GitHub
  Create and deploy virtual-experiments - co-processing computational workflows
  ☆10Jan 28, 2026Updated 2 weeks ago
• RUC-NLPIR / fullrank

  View on GitHub
  ☆38Nov 13, 2025Updated 3 months ago
• abdelfattah-lab / xKV

  View on GitHub
  xKV: Cross-Layer SVD for KV-Cache Compression
  ☆44Nov 30, 2025Updated 2 months ago
• NathanGodey / qfilters

  View on GitHub
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆35Mar 7, 2025Updated 11 months ago
• omkaark / agenata

  View on GitHub
  Build Web Datasets with Ease
  ☆33Jun 23, 2024Updated last year
• microsoft / chunk-attention

  View on GitHub
  ☆85Apr 18, 2025Updated 9 months ago
• HKUNLP / STRING

  View on GitHub
  [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆78Nov 25, 2024Updated last year
• princeton-pli / PruLong

  View on GitHub
  Code for the preprint "Cache Me If You Can: How Many KVs Do You Need for Effective Long-Context LMs?"
  ☆47Jul 29, 2025Updated 6 months ago
• Concyclics / BIG_PROJECT

  View on GitHub
  homework in SCUT_SE
  ☆12Nov 9, 2021Updated 4 years ago
• caps-tum / mt4g

  View on GitHub
  Memory Topology for GPUs
  ☆17Dec 9, 2025Updated 2 months ago
• eth-cscs / ext_mpi_collectives

  View on GitHub
  ext_mpi_collectives
  ☆11Apr 1, 2025Updated 10 months ago