Alternatives and similar repositories for infini-gram-mini

Users that are interested in infini-gram-mini are comparing it to the libraries listed below

• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆46Updated last year
• thunlp / APB
  Official Implementation of APB (ACL 2025 main Oral)
  ☆32Updated 9 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated last year
• RAIVNLab / MatFormer-OLMo
  Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…
  ☆30Updated 2 years ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆77Updated last year
• yynil / RWKVInside
  ☆39Updated 7 months ago
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆58Updated 2 weeks ago
• Infini-AI-Lab / gsm_infinite
  ☆60Updated 6 months ago
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated last week
• NX-AI / mlstm_kernels
  Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.
  ☆79Updated 3 weeks ago
• lmgame-org / GRL
  Multi-Turn RL Training System with AgentTrainer for Language Model Game Reinforcement Learning
  ☆54Updated last month
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆28Updated 7 months ago
• eth-easl / mixtera
  A lightweight, user-friendly data-plane for LLM training.
  ☆37Updated 3 months ago
• graphcore-research / jax-scalify
  JAX Scalify: end-to-end scaled arithmetics
  ☆17Updated last year
• thunlp / SparsingLaw
  The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".
  ☆28Updated last year
• kjslag / spacebyte
  A byte-level decoder architecture that matches the performance of tokenized Transformers.
  ☆66Updated last year
• metacarbon / shareAtt
  Beyond KV Caching: Shared Attention for Efficient LLMs
  ☆20Updated last year
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆40Updated 2 months ago
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated last year
• lucasjinreal / ImageTokenizer
  imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…
  ☆37Updated last year
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆33Updated last year
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last year
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆35Updated 9 months ago
• subconscious-systems / TIMRUN
  ☆62Updated 2 weeks ago
• zaydzuhri / flame
  Fork of Flame repo for training of some new stuff in development
  ☆19Updated 2 weeks ago
• UCB-ADRS / ADRS
  AI-Driven Research Systems (ADRS)
  ☆91Updated this week
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆62Updated last year
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆45Updated this week
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆42Updated last year
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆35Updated last year