Alternatives and similar repositories for superbpe:

Users that are interested in superbpe are comparing it to the libraries listed below

• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …
  ☆59Updated 6 months ago
• princeton-pli / MeCo
  Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"
  ☆36Updated last month
• mgmalek / efficient_cross_entropy
  ☆100Updated 10 months ago
• sustcsonglin / mamba-triton
  ☆46Updated last year
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 7 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆127Updated 3 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆73Updated last year
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆55Updated last week
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆59Updated 2 months ago
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains
  ☆54Updated this week
• allenai / bff
  ☆38Updated last year
• srush / LLM-Talk
  ☆49Updated last year
• huggingface / kernels
  Load compute kernels from the Hub
  ☆115Updated this week
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆96Updated last year
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆53Updated 7 months ago
• google-deepmind / randomized_positional_encodings
  Randomized Positional Encodings Boost Length Generalization of Transformers
  ☆80Updated last year
• DAMO-NLP-SG / LongPO
  [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
  ☆33Updated last month
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆23Updated 7 months ago
• cofe-ai / nanoLM
  An Affordable LLM Pre-training Benchmark via Accurate Loss Prediction across Scales
  ☆13Updated 10 months ago
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆43Updated last year
• luyug / magix
  Supercharge huggingface transformers with model parallelism.
  ☆76Updated 6 months ago
• chijames / KERPLE
  ☆19Updated 2 years ago
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆45Updated 3 weeks ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆34Updated 6 months ago
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆60Updated 11 months ago
• ZhaofengWu / semantic-hub
  ☆15Updated 4 months ago
• Infini-AI-Lab / gsm_infinite
  ☆43Updated last month
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆76Updated last year
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆53Updated last year
• hills-code / open-instruct
  ☆17Updated 11 months ago