Alternatives and similar repositories for blt:

Users that are interested in blt are comparing it to the libraries listed below

• microsoft / Samba
  Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"
  ☆821Updated last week
• facebookresearch / large_concept_model
  Large Concept Models: Language modeling in a sentence representation space
  ☆108Updated this week
• ironjr / grokfast
  Official repository for the paper "Grokfast: Accelerated Grokking by Amplifying Slow Gradients"
  ☆526Updated 5 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆181Updated 5 months ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 2 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆372Updated 3 months ago
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆223Updated last month
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆164Updated 3 weeks ago
• KellerJordan / Muon
  Muon optimizer for neural networks: >30% extra sample efficiency, <3% wallclock overhead
  ☆174Updated this week
• open-thought / system-2-research
  System 2 Reasoning Link Collection
  ☆702Updated this week
• google-deepmind / recurrentgemma
  Open weights language model from Google DeepMind, based on Griffin.
  ☆612Updated 5 months ago
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆274Updated 2 weeks ago
• PaulPauls / llama3_interpretability_sae
  A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…
  ☆603Updated 2 weeks ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆315Updated 3 weeks ago
• HazyResearch / lolcats
  Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"
  ☆197Updated 2 months ago
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆715Updated 3 weeks ago
• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆543Updated last week
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆737Updated last week
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,331Updated this week
• EleutherAI / sae
  Sparse autoencoders
  ☆379Updated last week
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆877Updated this week
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆142Updated last month
• pbelcak / UltraFastBERT
  The repository for the code of the UltraFastBERT paper
  ☆513Updated 8 months ago
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆460Updated 9 months ago
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆242Updated last week
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆244Updated 5 months ago
• microsoft / GRIN-MoE
  GRadient-INformed MoE
  ☆261Updated 2 months ago
• NousResearch / Open-Reasoning-Tasks
  A comprehensive repository of reasoning tasks for LLMs (and beyond)
  ☆291Updated 2 months ago
• ekinakyurek / marc
  Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"
  ☆251Updated 3 weeks ago