Alternatives and similar repositories for transformer-debugger

Users that are interested in transformer-debugger are comparing it to the libraries listed below

• allenai / OLMo
  Modeling, training, eval, and inference code for OLMo
  ☆5,810Updated last week
• pytorch-labs / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆6,033Updated 3 months ago
• pytorch / torchtune
  PyTorch native post-training library
  ☆5,361Updated this week
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆6,053Updated last week
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆6,936Updated last year
• jiaweizzhao / GaLore
  GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
  ☆1,578Updated 8 months ago
• EleutherAI / lm-evaluation-harness
  A framework for few-shot evaluation of language models.
  ☆9,588Updated last week
• XueFuzhao / OpenMoE
  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models
  ☆1,567Updated last year
• karpathy / minbpe
  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
  ☆9,772Updated last year
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆5,271Updated 2 weeks ago
• EleutherAI / pythia
  The hub for EleutherAI's work on interpretability and learning dynamics
  ☆2,570Updated last month
• mlfoundations / dclm
  DataComp for Language Models
  ☆1,328Updated 4 months ago
• allenai / open-instruct
  AllenAI's post-training codebase
  ☆3,067Updated this week
• lucidrains / self-rewarding-lm-pytorch
  Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
  ☆1,394Updated last year
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆7,330Updated this week
• jzhang38 / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆8,654Updated last year
• FasterDecoding / Medusa
  Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
  ☆2,578Updated last year
• openai / weak-to-strong
  ☆2,528Updated last year
• mit-han-lab / llm-awq
  [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
  ☆3,172Updated last week
• Lightning-AI / lit-llama
  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…
  ☆6,073Updated 3 weeks ago
• KellerJordan / modded-nanogpt
  NanoGPT (124M) in 3 minutes
  ☆2,851Updated last week
• karpathy / nano-llama31
  nanoGPT style version of Llama 3.1
  ☆1,401Updated 11 months ago
• tatsu-lab / alpaca_eval
  An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
  ☆1,806Updated 6 months ago
• huggingface / datatrove
  Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
  ☆2,487Updated last week
• AviSoori1x / makeMoE
  From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)
  ☆730Updated 8 months ago
• gkamradt / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆1,940Updated 11 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆2,051Updated 2 weeks ago
• microsoft / LMOps
  General technology for enabling AI capabilities w/ LLMs and MLLMs
  ☆4,067Updated 3 weeks ago
• S-LoRA / S-LoRA
  S-LoRA: Serving Thousands of Concurrent LoRA Adapters
  ☆1,843Updated last year
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,236Updated 5 months ago