Alternatives and similar repositories for transformer-debugger

Users that are interested in transformer-debugger are comparing it to the libraries listed below

• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆6,170Updated 2 weeks ago
• pytorch / torchtune
  PyTorch native post-training library
  ☆5,399Updated this week
• allenai / OLMo
  Modeling, training, eval, and inference code for OLMo
  ☆5,860Updated this week
• meta-pytorch / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆6,045Updated 4 months ago
• EleutherAI / lm-evaluation-harness
  A framework for few-shot evaluation of language models.
  ☆9,802Updated this week
• XueFuzhao / OpenMoE
  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models
  ☆1,577Updated last year
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆5,318Updated 2 weeks ago
• EleutherAI / pythia
  The hub for EleutherAI's work on interpretability and learning dynamics
  ☆2,590Updated 2 months ago
• jiaweizzhao / GaLore
  GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
  ☆1,585Updated 9 months ago
• huggingface / datatrove
  Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
  ☆2,537Updated this week
• allenai / open-instruct
  AllenAI's post-training codebase
  ☆3,105Updated this week
• mlfoundations / dclm
  DataComp for Language Models
  ☆1,347Updated last week
• lucidrains / self-rewarding-lm-pytorch
  Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
  ☆1,397Updated last year
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆6,999Updated last year
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆7,450Updated last week
• karpathy / minbpe
  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
  ☆9,836Updated last year
• AnswerDotAI / fsdp_qlora
  Training LLMs with QLoRA + FSDP
  ☆1,525Updated 9 months ago
• FasterDecoding / Medusa
  Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
  ☆2,593Updated last year
• google / gemma_pytorch
  The official PyTorch implementation of Google's Gemma models
  ☆5,529Updated 2 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆2,121Updated last month
• gkamradt / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆1,964Updated 11 months ago
• S-LoRA / S-LoRA
  S-LoRA: Serving Thousands of Concurrent LoRA Adapters
  ☆1,846Updated last year
• pytorch / torchtitan
  A PyTorch native platform for training generative AI models
  ☆4,195Updated this week
• openai / simple-evals
  ☆3,945Updated last week
• microsoft / LMOps
  General technology for enabling AI capabilities w/ LLMs and MLLMs
  ☆4,082Updated last month
• openai / weak-to-strong
  ☆2,529Updated last year
• eric-mitchell / direct-preference-optimization
  Reference implementation for DPO (Direct Preference Optimization)
  ☆2,692Updated last year
• TransformerLensOrg / TransformerLens
  A library for mechanistic interpretability of GPT-style language models
  ☆2,458Updated this week
• jquesnelle / yarn
  YaRN: Efficient Context Window Extension of Large Language Models
  ☆1,569Updated last year
• FranxYao / chain-of-thought-hub
  Benchmarking large language models' complex reasoning ability with chain-of-thought prompting
  ☆2,744Updated last year