Alternatives and similar repositories for modalities

Users that are interested in modalities are comparing it to the libraries listed below

• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆107Updated 4 months ago
• VectorInstitute / vector-inference
  Efficient LLM inference on Slurm clusters using vLLM.
  ☆77Updated this week
• srush / do-we-need-attention
  ☆166Updated 2 years ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆82Updated 3 years ago
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆79Updated 3 years ago
• AntreasAntoniou / kubejobs
  ☆31Updated 5 months ago
• luyug / magix
  Supercharge huggingface transformers with model parallelism.
  ☆77Updated last month
• epfml / DenseFormer
  ☆82Updated last year
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆63Updated last year
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆160Updated 2 months ago
• anthropics / toy-models-of-superposition
  Notebooks accompanying Anthropic's "Toy Models of Superposition" paper
  ☆128Updated 3 years ago
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 3 years ago
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆79Updated 3 years ago
• tommasomncttn / mergenetic
  Flexible library for merging large language models (LLMs) via evolutionary optimization (ACL 2025 Demo).
  ☆85Updated last month
• princeton-nlp / TransformerPrograms
  [NeurIPS 2023] Learning Transformer Programs
  ☆162Updated last year
• coastalcph / hierarchical-transformers
  Hierarchical Attention Transformers (HAT)
  ☆58Updated last year
• jxiw / BiGS
  Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …
  ☆115Updated last year
• EdinburghNLP / torch-adaptive-imle
  ☆35Updated 9 months ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆91Updated last week
• google-deepmind / transformer_grammars
  Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)
  ☆130Updated 3 months ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆129Updated 9 months ago
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆225Updated 2 months ago
• HenryNdubuaku / nanodl
  A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.
  ☆291Updated last year
• nostalgebraist / transformer-utils
  Utilities for the HuggingFace transformers library
  ☆71Updated 2 years ago
• McGill-NLP / length-generalization
  Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023
  ☆137Updated last year
• fdalvi / NeuroX
  A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.
  ☆105Updated last year
• guy-dar / embedding-space
  ☆54Updated 2 years ago
• srush / mamba-primer
  ☆38Updated last year
• msakarvadia / AttentionLens
  Interpretating the latent space representations of attention head outputs for LLMs
  ☆34Updated last year
• ludwigwinkler / JaxLightning
  Running Jax in PyTorch Lightning
  ☆113Updated 9 months ago