Alternatives and similar repositories for bamba

Users that are interested in bamba are comparing it to the libraries listed below

• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆186Updated 10 months ago
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆111Updated 7 months ago
• mistralai / mistral-evals
  ☆78Updated 2 weeks ago
• google-deepmind / asyncdiloco
  ☆47Updated last year
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆78Updated last year
• devvrit / matformer
  MatFormer repo
  ☆66Updated 11 months ago
• lucidrains / mind-evolution
  Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind
  ☆57Updated 6 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆130Updated last year
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆110Updated 7 months ago
• allenai / olmo-cookbook
  OLMost every training recipe you need to perform data interventions with the OLMo family of models.
  ☆56Updated last week
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆304Updated last month
• NVlabs / hymba
  ☆202Updated 11 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆100Updated 6 months ago
• Aleph-Alpha-Research / trigrams
  ☆58Updated 2 weeks ago
• RobertCsordas / moeut
  ☆89Updated last year
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆123Updated 4 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆225Updated this week
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated last month
• IST-DASLab / gptq-gguf-toolkit
  Efficient non-uniform quantization with GPTQ for GGUF
  ☆53Updated 2 months ago
• facebookresearch / llm-speedrunner
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆112Updated last month
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆37Updated last month
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆100Updated last year
• apple / ml-hypercloning
  ☆52Updated last year
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆102Updated last year
• arcee-ai / DAM
  ☆55Updated last year
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆28Updated 7 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 7 months ago
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆58Updated this week
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year