Alternatives and similar repositories for bamba

Users that are interested in bamba are comparing it to the libraries listed below

• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆81Updated 2 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆184Updated 6 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆78Updated last year
• facebookresearch / llm-speedrunner
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆93Updated this week
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆78Updated last week
• mistralai / mistral-evals
  ☆73Updated 3 months ago
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆277Updated last week
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆127Updated 8 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated 2 weeks ago
• google-deepmind / asyncdiloco
  ☆45Updated last year
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated 11 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 6 months ago
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆103Updated 3 months ago
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆87Updated this week
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆117Updated 2 weeks ago
• arcee-ai / DAM
  ☆53Updated 8 months ago
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆28Updated 3 months ago
• lucidrains / mind-evolution
  Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind
  ☆56Updated 2 months ago
• devvrit / matformer
  MatFormer repo
  ☆56Updated 7 months ago
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆98Updated 10 months ago
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆94Updated 8 months ago
• kyleliang919 / Super_Muon
  ☆60Updated 4 months ago
• allenai / IFBench
  ☆62Updated last month
• thepowerfuldeez / OLMo
  My fork os allen AI's OLMo for educational purposes.
  ☆30Updated 7 months ago
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆43Updated 7 months ago
• Aleph-Alpha-Research / trigrams
  ☆56Updated 2 months ago
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆91Updated last year
• allenai / infinigram-api
  ☆70Updated 2 weeks ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆46Updated last year
• RobertCsordas / moeut
  ☆83Updated 11 months ago