Alternatives and similar repositories for bamba

Users that are interested in bamba are comparing it to the libraries listed below

• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆94Updated this week
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆185Updated 8 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated 2 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆78Updated last year
• mistralai / mistral-evals
  ☆77Updated last month
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆89Updated 4 months ago
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆109Updated 5 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆55Updated 8 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆103Updated 5 months ago
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆296Updated last month
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆59Updated last year
• google-deepmind / asyncdiloco
  ☆46Updated last year
• arcee-ai / DAM
  ☆54Updated 10 months ago
• allenai / IFBench
  ☆77Updated 2 weeks ago
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆96Updated 10 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆130Updated 10 months ago
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆116Updated last month
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆149Updated this week
• facebookresearch / llm-speedrunner
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆99Updated 2 months ago
• NVlabs / hymba
  ☆198Updated 9 months ago
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆99Updated last year
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …
  ☆60Updated 11 months ago
• IST-DASLab / gptq-gguf-toolkit
  GPTQ and efficient search for GGUF
  ☆49Updated 2 weeks ago
• lucidrains / mind-evolution
  Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind
  ☆57Updated 4 months ago
• devvrit / matformer
  MatFormer repo
  ☆62Updated 9 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆93Updated last year
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆48Updated 5 months ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆115Updated 5 months ago