foundation-model-stack / bamba
Train, tune, and infer Bamba model
☆115Updated last week
Alternatives and similar repositories for bamba:
Users that are interested in bamba are comparing it to the libraries listed below
- ☆43Updated last year
- EvaByte: Efficient Byte-level Language Models at Scale☆91Updated 2 weeks ago
- ☆71Updated last week
- Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya☆108Updated 2 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆59Updated 6 months ago
- Simple repository for training small reasoning models☆27Updated 3 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 8 months ago
- Dolomite Engine is a library for pretraining/finetuning LLMs☆52Updated this week
- A repository for research on medium sized language models.☆76Updated 11 months ago
- ☆54Updated this week
- From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…☆45Updated 2 weeks ago
- A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.☆83Updated last month
- ☆47Updated 8 months ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated 2 weeks ago
- ☆44Updated 2 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆39Updated 3 months ago
- Cray-LM unified training and inference stack.☆22Updated 3 months ago
- Data preparation code for Amber 7B LLM☆89Updated 11 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆126Updated 5 months ago
- RWKV-7: Surpassing GPT☆83Updated 5 months ago
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆55Updated 2 weeks ago
- DPO, but faster 🚀☆41Updated 5 months ago
- Utilities for Training Very Large Models☆58Updated 7 months ago
- ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)☆71Updated this week
- ☆28Updated 5 months ago
- Collection of autoregressive model implementation☆85Updated last week
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆153Updated 3 weeks ago
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆30Updated last month
- ☆78Updated 8 months ago