Alternatives and similar repositories for dolomite-engine:

Users that are interested in dolomite-engine are comparing it to the libraries listed below

• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆59Updated 5 months ago
• mayank31398 / ladder-residual-inference
  ☆12Updated 3 weeks ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆86Updated 2 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated 10 months ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆80Updated 3 years ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆40Updated last year
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆71Updated 7 months ago
• google-deepmind / asyncdiloco
  ☆43Updated last year
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆85Updated last week
• arcee-ai / DAM
  ☆48Updated 4 months ago
• hadasah / btm
  ☆73Updated 10 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆125Updated 2 months ago
• jeffreysijuntan / lloco
  The official repo for "LLoCo: Learning Long Contexts Offline"
  ☆116Updated 9 months ago
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆58Updated 2 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆42Updated 6 months ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated 11 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 6 months ago
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆45Updated last year
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆79Updated 2 weeks ago
• allenai / bff
  ☆38Updated 11 months ago
• HazyResearch / train-tk
  train with kittens!
  ☆54Updated 5 months ago
• berlino / seq_icl
  ☆51Updated 10 months ago
• foundation-model-stack / fms-hf-tuning
  🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
  ☆38Updated this week
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆51Updated last week
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆42Updated last year
• srush / LLM-Talk
  ☆48Updated last year
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆96Updated last week
• lfsszd / CS-Drafting
  Cascade Speculative Drafting
  ☆29Updated 11 months ago
• epfml / DenseFormer
  ☆79Updated 11 months ago
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆82Updated 4 months ago