Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.
☆112Oct 12, 2026Updated 3 weeks ago
Alternatives and similar repositories for modalities
Users that are interested in modalities are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Sep 10, 2025Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆13Jul 14, 2025Updated last year
- ☆10Jul 6, 2023Updated 3 years ago
- 🤖 A Python Package for generating new patient representations driven by data and prior knowledge☆22Oct 24, 2025Updated last year
- Tool to perform paired evaluation of automatic systems☆13Oct 20, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Resource Multiplexing in Tuning and Serving Large Language Models (USENIX ATC 2025)☆10Apr 21, 2026Updated 6 months ago
- BPE modification that implements removing of the intermediate tokens during tokenizer training.☆27Nov 25, 2024Updated last year
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- ☆10Oct 2, 2024Updated 2 years ago
- A framework for few-shot evaluation of autoregressive language models.☆13Feb 14, 2024Updated 2 years ago
- A lightweight CuTe-based CUDA kernel for DuoAttention, optimized for large language model inference.☆12Dec 25, 2025Updated 10 months ago
- Mini-SGLang is a mini version of SGLang project ().☆13Sep 24, 2025Updated last year
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆15Oct 16, 2023Updated 3 years ago
- A scheduling framework for multitasking over diverse XPUs, including GPUs, NPUs, ASICs, and FPGAs☆14Jun 17, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- BlitzScale Router - Distributed LLM Inference Router (Rust)☆17May 25, 2026Updated 5 months ago
- PathPiece tokenizer☆14Nov 10, 2024Updated last year
- Do Multilingual Language Models Think Better in English?☆42Aug 3, 2023Updated 3 years ago
- Minimal PyTorch implementation of TP, SP, FSDP and sharded-EMA☆32Nov 27, 2025Updated 11 months ago
- ☆10Oct 15, 2019Updated 7 years ago
- ☆31Mar 2, 2023Updated 3 years ago
- The repository for ATC'25 paper "Greyhound: Hunting Fail-Slows in Hybrid-Parallel Training at Scale"☆18Sep 7, 2026Updated last month
- [ICML'25] "Rethinking Addressing in Language Models via Contextualized Equivariant Positional Encoding" by Jiajun Zhu, Peihao Wang, Ruisi…☆15Jun 6, 2025Updated last year
- MetaAttention: A Unified and Performant Attention Framework Across Hardware Backends(PPoPP'26)☆18Aug 6, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- T-Projection is a method to perform high-quality Annotation Projection of Sequence Labeling datasets.☆13Nov 21, 2023Updated 2 years ago
- A Multilingual Keyboard Layout-Based Typo Generator☆19Nov 23, 2025Updated 11 months ago
- Official repo for "Binary Retrieval-augmented Reward Mitigates Hallucinations"☆16Nov 13, 2025Updated 11 months ago
- Directly applying advancements in transfer learning from BERT results in poor accuracy in domain-specific areas like law because of a wor…☆10May 7, 2023Updated 3 years ago
- Weaker Than You Think: A Critical Look at Weakly Supervised Learning☆10Oct 22, 2023Updated 3 years ago
- [ICIP2023] Code for the paper 'Action Anticipation with Goal Consistency'☆12Apr 5, 2024Updated 2 years ago
- Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"☆27Oct 3, 2021Updated 5 years ago
- Implementation from scratch in C of the Multi-head latent attention used in the Deepseek-v3 technical paper.☆18Jan 15, 2025Updated last year
- Subset-Norm and Subset-Momentum. This repo is built on top of https://github.com/jiaweizzhao/GaLore.☆20Jul 9, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code for the ACL 2022 paper "Contextual Representation Learning beyond Masked Language Modeling"☆33Oct 23, 2022Updated 4 years ago
- [NSDI'26] PolyRL is a reinforcement learning framework for LLM that harvest spot instances on the cloud to reduce cost.☆19Mar 30, 2026Updated 7 months ago
- The official repository for Toxic Commons and Celadon. Toxicity Classification for public domain data.☆23Jul 17, 2026Updated 3 months ago
- Model-free policy gradient algorithm for LQR☆10Apr 8, 2020Updated 6 years ago
- A repository containing the code for translating popular LLM benchmarks to German.☆32Aug 20, 2023Updated 3 years ago
- A repository for research on medium sized language models.☆538Jun 6, 2025Updated last year
- Manage scalable open LLM inference endpoints in Slurm clusters☆296Jul 11, 2024Updated 2 years ago