Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.
☆111Sep 14, 2026Updated last week
Alternatives and similar repositories for modalities
Users that are interested in modalities are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆21Mar 28, 2024Updated 2 years ago
- German Language Understanding Evaluation Benchmark @NAACL24☆23Dec 11, 2025Updated 9 months ago
- ☆17Sep 10, 2025Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆13Jul 14, 2025Updated last year
- ☆10Jul 6, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- BPE modification that implements removing of the intermediate tokens during tokenizer training.☆27Nov 25, 2024Updated last year
- Small python package to measure OCR quality and other related metrics.☆26Feb 19, 2024Updated 2 years ago
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- ☆10Oct 2, 2024Updated last year
- A framework for few-shot evaluation of autoregressive language models.☆13Feb 14, 2024Updated 2 years ago
- PathPiece tokenizer☆14Nov 10, 2024Updated last year
- Do Multilingual Language Models Think Better in English?☆42Aug 3, 2023Updated 3 years ago
- ☆10Oct 15, 2019Updated 6 years ago
- T-Projection is a method to perform high-quality Annotation Projection of Sequence Labeling datasets.☆13Nov 21, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ICML'25] "Rethinking Addressing in Language Models via Contextualized Equivariant Positional Encoding" by Jiajun Zhu, Peihao Wang, Ruisi…☆15Jun 6, 2025Updated last year
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆14Sep 8, 2026Updated 2 weeks ago
- MetaAttention: A Unified and Performant Attention Framework Across Hardware Backends(PPoPP'26)☆18Aug 6, 2026Updated last month
- TokEval: intrinsic quality metrics for tokenizers across natural language, code, and math☆53Aug 31, 2026Updated 3 weeks ago
- A Multilingual Keyboard Layout-Based Typo Generator☆17Nov 23, 2025Updated 10 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆294Jul 11, 2024Updated 2 years ago
- The official repository for Toxic Commons and Celadon. Toxicity Classification for public domain data.☆23Jul 17, 2026Updated 2 months ago
- Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"☆27Oct 3, 2021Updated 4 years ago
- ☆13Feb 16, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A repository containing the code for translating popular LLM benchmarks to German.☆32Aug 20, 2023Updated 3 years ago
- Code for the ACL 2022 paper "Contextual Representation Learning beyond Masked Language Modeling"☆33Oct 23, 2022Updated 3 years ago
- Deep Reinforcement Learning Framework done with PyTorch☆43Mar 12, 2025Updated last year
- Subset-Norm and Subset-Momentum. This repo is built on top of https://github.com/jiaweizzhao/GaLore.☆19Jul 9, 2025Updated last year
- Implementation of the Pairformer model used in AlphaFold 3☆14Aug 28, 2026Updated 3 weeks ago
- [NSDI'26] PolyRL is a reinforcement learning framework for LLM that harvest spot instances on the cloud to reduce cost.☆19Mar 30, 2026Updated 5 months ago
- ☆48Jul 22, 2026Updated 2 months ago
- [Accepted to SOSP 2026] Fast Deterministic LLM Inference☆29Sep 10, 2026Updated 2 weeks ago
- Repository for CPU Kernel Generation for LLM Inference☆28Jul 13, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Scaling Data-Constrained Language Models☆345Jun 28, 2025Updated last year
- Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method ; GKD: A General Knowledge Distillation…☆34Aug 4, 2023Updated 3 years ago
- AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…☆18Oct 13, 2025Updated 11 months ago
- A Python framework for integrating biological databases and structured data sources in Biological Expression Language (BEL)☆22Nov 3, 2021Updated 4 years ago
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 9 months ago
- This project compares the performance of Swin-Transformer v2 implemented in JAX and PyTorch.☆12Jun 8, 2022Updated 4 years ago
- [ICML 2025] AdaDecode: Accelerating LLM Decoding with Adaptive Layer Parallelism☆20Jul 14, 2025Updated last year