Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.
☆106Mar 17, 2026Updated this week
Alternatives and similar repositories for modalities
Users that are interested in modalities are comparing it to the libraries listed below
Sorting:
- A framework for few-shot evaluation of autoregressive language models.☆12Jul 14, 2025Updated 8 months ago
- Official implementation of "Diffusion Model Guided Sampling with Pixel-Wise Aleatoric Uncertainty Estimation"☆15Apr 1, 2025Updated 11 months ago
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆13Jan 30, 2026Updated last month
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆22Jun 30, 2025Updated 8 months ago
- MLX implementation of Hierarchical Reasoning Model (HRM) - Adaptive computation for complex reasoning tasks☆28Aug 27, 2025Updated 6 months ago
- A repository containing the code for translating popular LLM benchmarks to German.☆32Aug 20, 2023Updated 2 years ago
- ☆12Feb 16, 2024Updated 2 years ago
- [CVPR'25] SyncVP: Joint Diffusion for Synchronous Multi-Modal Video Prediction☆20Jul 28, 2025Updated 7 months ago
- Deep Reinforcement Learning Framework done with PyTorch☆43Mar 12, 2025Updated last year
- Repository for CPU Kernel Generation for LLM Inference☆28Jul 13, 2023Updated 2 years ago
- COM Kitchens: An Unedited Overhead-view Video Dataset as a Vision-Language Benchmark☆14Aug 22, 2024Updated last year
- ☆13Mar 5, 2024Updated 2 years ago
- Official code implementation for the paper "Do Vision & Language Decoders use Images and Text equally? How Self-consistent are their Expl…☆12Apr 4, 2025Updated 11 months ago
- ☆23Aug 19, 2024Updated last year
- Source code for "Influencing Long-Term Behavior in Multiagent Reinforcement Learning" (NeurIPS 2022)☆19Jan 1, 2023Updated 3 years ago
- PyTorch implementation of SimPLe (Simulated Policy Learning) on the Atari 100k benchmark.☆17Dec 7, 2022Updated 3 years ago
- A Python package for benchmarking pathway database with functional enrichment and classification methods☆13Mar 2, 2021Updated 5 years ago
- The repository contains the data and the codes for the manuscript "Relational graph convolutional networks for predicting blood-brain bar…☆15May 21, 2025Updated 9 months ago
- [CVPR 2025] MANTA: Diffusion Mamba for Efficient and Effective Stochastic Long-Term Dense Anticipation☆24Jun 13, 2025Updated 9 months ago
- Simple analyses and tutorials on the COVID-19 Knowledge Graph☆14Apr 27, 2020Updated 5 years ago
- [ICLR 2024 Poster] SCHEMA: State CHangEs MAtter for Procedure Planning in Instructional Videos☆20Aug 21, 2025Updated 6 months ago
- Learning adapter weights from task descriptions☆19Nov 12, 2023Updated 2 years ago
- WavSpA: Wavelet Space Attention for Enhancing Transformer's Long Sequence Learning☆12Feb 24, 2024Updated 2 years ago
- Using LLMs and rules for a local personal agent☆16Jan 17, 2025Updated last year
- Multi-threading, Concurrency, Asynchrony, and various Execution Methods implemented in a Rust backend for bleeding edge performance.☆19Nov 11, 2024Updated last year
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆487Updated this week
- Re-implementation for ICCV23 "Social Diffusion: Long-term Multiple Human Motion Anticipation"☆24Oct 3, 2023Updated 2 years ago
- Code for LOTUS web☆14Nov 18, 2022Updated 3 years ago
- Multimodal Large Models Are Effective Action Anticipators （IEEE TMM）🌳☆25Aug 15, 2025Updated 7 months ago
- Official implementation of the paper "Neural Hamilton: Can A.I. Understand Hamiltonian Mechanics?"☆14Feb 9, 2026Updated last month
- ☆30Mar 2, 2023Updated 3 years ago
- Differentiable and gpu enabled fast wavelet transforms in JAX.☆48Jul 5, 2024Updated last year
- PaperHelper: Knowledge-Based LLM QA Paper Reading Assistant with Reliable References☆21Jun 13, 2024Updated last year
- CogNetX is an advanced, multimodal neural network architecture inspired by human cognition. It integrates speech, vision, and video proce…☆20Mar 9, 2026Updated last week
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆15Oct 16, 2023Updated 2 years ago
- Biomedical Entity Linking Benchmark☆13Dec 10, 2024Updated last year
- String Distances in rust☆14Nov 21, 2022Updated 3 years ago
- Official Repository of "GraphTeam: Facilitating Large Language Model-based Graph Analysis via Multi-Agent Collaboration".☆44Mar 28, 2025Updated 11 months ago
- (CVPR 2023) Official implemention of the paper "Weakly Supervised Video Representation Learning with Unaligned Text for Sequential Videos…☆31Apr 2, 2024Updated last year