Code release for "LLMs can see and hear without any training"
☆459May 8, 2025Updated last year
Alternatives and similar repositories for MILS
Users that are interested in MILS are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-Performance Implementation of OpenAI's TikToken.☆474Jul 3, 2025Updated last year
- GitHub repository for AudioToolAgent☆22Feb 13, 2026Updated 8 months ago
- Accompany repo for the PromptQuine paper (ICML 2025).☆16Jan 27, 2026Updated 9 months ago
- A browser-based, WebGL2 implementation of GPT-2 with transform block and attention matrix visualization☆348Oct 24, 2025Updated last year
- ☆13Jul 10, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ICLR 2026] TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching☆885Jan 28, 2026Updated 9 months ago
- Exploring Zep & Knowledge Graphs with Open-Source models as an alternative to OpenAI's Assistant Threads☆20Dec 14, 2024Updated last year
- [CVPR 2025] Magma: A Foundation Model for Multimodal AI Agents☆1,950Mar 3, 2026Updated 7 months ago
- (Accepted by IJCV) Liquid: Language Models are Scalable and Unified Multi-modal Generators☆639Jun 1, 2026Updated 4 months ago
- [ACL 2025 🔥] Rethinking Step-by-step Visual Reasoning in LLMs☆307May 21, 2025Updated last year
- Calibrating LLM Confidence by Probing Perturbed Representation Stability☆19Jul 5, 2025Updated last year
- Code for the paper "Adapt - $\infty$: Scalable Lifelong Multimodal Instruction Tuning"☆10Oct 15, 2024Updated 2 years ago
- [CVPR24] Official Implementation of GEM (Grounding Everything Module)☆141Apr 10, 2025Updated last year
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆127Apr 21, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Next-Token Prediction is All You Need☆2,452Jan 12, 2026Updated 9 months ago
- Balancing Gradient Flow for Universally Better Vision Transformer Attributions☆13Nov 27, 2024Updated last year
- LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…☆3,144May 19, 2025Updated last year
- 4M: Massively Multimodal Masked Modeling☆1,818Sep 11, 2026Updated last month
- This is the repo for Sound-VECaps☆12Jul 8, 2024Updated 2 years ago
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,973Aug 15, 2024Updated 2 years ago
- [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆329Jul 4, 2025Updated last year
- ☆16Jul 16, 2024Updated 2 years ago
- Official PyTorch implementation of TokenSet.☆128Mar 21, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI☆1,409Sep 4, 2026Updated last month
- Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.☆361Oct 22, 2024Updated 2 years ago
- \infty-Video: A Training-Free Approach to Long Video Understanding via Continuous-Time Memory Consolidation☆22Feb 14, 2025Updated last year
- ☆288Mar 6, 2025Updated last year
- [arXiv] On-device Sora: Enabling Diffusion-Based Text-to-Video Generation for Mobile Devices☆140Nov 27, 2025Updated 11 months ago
- Official implementation of the paper The Hidden Language of Diffusion Models☆79Jan 24, 2024Updated 2 years ago
- Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models☆207May 29, 2024Updated 2 years ago
- Qwen3-omni is a natively end-to-end, omni-modal LLM developed by the Qwen team at Alibaba Cloud, capable of understanding text, audio, im…☆4,090Apr 23, 2026Updated 6 months ago
- ☆196May 5, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ACL 2025 Findings] Official pytorch implementation of "Don't Miss the Forest for the Trees: Attentional Vision Calibration for Large Vis…☆27Jul 21, 2024Updated 2 years ago
- [CVPR 2025] Aesthetic Post-Training Diffusion Models from Generic Preferences with Step-by-step Preference Optimization☆271Apr 7, 2025Updated last year
- 🍃 MINT-1T: A one trillion token multimodal interleaved dataset.☆833Jul 31, 2024Updated 2 years ago
- Janus-Series: Unified Multimodal Understanding and Generation Models☆17,765Feb 1, 2025Updated last year
- Everything about the SmolLM and SmolVLM family of models☆3,942Oct 6, 2026Updated 3 weeks ago
- Fully neural approach for text chunking☆421Oct 23, 2025Updated last year
- ☆24Nov 1, 2024Updated 2 years ago