Code release for "LLMs can see and hear without any training"
☆459May 8, 2025Updated last year
Alternatives and similar repositories for MILS
Users that are interested in MILS are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GitHub repository for AudioToolAgent☆21Feb 13, 2026Updated 7 months ago
- ☆197May 5, 2025Updated last year
- [ACL 2025 🔥] Rethinking Step-by-step Visual Reasoning in LLMs☆307May 21, 2025Updated last year
- ☆13Jul 10, 2024Updated 2 years ago
- High-Performance Implementation of OpenAI's TikToken.☆476Jul 3, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- (Accepted by IJCV) Liquid: Language Models are Scalable and Unified Multi-modal Generators☆640Jun 1, 2026Updated 3 months ago
- [ICLR 2026] TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching☆886Jan 28, 2026Updated 7 months ago
- Fully neural approach for text chunking☆421Oct 23, 2025Updated 10 months ago
- Calibrating LLM Confidence by Probing Perturbed Representation Stability☆19Jul 5, 2025Updated last year
- A browser-based, WebGL2 implementation of GPT-2 with transform block and attention matrix visualization☆348Oct 24, 2025Updated 10 months ago
- Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.☆361Oct 22, 2024Updated last year
- Rewriting Principia Mathematica in Lean☆141Feb 5, 2026Updated 7 months ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM", IJCV2025☆281May 26, 2025Updated last year
- \infty-Video: A Training-Free Approach to Long Video Understanding via Continuous-Time Memory Consolidation☆22Feb 14, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Qwen3-omni is a natively end-to-end, omni-modal LLM developed by the Qwen team at Alibaba Cloud, capable of understanding text, audio, im…☆4,019Apr 23, 2026Updated 4 months ago
- ☆14Jan 22, 2025Updated last year
- LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…☆3,148May 19, 2025Updated last year
- ☆16Jun 23, 2026Updated 2 months ago
- ☆285Mar 6, 2025Updated last year
- Next-Token Prediction is All You Need☆2,447Jan 12, 2026Updated 8 months ago
- Everything about the SmolLM and SmolVLM family of models☆3,899Updated this week
- Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audi…☆11,113Sep 9, 2026Updated last week
- Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI☆1,402Sep 4, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Janus-Series: Unified Multimodal Understanding and Generation Models☆17,766Feb 1, 2025Updated last year
- An unified model that seamlessly integrates multimodal understanding, text-to-image generation, and image editing within a single powerfu…☆454Dec 2, 2025Updated 9 months ago
- Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models☆206May 29, 2024Updated 2 years ago
- Open-source watermark segmentation by DiffusionDynamics.ai and clear.photo. Harness deep learning plus synthetic data augmentation in PyT…☆79Apr 24, 2025Updated last year
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025) (Oral)☆36Feb 11, 2026Updated 7 months ago
- Transductive regular expressions☆258Sep 4, 2026Updated 2 weeks ago
- [CVPR 2025] Magma: A Foundation Model for Multimodal AI Agents☆1,942Mar 3, 2026Updated 6 months ago
- Plugin Marketplace for Claude Code☆19Feb 8, 2026Updated 7 months ago
- [CVPR24] Official Implementation of GEM (Grounding Everything Module)☆140Apr 10, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official repository for our work on micro-budget training of large-scale diffusion models.☆1,595Jan 12, 2025Updated last year
- Things you can do with the token embeddings of an LLM☆1,450Dec 1, 2025Updated 9 months ago
- code for "TVG: A Training-free Transition Video Generation Method with Diffusion Models"☆50Aug 19, 2024Updated 2 years ago
- Implement recursion using English as the programming language and an LLM as the runtime.☆243Apr 3, 2023Updated 3 years ago
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,967Aug 15, 2024Updated 2 years ago
- Codebase for Aria - an Open Multimodal Native MoE☆1,088Jan 22, 2025Updated last year
- [WACV 2024] Customizing 360-Degree Panoramas through Text-to-Image Diffusion Models☆44Dec 23, 2024Updated last year