Code release for "LLMs can see and hear without any training"
☆460May 8, 2025Updated last year
Alternatives and similar repositories for MILS
Users that are interested in MILS are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GitHub repository for AudioToolAgent☆21Feb 13, 2026Updated 6 months ago
- ☆197May 5, 2025Updated last year
- [ACL 2025 🔥] Rethinking Step-by-step Visual Reasoning in LLMs☆307May 21, 2025Updated last year
- A Simple Scenes Based Movie Generation App☆52Nov 8, 2024Updated last year
- ☆13Jul 10, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- High-Performance Implementation of OpenAI's TikToken.☆475Jul 3, 2025Updated last year
- (Accepted by IJCV) Liquid: Language Models are Scalable and Unified Multi-modal Generators☆640Jun 1, 2026Updated 2 months ago
- Fully neural approach for text chunking☆420Oct 23, 2025Updated 10 months ago
- [ICLR 2026] TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching☆882Jan 28, 2026Updated 7 months ago
- Curated collection of the latest open-source AI agent projects—Weekly updated!☆92Apr 8, 2025Updated last year
- A browser-based, WebGL2 implementation of GPT-2 with transform block and attention matrix visualization☆348Oct 24, 2025Updated 10 months ago
- Calibrating LLM Confidence by Probing Perturbed Representation Stability☆19Jul 5, 2025Updated last year
- Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.☆361Oct 22, 2024Updated last year
- Rewriting Principia Mathematica in Lean☆141Feb 5, 2026Updated 6 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM", IJCV2025☆279May 26, 2025Updated last year
- \infty-Video: A Training-Free Approach to Long Video Understanding via Continuous-Time Memory Consolidation☆22Feb 14, 2025Updated last year
- Make your LLM agent and chat with it simple and fast!☆74Nov 22, 2025Updated 9 months ago
- Qwen3-omni is a natively end-to-end, omni-modal LLM developed by the Qwen team at Alibaba Cloud, capable of understanding text, audio, im…☆3,988Apr 23, 2026Updated 4 months ago
- ☆14Jan 22, 2025Updated last year
- LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve spee…☆3,146May 19, 2025Updated last year
- ☆16Jun 23, 2026Updated 2 months ago
- Next-Token Prediction is All You Need☆2,442Jan 12, 2026Updated 7 months ago
- ☆283Mar 6, 2025Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Everything about the SmolLM and SmolVLM family of models☆3,887May 26, 2026Updated 3 months ago
- Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audi…☆10,979May 16, 2026Updated 3 months ago
- Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI☆1,395Updated this week
- 🍃 MINT-1T: A one trillion token multimodal interleaved dataset.☆832Jul 31, 2024Updated 2 years ago
- Janus-Series: Unified Multimodal Understanding and Generation Models☆17,761Feb 1, 2025Updated last year
- An unified model that seamlessly integrates multimodal understanding, text-to-image generation, and image editing within a single powerfu…☆452Dec 2, 2025Updated 8 months ago
- Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models☆206May 29, 2024Updated 2 years ago
- Open-source watermark segmentation by DiffusionDynamics.ai and clear.photo. Harness deep learning plus synthetic data augmentation in PyT…☆78Apr 24, 2025Updated last year
- An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspace☆19Oct 21, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression (ICASSP 2025) (Oral)☆35Feb 11, 2026Updated 6 months ago
- 🔥ICLR 2025 (Spotlight) One-Prompt-One-Story: Free-Lunch Consistent Text-to-Image Generation Using a Single Prompt☆321Oct 20, 2025Updated 10 months ago
- [CVPR 2025] Magma: A Foundation Model for Multimodal AI Agents☆1,939Mar 3, 2026Updated 5 months ago
- Plugin Marketplace for Claude Code☆19Feb 8, 2026Updated 6 months ago
- Official repository for our work on micro-budget training of large-scale diffusion models.☆1,594Jan 12, 2025Updated last year
- Things you can do with the token embeddings of an LLM☆1,451Dec 1, 2025Updated 8 months ago
- code for "TVG: A Training-free Transition Video Generation Method with Diffusion Models"☆50Aug 19, 2024Updated 2 years ago