Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"
β26Jan 27, 2025Updated last year
Alternatives and similar repositories for Mirasol
Users that are interested in Mirasol are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of π» Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorchβ92Dec 22, 2023Updated 2 years ago
- β20Apr 26, 2024Updated 2 years ago
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant β¦β15Mar 11, 2024Updated 2 years ago
- β36Jul 9, 2025Updated last year
- Implementation of "PaLM2-VAdapter:" from the multi-modal model paper: "PaLM2-VAdapter: Progressively Aligned Language Model Makes a Stronβ¦β17Nov 11, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform β’ AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This is a [forked version] for author's debugging. Please jump to https://github.com/QualityAssessment/DOVER for stable version to use.β14Oct 29, 2023Updated 3 years ago
- [CVPR2025] The repository of SAM2-LOVE paperβ12Jun 6, 2025Updated last year
- β24Sep 24, 2023Updated 3 years ago
- [ECCVβ24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenarioβ¦β59Sep 4, 2024Updated 2 years ago
- β13Oct 18, 2022Updated 4 years ago
- β29May 13, 2025Updated last year
- Implementation of the premier Text to Video model from OpenAIβ56Nov 11, 2024Updated last year
- β33Sep 27, 2024Updated 2 years ago
- A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)β58Apr 17, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Talking Head from Speech Audio using a Pre-trained Image Generatorβ22May 7, 2024Updated 2 years ago
- An example project demonstrating one approach to GraphRAGβ14Sep 13, 2024Updated 2 years ago
- A simplified version of MPNβ13May 21, 2021Updated 5 years ago
- νκ΅μ΄ μλ£ λΆμΌ νΉν μ±λ΄ νλ‘μ νΈβ32Nov 20, 2023Updated 2 years ago
- [ICML 2025] Diff-MoE: Diffusion Transformer with Time-Aware and Space-Adaptive Expertsβ36Nov 10, 2025Updated 11 months ago
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPOβ32Oct 26, 2026Updated last week
- Implementation of Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching (NeurIPS'24)β63Apr 3, 2025Updated last year
- β10Jun 11, 2019Updated 7 years ago
- Official repository supporting the L3DAS23 IEEE ICASSP Grand Challengeβ18Feb 10, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- MTalk-Bench: Evaluating Speech-to-Speech Models in Multi-Turn Dialogues via Arena-style and Rubrics Protocolsβ20Nov 19, 2025Updated 11 months ago
- Analysis of video quality datasets via design of minimalistic video quality modelsβ24Jul 15, 2024Updated 2 years ago
- β12Jul 30, 2025Updated last year
- [NeurIPS'25] Sequence Modeling with Spectral Mean Flows, in PyTorchβ12Oct 20, 2025Updated last year
- OmniInteract: Benchmarking Real-World Streaming Interaction for Real-Time Omnimodal Assistantsβ24May 30, 2026Updated 5 months ago
- GUI-AIMA: Aligning Intrinsic Multimodal Attention with a Context Anchor for GUI Groundingβ12May 27, 2026Updated 5 months ago
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Modelsβ35Jun 12, 2024Updated 2 years ago
- Repo for "STAR: Spectral Truncation and Rescale for Model Merging" [NAACL 2025]β11Oct 22, 2026Updated 2 weeks ago
- [TIP2024] The code of βDeep Boosting Learning: A Brand-new Cooperative Approach for Image-Text Matchingββ13Jun 12, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer β’ AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Official Codebase of "A Unified Audio-Visual Learning Framework for Localization, Separation, and Recognition" (ICML 2023)β12Jun 1, 2023Updated 3 years ago
- Spectral Graph Attention Network with Fast Eigen-approximationβ11Dec 24, 2021Updated 4 years ago
- Code for the paper "Computational Language Acquisition with Theory of Mind" (ICLR 2023).β15Apr 27, 2023Updated 3 years ago
- Risky Object Localization (ROL) in a Driving Scene Datasetβ15Dec 24, 2023Updated 2 years ago
- β11Apr 5, 2023Updated 3 years ago
- An open source community implementation of the model from the paper: "Movie Gen: A Cast of Media Foundation Models". Join our community β¦β61Updated this week
- [AAAI 2023] Official implementation of FiTs: Fine-grained Two-stage Training for Knowledge Base Question Answeringβ11Mar 10, 2023Updated 3 years ago