A method for multi-reference image-grounded video captioning.
☆20Aug 1, 2026Updated 2 months ago
Alternatives and similar repositories for RefCaptioner
Users that are interested in RefCaptioner are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A unified audio-video variational autoencoder with cross-modal alignment for joint reconstruction and generation☆91Updated this week
- OmniAgent (ICML 2026): the first native omni-modal agent for active video perception — a 7B agent that beats Qwen2.5-VL-72B with 73% fewe…☆78Sep 18, 2026Updated last month
- ☆15Jun 2, 2025Updated last year
- VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation. To our knowledge, it's the first reward model…☆69Oct 7, 2026Updated last week
- ☆17Jun 9, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ConversationalVoice: Full-Duplex Speech Data from Real Conversations☆70Sep 18, 2026Updated last month
- Prompt tune geometry reconstruction models for long-sequence.☆71Sep 4, 2026Updated last month
- Reconstructing Big Tech T2I/T2V captioning pipelines for production and research☆45Aug 5, 2026Updated 2 months ago
- ☆153Apr 8, 2026Updated 6 months ago
- This repository provides the official PyTorch implementation of "SpotSound: Enhancing Large Audio-Language Models with Fine-Grained Tempo…☆32Aug 7, 2026Updated 2 months ago
- A fully local, cross-platform audio visualizer editor. Create reactive music videos with layered graphics, AI-transcribed lyrics, and fra…☆16Sep 19, 2026Updated 3 weeks ago
- Project page for ScenA: Reference-Driven Multi-Speaker Audio Scene Generation from In-the-Wild Priors☆45Jul 26, 2026Updated 2 months ago
- ☆30Updated this week
- Official implementation for paper "Fourier is Frontier: Frequency-Aware Autoencoding for High-Fidelity Music Reconstruction". We treat is…☆80Sep 1, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ICML 2026] Trust3R: Trustworthy feed-forward 3D reconstruction with evidential uncertainty.☆30Aug 7, 2026Updated 2 months ago
- Official code release for TRACE: Ergodic Trajectory Optimization for Active Scene Reconstruction.☆28Aug 6, 2026Updated 2 months ago
- AWSM — Agentic World Simulation and Mapping. Turning visual observations into geometry-grounded, editable 3D worlds simulation-ready for …☆59Oct 3, 2026Updated 2 weeks ago
- official repo for RIGOR: Rig-Informed Geometry for Omnidirectional Reconstruction☆19Oct 9, 2026Updated last week
- [SIGGRAPH 2026] GR3EN: Generative Relighting for 3D Environments☆35Jul 27, 2026Updated 2 months ago
- NCM: Next Concept Modeling☆127Updated this week
- VidaForge: Open Research Infrastructure for Video Pretraining Data Recipes☆102Sep 26, 2026Updated 3 weeks ago
- ☆109Aug 30, 2026Updated last month
- Official Code release for the SIGGRAPH 2026 paper "A LoD of Gaussians: Out-of-Core Training and Rendering for Seamless Ultra-Large Scene …☆79Jul 3, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ECCV 26] One Video, One World: Turning Monocular Video into Physical 4D Scenes☆27Aug 22, 2026Updated last month
- Audio-Oscar is a multi-agent framework for generating long-form, controllable audio from complex audio scene descriptions.☆70Jun 8, 2026Updated 4 months ago
- ☆13Aug 28, 2022Updated 4 years ago
- ☆34Oct 2, 2026Updated 2 weeks ago
- WorldRecon: Generative Multi-View Mesh Reconstruction for Large-Scale 3D World☆43Updated this week
- Frame-Synchronous Dual-Head Modeling for Joint Streaming ASR and Turn State Prediction☆99Oct 9, 2026Updated last week
- ☆193Sep 23, 2026Updated 3 weeks ago
- ☆43Sep 28, 2026Updated 2 weeks ago
- CuteTTS: a lightweight continuous autoregressive TTS model that runs efficiently on GPUs, CPUs, and Apple silicon.☆83Aug 25, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- OREN: Octree Residual Network for Real-Time Euclidean Signed Distance Mapping☆41Jul 8, 2026Updated 3 months ago
- ☆12Jul 15, 2021Updated 5 years ago
- [ECCV 2026] Dynamic Sparse Attention for Feed-Forward 3D Reconstruction Transformers☆33Jul 7, 2026Updated 3 months ago
- [ICML'26] Toward Human-like Audio-Visual Intelligence of Omni-MLLMs☆18Oct 4, 2026Updated 2 weeks ago
- [ECCV'26] Map-Det3D: Metric Feed-Forward 3D Reconstruction Prior for Multi-view 3D Object Detection from Streaming Inputs☆54Sep 29, 2026Updated 2 weeks ago
- LEMAS‑Edit is a multilingual speech editing system, supporting 10 languages: Chinese English Spanish Russian French German Italian Portug…☆22Mar 31, 2026Updated 6 months ago
- Sekai2: From World Exploration to Interactive World Modeling☆74Sep 9, 2026Updated last month