OmniEvalKit is an evaluation framework designed for omni-modal large language models, with a focus on audio and audio-visual understanding. Based on OmniEvalKit, you can quickly reproduce benchmarks, implement your own models or datasets, and conduct fair comparisons with other open-source models. MiniCPM-o is evaluated using this framework.
☆14Mar 27, 2026Updated 7 months ago
Alternatives and similar repositories for OmniEvalKit
Users that are interested in OmniEvalKit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11Aug 19, 2024Updated 2 years ago
- [ICLR 2026] An official implementation of "STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligence"☆48Apr 19, 2026Updated 6 months ago
- Index of URLs to pdf files all over the internet and scripts☆25May 2, 2023Updated 3 years ago
- [CVPR2025] The repository of SAM2-LOVE paper☆12Jun 6, 2025Updated last year
- A bug-free and improved implementation of LLaVA-UHD, based on the code from the official repo☆35Aug 12, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Implementation of VinTAGe: Joint Video and Text Conditioning for Holistic Audio Generation (CVPR'25)☆14Jun 13, 2026Updated 4 months ago
- Efficient Personalized Speech Enhancement through Self-Supervised Learning☆24Mar 12, 2023Updated 3 years ago
- 清华大学第七届人工智能挑战赛电子系赛道（原电子系第 25 届队式程序设计大赛 teamstyle25）☆23Sep 7, 2026Updated 2 months ago
- ☆10Oct 20, 2021Updated 5 years ago
- to release the source code for reproducing the results reported in our paper: https://arxiv.org/abs/2409.17550☆14Nov 15, 2024Updated last year
- Data and code for ACL 2023 paper "RobuT: A Systematic Study of Table QA Robustness Against Human-Annotated Adversarial Perturbations"☆15Feb 8, 2024Updated 2 years ago
- Mini-Omni-Reasoner: a real-time speech reasoning framework that interleaves silent reasoning tokens with spoken response tokens (“thinkin…☆171Aug 26, 2025Updated last year
- ☆45Jan 13, 2025Updated last year
- Tools to convert sigsep mus dataset from STEMS <-> WAV☆12Jul 15, 2020Updated 6 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- LangGraph Multi-Agent Handoffs, Clearly Explained☆13Dec 12, 2025Updated 10 months ago
- Official implementation of "Video-Foley: Two-Stage Video-To-Sound Generation via Temporal Event Condition For Foley Sound". IEEE TASLP 20…☆19Feb 27, 2026Updated 8 months ago
- 🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)☆93Feb 13, 2025Updated last year
- Official implementation of "NaVLA$^2$: A Vision-Language-Audio-Action Model for Multimodal Instruction Navigation"☆13Mar 14, 2026Updated 7 months ago
- offical code for Dense-TSNet☆12Sep 17, 2024Updated 2 years ago
- A frontend UI for AceStep☆14Feb 25, 2026Updated 8 months ago
- Automatically generate class schedules for CUHZ(SZ) students.☆15Oct 18, 2023Updated 3 years ago
- Cardiovascular Disease Classification Employing Empirical Mode Decomposition (EMD) of Modified ECG☆11Oct 6, 2023Updated 3 years ago
- PyTorch implementation of TinyWASE described in our paper "Compressing Speaker Extraction Model with Ultra-low Precision Quantization and…☆11Jun 28, 2021Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- An open-source AI agent that brings the power of Gemini directly into your terminal.☆10Aug 11, 2025Updated last year
- MTalk-Bench: Evaluating Speech-to-Speech Models in Multi-Turn Dialogues via Arena-style and Rubrics Protocols☆20Nov 19, 2025Updated 11 months ago
- ☆12Jun 1, 2023Updated 3 years ago
- Dual fisheye video stitching in Python3, forked from : https://github.com/cynricfu/dual-fisheye-video-stitching☆13Dec 20, 2018Updated 7 years ago
- A minimal implementation of agent skills - a lightweight, open format for extending AI agents with specialized capabilities.☆11Dec 23, 2025Updated 10 months ago
- [CVPR 2025] The official implementation of the paper "Building a Mind Palace: Structuring Environment-Grounded Semantic Graphs for Effect…☆11Jun 9, 2025Updated last year
- Piano practice companion for Apple Vision Pro — practice tenderly, one section at a time.（Developing）☆11Oct 4, 2026Updated last month
- Ego4DSounds: A diverse egocentric dataset with high action-audio correspondence☆22Jun 14, 2024Updated 2 years ago
- OmniInteract: Benchmarking Real-World Streaming Interaction for Real-Time Omnimodal Assistants☆24May 30, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- STVQA and TextVQA OCR results from Amazon Text in Image pipeline☆12Jul 18, 2022Updated 4 years ago
- 2022 秋季学期清华大学电子系数据与算法课程 OJ 参考解答☆10Jun 18, 2023Updated 3 years ago
- Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"☆26Jan 27, 2025Updated last year
- The demo for "Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problem".☆12Oct 25, 2021Updated 5 years ago
- Machine Learning to automatically generate highlights from videogame streams☆13Aug 20, 2019Updated 7 years ago
- Official repository supporting the L3DAS23 IEEE ICASSP Grand Challenge☆18Feb 10, 2023Updated 3 years ago
- Solution to the Weather4cast 2021 Stage 1 challenge☆15Nov 8, 2021Updated 5 years ago
Are these results useful?