Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.
☆71Aug 8, 2025Updated 6 months ago
Alternatives and similar repositories for lmms-eval
Users that are interested in lmms-eval are comparing it to the libraries listed below
Sorting:
- ☆18Jul 10, 2024Updated last year
- ☆78Sep 25, 2025Updated 5 months ago
- [Findings of ACL 2023] Communication Efficient Federated Learning for Multilingual Machine Translation with Adapter☆12Sep 4, 2023Updated 2 years ago
- Code and data for Distributional Correlation–Aware Knowledge Distillation for Stock Trading Volume Prediction (ECML-PKDD 22)☆15Sep 6, 2022Updated 3 years ago
- For audio visualization and playback in Jupyter notebooks.☆17Nov 25, 2025Updated 3 months ago
- Vision Large Language Models trained on M3IT instruction tuning dataset☆17Aug 16, 2023Updated 2 years ago
- The official implementation of "ICDPO: Effectively Borrowing Alignment Capability of Others via In-context Direct Preference Optimization…☆16Feb 15, 2024Updated 2 years ago
- Extending context length of visual language models☆12Dec 18, 2024Updated last year
- Code for CascadeBERT, Findings of EMNLP 2021☆12Mar 30, 2022Updated 3 years ago
- ☆40Dec 19, 2025Updated 2 months ago
- [NeurIPS 2024] Search for Efficient LLMs☆16Jan 16, 2025Updated last year
- ☆21Jul 9, 2025Updated 7 months ago
- [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models☆19Mar 16, 2023Updated 2 years ago
- Visual and Embodied Concepts evaluation benchmark☆21Oct 10, 2023Updated 2 years ago
- ☆28Aug 13, 2025Updated 6 months ago
- ☆21Jan 17, 2025Updated last year
- Step-Realtime-Console☆67Dec 15, 2025Updated 2 months ago
- Google Scholar自搜小脚本，每次开启命令行即显示当前citation。Small Script displaying current citation count each time the shell is opened.☆22Mar 3, 2025Updated last year
- ☆56Nov 12, 2025Updated 3 months ago
- ☆25Feb 27, 2023Updated 3 years ago
- Code for NAACL2022 Long Paper "An Enhanced Span-based Decomposition Method for Few-Shot Sequence Labeling"☆28Nov 9, 2022Updated 3 years ago
- MiMo-VL☆628Aug 21, 2025Updated 6 months ago
- In-car multi-channel speech transcription system of AISHELL-5.☆41Jun 9, 2025Updated 8 months ago
- my commonly-used tools☆64Jan 7, 2025Updated last year
- [NeurIPS 2023 Datasets and Benchmarks] "FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generation", Yuanxin L…☆57Mar 4, 2024Updated 2 years ago
- ☆48Dec 13, 2025Updated 2 months ago
- The framework of training large language models，support lora, full parameters fine tune etc, define yaml to start training/fine tune of y…☆31Sep 19, 2024Updated last year
- Group Meeting Record for Baobao Chang Group in Peking University☆26May 17, 2021Updated 4 years ago
- ☆39Aug 4, 2025Updated 7 months ago
- ☆32Nov 15, 2022Updated 3 years ago
- Machine translation experiments for WMT18 en-zh track☆32Apr 27, 2021Updated 4 years ago
- [ACL 2021] Learning Relation Alignment for Calibrated Cross-modal Retrieval☆34May 16, 2023Updated 2 years ago
- A single-layer, streaming codec model providing SOTA audio quality and discrete tokens designed for superior downstream modelability.☆113Jun 4, 2025Updated 9 months ago
- ☆111Jun 15, 2025Updated 8 months ago
- A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.☆134Sep 19, 2025Updated 5 months ago
- Methods and evaluation for aligning language models temporally☆30Mar 2, 2024Updated 2 years ago
- A collection of awesome think with videos papers.☆90Dec 1, 2025Updated 3 months ago
- LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.☆39Jun 20, 2024Updated last year
- TASU: A New Style of Alignment of Speech LLM with only Text Training Data, zero-shot on ASR and Other SU tasks☆22Jan 19, 2026Updated last month