Tencent / Freeze-OmniLinks
The official implement of Freeze-Omni.
☆13Updated 2 months ago
Alternatives and similar repositories for Freeze-Omni
Users that are interested in Freeze-Omni are comparing it to the libraries listed below
Sorting:
- ☆176Updated 7 months ago
- Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊☆269Updated 8 months ago
- ☆56Updated 3 months ago
- The official implement of VITA, VITA15, LongVITA, and VITA-Audio.☆34Updated 2 months ago
- LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …☆75Updated 3 months ago
- imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…☆37Updated last year
- SpeechAgents: Human-Communication Simulation with Multi-Modal Multi-Agent Systems☆84Updated last year
- LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.☆37Updated last year
- (NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Align…☆100Updated 2 weeks ago
- A collection of optimized utilities for text-to-audio processing, enhancing both training and inference workflows. This repository contai…☆39Updated 6 months ago
- 🤗 R1-AQA Model: mispeech/r1-aqa☆300Updated 6 months ago
- OpenS2S : Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model☆83Updated 2 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆119Updated 9 months ago
- ☆99Updated this week
- Keras implement of Finite Scalar Quantization☆83Updated last year
- flow mirror models from JZX AI Labs☆44Updated last year
- Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction☆211Updated 7 months ago
- The WorldRWKV project aims to implement training and inference across various modalities using the RWKV7 architecture. By leveraging diff…☆58Updated last week
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆348Updated 4 months ago
- XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.☆38Updated last year
- A Foundation Model for Industrial Signal Comprehensive Representation☆43Updated last month
- An easy-to-use, fast, and easily integrable tool for evaluating audio LLM☆149Updated 2 weeks ago
- ☆61Updated last week
- ☆111Updated last month
- A project for tri-modal LLM benchmarking and instruction tuning.☆48Updated 6 months ago
- MooER: Moore-threads Open Omni model for speech-to-speech intERaction. MooER-omni includes a series of end-to-end speech interaction mode…☆218Updated 8 months ago
- LUCY: Linguistic Understanding and Control Yielding Early Stage of Her☆55Updated 5 months ago
- ☆78Updated 5 months ago
- Code for ACL 2024 main conference paper "Can We Achieve High-quality Direct Speech-to-Speech Translation Without Parallel Speech Data?".☆25Updated last year
- video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is d…☆78Updated last week