mesolitica / multimodal-LLMLinks
Multi-Modal Language Modeling with Image, Audio and Text Integration, included multi-images and multi-audio in a single multiturn.
☆18Updated last year
Alternatives and similar repositories for multimodal-LLM
Users that are interested in multimodal-LLM are comparing it to the libraries listed below
Sorting:
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Updated last year
- Code for NeurIPS LLM Efficiency Challenge☆60Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆72Updated last year
- Fast approximate inference on a single GPU with sparsity aware offloading☆39Updated 2 years ago
- Improving Text Embedding of Language Models Using Contrastive Fine-tuning☆64Updated last year
- Simple GRPO scripts and configurations.☆59Updated 11 months ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆75Updated last year
- ☆86Updated last year
- ☆55Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- ☆53Updated 11 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆61Updated last year
- ☆39Updated last year
- QLoRA with Enhanced Multi GPU Support☆37Updated 2 years ago
- (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…☆84Updated 5 months ago
- Codebase accompanying the Summary of a Haystack paper.☆80Updated last year
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆45Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆112Updated last year
- ☆54Updated 2 weeks ago
- Merge LLM that are split in to parts☆27Updated 6 months ago
- Universal text classifier for generative models☆24Updated last year
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…☆28Updated last year
- 🐜🔧 A minimalistic tool to fine-tune your LLMs☆18Updated 2 years ago
- ☆50Updated last year
- Entailment self-training☆26Updated 2 years ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆70Updated 2 years ago
- 🚀 Automatically convert unstructured data into a high-quality 'textbook' format, optimized for fine-tuning Large Language Models (LLMs)☆25Updated 2 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆35Updated 2 years ago
- Collection of autoregressive model implementation☆85Updated 2 weeks ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆23Updated last year