mesolitica / multimodal-LLM
Multi-Modal Language Modeling with Image, Audio and Text Integration, included multi-images and multi-audio in a single multiturn.
☆13Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for multimodal-LLM
- DPO, but faster 🚀☆21Updated 2 weeks ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 8 months ago
- ☆26Updated 4 months ago
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆24Updated 2 weeks ago
- ☆21Updated last week
- ☆57Updated last month
- SCREWS: A Modular Framework for Reasoning with Revisions☆26Updated last year
- Code for NeurIPS LLM Efficiency Challenge☆53Updated 7 months ago
- QLoRA for Masked Language Modeling☆20Updated last year
- Using multiple LLMs for ensemble Forecasting☆16Updated 9 months ago
- ☆40Updated last week
- Collection of autoregressive model implementation☆66Updated last week
- Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding☆37Updated 3 weeks ago
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated last year
- Implementation of the Mamba SSM with hf_integration.☆55Updated 2 months ago
- ☆33Updated 6 months ago
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Updated 10 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆46Updated 2 months ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆36Updated 7 months ago
- A list of language models with permissive licenses such as MIT or Apache 2.0☆22Updated last week
- Official repository for RAGVIZ: Diagnose and Visualize Retrieval-Augmented Generation☆21Updated this week
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆22Updated 8 months ago
- ☆24Updated last year
- ☆35Updated last year
- Index of URLs to pdf files all over the internet and scripts☆21Updated last year
- ☆20Updated 9 months ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- Tools for merging pretrained large language models.☆19Updated 5 months ago
- Finetune any model on HF in less than 30 seconds☆56Updated last week
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year