mesolitica / multimodal-LLM
Multi-Modal Language Modeling with Image, Audio and Text Integration, included multi-images and multi-audio in a single multiturn.
☆17Updated 11 months ago
Alternatives and similar repositories for multimodal-LLM:
Users that are interested in multimodal-LLM are comparing it to the libraries listed below
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 10 months ago
- ☆31Updated 7 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆48Updated 6 months ago
- Tools for merging pretrained large language models.☆19Updated 7 months ago
- Measuring and Controlling Persona Drift in Language Model Dialogs☆15Updated 11 months ago
- Code for NeurIPS LLM Efficiency Challenge☆54Updated 9 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆53Updated 5 months ago
- ☆24Updated last year
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆74Updated 3 months ago
- ☆14Updated 3 months ago
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- ☆48Updated 2 months ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆40Updated 10 months ago
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆23Updated 2 months ago
- Visual RAG using less than 300 lines of code.☆24Updated 10 months ago
- MEXMA: Token-level objectives improve sentence representations☆37Updated 3 weeks ago
- Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya☆101Updated this week
- Collection of autoregressive model implementation☆77Updated 3 weeks ago
- Goldfish: Monolingual language models for 350 languages.☆13Updated 5 months ago
- ☆60Updated 3 months ago
- QLoRA for Masked Language Modeling☆21Updated last year
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated 10 months ago
- Improving Text Embedding of Language Models Using Contrastive Fine-tuning☆59Updated 5 months ago
- Code and pretrained models for the paper: "MatMamba: A Matryoshka State Space Model"☆56Updated 2 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆61Updated 2 weeks ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆34Updated last month
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆14Updated last year
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- Merge LLM that are split in to parts☆25Updated last year