mesolitica / multimodal-LLMLinks
Multi-Modal Language Modeling with Image, Audio and Text Integration, included multi-images and multi-audio in a single multiturn.
☆18Updated last year
Alternatives and similar repositories for multimodal-LLM
Users that are interested in multimodal-LLM are comparing it to the libraries listed below
Sorting:
- Code for NeurIPS LLM Efficiency Challenge☆59Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- ☆49Updated 5 months ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆75Updated 9 months ago
- Simple GRPO scripts and configurations.☆59Updated 6 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated last year
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆62Updated 2 months ago
- ☆47Updated 10 months ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- Improving Text Embedding of Language Models Using Contrastive Fine-tuning☆64Updated last year
- Measuring and Controlling Persona Drift in Language Model Dialogs☆17Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆65Updated last year
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆43Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated 3 months ago
- Explore the use of DSPy for extracting features from PDFs 🔎☆45Updated last year
- Exploring limitations of LLM-as-a-judge☆19Updated 11 months ago
- ☆53Updated 9 months ago
- minimal scripts for 24GB VRAM GPUs. training, inference, whatever☆41Updated last month
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated 11 months ago
- Tools for merging pretrained large language models.☆19Updated last year
- QLoRA with Enhanced Multi GPU Support☆37Updated 2 years ago
- ☆67Updated last year
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 6 months ago
- ☆29Updated last week
- EMNLP 2024 "Re-reading improves reasoning in large language models". Simply repeating the question to get bidirectional understanding for…☆26Updated 7 months ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆24Updated 2 weeks ago
- Codebase accompanying the Summary of a Haystack paper.☆79Updated 10 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- ☆48Updated 11 months ago
- Collection of autoregressive model implementation☆86Updated 3 months ago