swiss-ai / mmore
Massive Multimodal Open RAG & Extraction A scalable multimodal pipeline for processing, indexing, and querying multimodal documents Ever needed to take 8000 PDFs, 2000 videos, and 500 spreadsheets and feed them to an LLM as a knowledge base? Well, MMORE is here to help you!
☆36Updated last week
Alternatives and similar repositories for mmore:
Users that are interested in mmore are comparing it to the libraries listed below
- Evaluate your LLM's response with Prometheus and GPT4 💯☆908Updated last month
- Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜☆1,407Updated 3 weeks ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,414Updated this week
- List of papers on hallucination detection in LLMs.☆839Updated last week
- ☆633Updated 4 months ago
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆1,136Updated 3 months ago
- The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.☆1,721Updated this week
- Bringing BERT into modernity via both architecture changes and scaling☆1,322Updated 3 weeks ago
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆771Updated 2 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,384Updated 2 weeks ago
- A reading list on LLM based Synthetic Data Generation 🔥☆1,238Updated 2 months ago
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆420Updated last year
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,629Updated this week
- 📝 Automatically annotate papers using LLMs☆316Updated 4 months ago
- ☆1,116Updated 10 months ago
- Synthetic data curation for post-training and structured data extraction☆1,230Updated this week
- Code for explaining and evaluating late chunking (chunked pooling)☆369Updated 3 months ago
- Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy☆1,112Updated this week
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.☆766Updated last month
- Stanford NLP Python library for Representation Finetuning (ReFT)☆1,455Updated 2 months ago
- Toolkit for attaching, training, saving and loading of new heads for transformer models☆273Updated last month
- An Open Source Toolkit For LLM Distillation☆574Updated 3 months ago
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆110Updated last week
- ☆512Updated 5 months ago
- Large Concept Models: Language modeling in a sentence representation space☆2,095Updated 2 months ago
- SONAR, a new multilingual and multimodal fixed-size sentence embedding space, with a full suite of speech and text encoders and decoders.☆731Updated 2 weeks ago
- Automatically evaluate your LLMs in Google Colab☆614Updated 11 months ago
- Official implementation of QATCH: Benchmarking SQL-centric tasks with Table Representation Learning Models on Your Data☆28Updated 2 weeks ago
- awesome synthetic (text) datasets☆272Updated 5 months ago
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆354Updated 7 months ago