stephenleo / llm-structured-output-benchmarks
Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on tasks like multi-label classification, named entity recognition, synthetic data generation, etc.
☆153Updated 5 months ago
Alternatives and similar repositories for llm-structured-output-benchmarks:
Users that are interested in llm-structured-output-benchmarks are comparing it to the libraries listed below
- awesome synthetic (text) datasets☆263Updated 4 months ago
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆144Updated 10 months ago
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆102Updated 10 months ago
- LLM-driven automated knowledge graph construction from text using DSPy and Neo4j.☆169Updated 11 months ago
- ☆210Updated 3 months ago
- ☆118Updated last week
- Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.☆166Updated 10 months ago
- ☆142Updated 7 months ago
- A Python library to chunk/group your texts based on semantic similarity.☆93Updated 7 months ago
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆252Updated 2 weeks ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆102Updated 2 months ago
- Tutorial for building LLM router☆185Updated 7 months ago
- Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDB☆118Updated last year
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆260Updated 2 months ago
- This package, developed as part of our research detailed in the Chroma Technical Report, provides tools for text chunking and evaluation.…☆253Updated 5 months ago
- Code for explaining and evaluating late chunking (chunked pooling)☆333Updated 2 months ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆83Updated 3 weeks ago
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆94Updated 2 months ago
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆122Updated 4 months ago
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆407Updated last year
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆107Updated 3 weeks ago
- Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.☆179Updated last week
- Ready-to-go containerized RAG service. Implemented with text-embedding-inference + Qdrant/LanceDB.☆58Updated 2 months ago
- 🦜💯 Flex those feathers!☆239Updated 4 months ago
- ☆263Updated 8 months ago
- Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)☆262Updated 11 months ago
- Official code of the paper "SimGRAG: Leveraging Similar Subgraphs for Knowledge Graphs Driven Retrieval-Augmented Generation"☆99Updated 2 months ago
- Domain Adapted Language Modeling Toolkit - E2E RAG☆314Updated 3 months ago
- This repository implements the chain of verification paper by Meta AI☆163Updated last year
- 🔧 Compare how Agent systems perform on several benchmarks. 📊🚀☆81Updated 4 months ago