stephenleo / llm-structured-output-benchmarksLinks
Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on tasks like multi-label classification, named entity recognition, synthetic data generation, etc.
☆181Updated last year
Alternatives and similar repositories for llm-structured-output-benchmarks
Users that are interested in llm-structured-output-benchmarks are comparing it to the libraries listed below
Sorting:
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆114Updated last year
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆446Updated last year
- ☆148Updated last year
- Generalist and Lightweight Model for Text Classification☆167Updated 3 weeks ago
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆148Updated last year
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆125Updated 2 months ago
- ☆242Updated 6 months ago
- LLM-driven automated knowledge graph construction from text using DSPy and Neo4j.☆198Updated last year
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆51Updated last year
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆90Updated 3 months ago
- awesome synthetic (text) datasets☆315Updated last month
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆350Updated 6 months ago
- Domain Adapted Language Modeling Toolkit - E2E RAG☆334Updated last year
- Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.☆166Updated last year
- Simple UI for debugging correlations of text embeddings☆306Updated 7 months ago
- A Lightweight Library for AI Observability☆253Updated 10 months ago
- ☆125Updated 10 months ago
- This repository implements the chain of verification paper by Meta AI☆182Updated 2 years ago
- A Python library to chunk/group your texts based on semantic similarity.☆101Updated last year
- Initiative to evaluate and rank the most popular LLMs across common task types based on their propensity to hallucinate.☆116Updated 5 months ago
- Mistral + Haystack: build RAG pipelines that rock 🤘☆106Updated last year
- Automated knowledge graph creation SDK☆122Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 8 months ago
- ☆210Updated 6 months ago
- Tutorial for building LLM router☆240Updated last year
- ☆81Updated last month
- Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.☆255Updated 4 months ago
- 📚 Datasets and models for instruction-tuning☆238Updated 2 years ago
- Banishing LLM Hallucinations Requires Rethinking Generalization☆276Updated last year
- Notebooks for training universal 0-shot classifiers on many different tasks☆137Updated last year