stephenleo / llm-structured-output-benchmarks
Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on tasks like multi-label classification, named entity recognition, synthetic data generation, etc.
☆160Updated 6 months ago
Alternatives and similar repositories for llm-structured-output-benchmarks:
Users that are interested in llm-structured-output-benchmarks are comparing it to the libraries listed below
- Repository to demonstrate Chain of Table reasoning with multiple tables powered by LangGraph☆144Updated 11 months ago
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆102Updated 11 months ago
- Tutorial for building LLM router☆189Updated 8 months ago
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆264Updated 3 months ago
- This repository implements the chain of verification paper by Meta AI☆166Updated last year
- ☆143Updated 8 months ago
- ☆215Updated 3 months ago
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆416Updated last year
- Attribute (or cite) statements generated by LLMs back to in-context information.☆221Updated 5 months ago
- ☆115Updated 7 months ago
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆272Updated last week
- RAGElo is a set of tools that helps you selecting the best RAG-based LLM agents by using an Elo ranker☆107Updated 2 weeks ago
- awesome synthetic (text) datasets☆265Updated 5 months ago
- Synthetic Data for LLM Fine-Tuning☆113Updated last year
- Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.☆189Updated last week
- FastAPI wrapper around DSPy☆235Updated last year
- ☆88Updated 4 months ago
- A Python library to chunk/group your texts based on semantic similarity.☆94Updated 8 months ago
- Domain Adapted Language Modeling Toolkit - E2E RAG☆318Updated 4 months ago
- Solving data for LLMs - Create quality synthetic datasets!☆145Updated 2 months ago
- ☆263Updated 9 months ago
- Function Calling Benchmark & Testing☆85Updated 8 months ago
- Mistral + Haystack: build RAG pipelines that rock 🤘☆103Updated last year
- Code for explaining and evaluating late chunking (chunked pooling)☆358Updated 3 months ago
- Research repository on interfacing LLMs with Weaviate APIs. Inspired by the Berkeley Gorilla LLM.☆120Updated last month
- Testing and evaluation framework for voice agents☆99Updated last month
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆224Updated 11 months ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆84Updated 3 weeks ago
- GenAIOps on Kubernetes: A collection of reference architectures for running GenAI at scale on Kubernetes using OSS tooling☆129Updated 5 months ago
- LLM-driven automated knowledge graph construction from text using DSPy and Neo4j.☆173Updated last year