brandonstarxel / chunking_evaluationLinks
This package, developed as part of our research detailed in the Chroma Technical Report, provides tools for text chunking and evaluation. It allows users to compare different chunking methods and includes implementations of several novel chunking strategies.
☆346Updated 4 months ago
Alternatives and similar repositories for chunking_evaluation
Users that are interested in chunking_evaluation are comparing it to the libraries listed below
Sorting:
- ☆227Updated last month
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆802Updated 5 months ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆173Updated 9 months ago
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆315Updated last month
- 👩🏻🍳 A collection of example notebooks using Haystack☆485Updated this week
- FastAPI wrapper around DSPy☆253Updated last year
- This repository shares end-to-end notebooks on how to use various Weaviate features and integrations!☆796Updated this week
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆342Updated last month
- In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.☆431Updated last year
- Code for explaining and evaluating late chunking (chunked pooling)☆416Updated 6 months ago
- An Awesome list of curated DSPy resources.☆372Updated 4 months ago
- Visualize Different Text Splitting Methods☆269Updated 6 months ago
- An example of multi-agent orchestration with llama-index☆426Updated 5 months ago
- ARAGOG- Advanced RAG Output Grading. Exploring and comparing various Retrieval-Augmented Generation (RAG) techniques on AI research paper…☆107Updated last year
- Automated Evaluation of RAG Systems☆624Updated 3 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,492Updated last month
- Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cro…☆827Updated last week
- ☆160Updated last month
- Readymade evaluators for agent trajectories☆265Updated last month
- Late Interaction Models Training & Retrieval☆481Updated this week
- A Lightweight Library for AI Observability☆246Updated 4 months ago
- Structured information extraction from documents☆317Updated 9 months ago
- A small library of LLM judges☆228Updated 2 weeks ago
- ☆202Updated 6 months ago
- ☆150Updated this week
- 🤗 Benchmark Large Language Models Reliably On Your Data☆359Updated this week
- ☆144Updated 11 months ago
- An open-source tool for general prompt optimization.☆557Updated this week
- A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…☆123Updated this week
- ☆185Updated last year