This package, developed as part of our research detailed in the Chroma Technical Report, provides tools for text chunking and evaluation. It allows users to compare different chunking methods and includes implementations of several novel chunking strategies.
☆501Dec 13, 2025Updated 7 months ago
Alternatives and similar repositories for chunking_evaluation
Users that are interested in chunking_evaluation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An Overview of the Latest Document Chunking Research☆90Nov 25, 2024Updated last year
- Applying domain specific evaluations to RAG chunking and embedding functions☆20Dec 25, 2024Updated last year
- ☆34Jun 17, 2024Updated 2 years ago
- Efficient document processing for RAG using MaxMin Chunking.☆16May 20, 2026Updated 2 months ago
- Code for explaining and evaluating late chunking (chunked pooling)☆532Dec 23, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Fast BM25 search in Python, powered by Numpy and Numba☆1,740Updated this week
- ☆52Nov 18, 2025Updated 8 months ago
- An overview of popular reranking models and architectures for 2 stage RAG pipelines☆24Jun 10, 2025Updated last year
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,625Dec 20, 2025Updated 7 months ago
- ☆1,477Jun 18, 2024Updated 2 years ago
- Query Only Linear Adapter Training for Fine Tuned Embedding Model Query Representation☆28Sep 12, 2024Updated last year
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,940May 17, 2025Updated last year
- Supercharge Your LLM Application Evaluations 🚀☆14,935Feb 24, 2026Updated 4 months ago
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆35Aug 24, 2024Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆22Oct 14, 2024Updated last year
- 🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines☆4,544Updated this week
- Optimize Document Retrieval with Fine-Tuned KnowledgeBases☆186Nov 5, 2025Updated 8 months ago
- Fork of OpenAI's Realtime Console, adapted for Vocal RAG☆35Oct 18, 2024Updated last year
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆161Jul 14, 2025Updated last year
- This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed not…☆28,748Jul 14, 2026Updated last week
- Late Interaction Models Training & Retrieval☆875Jul 13, 2026Updated last week
- Fast Multimodal Semantic Deduplication & Filtering☆947May 24, 2026Updated last month
- Model implementation for the contextual embeddings project☆47Jun 2, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- utilities for batched llm calls with retries☆51Jul 10, 2026Updated last week
- ☆12Feb 23, 2024Updated 2 years ago
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆851Jan 28, 2025Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated 10 months ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆25Jun 30, 2025Updated last year
- Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…☆15,176Updated this week
- ☆243Jan 18, 2026Updated 6 months ago
- Chunk your text using gpt4o-mini more accurately☆44Aug 3, 2024Updated last year
- Sandboxed tools and JS runtime for AI agents☆16Jul 13, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Fast, Accurate, Lightweight Python library to make State of the Art Embedding☆3,098Updated this week
- Meta-Chunking: Learning Efficient Text Segmentation via Logical Perception☆277Sep 25, 2025Updated 9 months ago
- Overview and entry point for methods and experiment environments from paper "Stronger Baselines for Retrieval-Augmented Generation with L…☆25Nov 8, 2025Updated 8 months ago
- structured outputs for llms☆13,593Jul 13, 2026Updated last week
- ☆255Jun 10, 2025Updated last year
- Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.☆1,317Jul 6, 2026Updated 2 weeks ago
- Library for evaluating RAG using Nuclia's models☆18Jul 31, 2024Updated last year