This package, developed as part of our research detailed in the Chroma Technical Report, provides tools for text chunking and evaluation. It allows users to compare different chunking methods and includes implementations of several novel chunking strategies.
☆511Dec 13, 2025Updated 10 months ago
Alternatives and similar repositories for chunking_evaluation
Users that are interested in chunking_evaluation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An Overview of the Latest Document Chunking Research☆90Nov 25, 2024Updated last year
- ☆34Jun 17, 2024Updated 2 years ago
- Efficient document processing for RAG using MaxMin Chunking.☆16May 20, 2026Updated 4 months ago
- Code for explaining and evaluating late chunking (chunked pooling)☆540Dec 23, 2024Updated last year
- Fast BM25 search in Python, powered by Numpy and Numba☆1,804Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆53Nov 18, 2025Updated 10 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,641Dec 20, 2025Updated 9 months ago
- ☆1,485Jun 18, 2024Updated 2 years ago
- Fast Multimodal Semantic Deduplication & Filtering☆974Oct 4, 2026Updated last week
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,964May 17, 2025Updated last year
- Query Only Linear Adapter Training for Fine Tuned Embedding Model Query Representation☆29Sep 12, 2024Updated 2 years ago
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆35Aug 24, 2024Updated 2 years ago
- ☆21Nov 26, 2024Updated last year
- ☆22Oct 14, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- 🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines☆4,787Oct 3, 2026Updated last week
- Optimize Document Retrieval with Fine-Tuned KnowledgeBases☆186Nov 5, 2025Updated 11 months ago
- Fork of OpenAI's Realtime Console, adapted for Vocal RAG☆35Oct 18, 2024Updated last year
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆161Jul 14, 2025Updated last year
- This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed not…☆29,842Updated this week
- Late Interaction Models Training & Retrieval☆897Jul 23, 2026Updated 2 months ago
- UIC-2024☆12Apr 6, 2025Updated last year
- Model implementation for the contextual embeddings project☆54Jun 2, 2025Updated last year
- ☆11Feb 23, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆851Jan 28, 2025Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated last year
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆25Jun 30, 2025Updated last year
- ☆16Sep 3, 2026Updated last month
- Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…☆15,563Updated this week
- ☆252Sep 11, 2026Updated last month
- Chunk your text using gpt4o-mini more accurately☆44Aug 3, 2024Updated 2 years ago
- Sandboxed tools and JS runtime for AI agents☆18Jul 13, 2026Updated 3 months ago
- Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.☆1,370Sep 25, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Fast, Accurate, Lightweight Python library to make State of the Art Embedding☆3,241Updated this week
- Overview and entry point for methods and experiment environments from paper "Stronger Baselines for Retrieval-Augmented Generation with L…☆25Nov 8, 2025Updated 11 months ago
- structured outputs for llms☆14,007Updated this week
- ☆259Sep 14, 2026Updated 3 weeks ago
- Library for evaluating RAG using Nuclia's models☆19Jul 31, 2024Updated 2 years ago
- ☆197May 5, 2024Updated 2 years ago
- Convert PowerPoint files into semantically rich text using vision language models☆111Nov 12, 2025Updated 11 months ago