This package, developed as part of our research detailed in the Chroma Technical Report, provides tools for text chunking and evaluation. It allows users to compare different chunking methods and includes implementations of several novel chunking strategies.
☆515Dec 13, 2025Updated 10 months ago
Alternatives and similar repositories for chunking_evaluation
Users that are interested in chunking_evaluation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An Overview of the Latest Document Chunking Research☆90Nov 25, 2024Updated last year
- Applying domain specific evaluations to RAG chunking and embedding functions☆20Dec 25, 2024Updated last year
- ☆36Jun 17, 2024Updated 2 years ago
- Efficient document processing for RAG using MaxMin Chunking.☆16May 20, 2026Updated 5 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,642Dec 20, 2025Updated 10 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Fast BM25 search in Python, powered by Numpy and Numba☆1,818Updated this week
- ☆53Nov 18, 2025Updated 11 months ago
- ☆1,487Jun 18, 2024Updated 2 years ago
- Code for explaining and evaluating late chunking (chunked pooling)☆541Dec 23, 2024Updated last year
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,973May 17, 2025Updated last year
- ☆21Mar 23, 2026Updated 7 months ago
- Optimize Document Retrieval with Fine-Tuned KnowledgeBases☆185Nov 5, 2025Updated 11 months ago
- Fast Multimodal Semantic Deduplication & Filtering☆979Oct 4, 2026Updated 3 weeks ago
- Query Only Linear Adapter Training for Fine Tuned Embedding Model Query Representation☆29Sep 12, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Supercharge Your LLM Application Evaluations 🚀☆16,203Feb 24, 2026Updated 8 months ago
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆851Jan 28, 2025Updated last year
- ☆261Sep 14, 2026Updated last month
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆35Aug 24, 2024Updated 2 years ago
- 🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines☆4,818Updated this week
- ☆21Nov 26, 2024Updated last year
- Fork of OpenAI's Realtime Console, adapted for Vocal RAG☆35Oct 18, 2024Updated 2 years ago
- ☆22Oct 14, 2024Updated 2 years ago
- This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed not…☆30,176Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Late Interaction Models Training & Retrieval☆900Jul 23, 2026Updated 3 months ago
- Convert PowerPoint files into semantically rich text using vision language models☆111Nov 12, 2025Updated 11 months ago
- utilities for batched llm calls with retries☆54Updated this week
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆26Jun 30, 2025Updated last year
- Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…☆15,671Updated this week
- Model implementation for the contextual embeddings project☆54Jun 2, 2025Updated last year
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆161Jul 14, 2025Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated last year
- structured outputs for llms☆14,093Oct 26, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data☆1,540Oct 2, 2026Updated last month
- ☆15Sep 28, 2025Updated last year
- Chunk your text using gpt4o-mini more accurately☆44Aug 3, 2024Updated 2 years ago
- ☆17Sep 3, 2026Updated last month
- Sandboxed tools and JS runtime for AI agents☆19Jul 13, 2026Updated 3 months ago
- Fast, Accurate, Lightweight Python library to make State of the Art Embedding☆3,275Updated this week
- Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cro…☆1,012Jul 11, 2026Updated 3 months ago