jina-ai / late-chunkingLinks
Code for explaining and evaluating late chunking (chunked pooling)
☆476Updated 11 months ago
Alternatives and similar repositories for late-chunking
Users that are interested in late-chunking are comparing it to the libraries listed below
Sorting:
- HtmlRAG: HTML is Better Than Plain Text for Modeling Retrieval Results in RAG Systems (WWW 2025)☆453Updated 6 months ago
- [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation☆310Updated last year
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)☆344Updated last year
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆235Updated 2 months ago
- Meta-Chunking: Learning Efficient Text Segmentation via Logical Perception☆262Updated 2 months ago
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆242Updated last year
- Repository for "MultiHop-RAG: A Dataset for Evaluating Retrieval-Augmented Generation Across Documents" (COLM 2024)☆400Updated 8 months ago
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆512Updated last month
- ☆242Updated 6 months ago
- The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval☆1,503Updated last year
- Automated Evaluation of RAG Systems☆679Updated 8 months ago
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆559Updated 3 weeks ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,579Updated 6 months ago
- Framework for enhancing LLMs for RAG tasks using fine-tuning.☆759Updated this week
- LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA☆516Updated 11 months ago
- RAGChecker: A Fine-grained Framework For Diagnosing RAG☆1,027Updated last year
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆348Updated 6 months ago
- [EMNLP'25 findings] This is the official repo for the paper, HiRAG: Retrieval-Augmented Generation with Hierarchical Knowledge.☆481Updated last month
- The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.☆183Updated 7 months ago
- Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cro…☆902Updated 3 months ago
- ☆276Updated last year
- A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.☆813Updated 5 months ago
- This package, developed as part of our research detailed in the Chroma Technical Report, provides tools for text chunking and evaluation.…☆458Updated last week
- This is the official repository for Auto-RAG.☆230Updated 5 months ago
- Build datasets using natural language☆552Updated 3 months ago
- This repository presents the original implementation of LumberChunker: Long-Form Narrative Document Segmentation by André V. Duarte, João…☆85Updated last year
- Corrective Retrieval Augmented Generation☆433Updated last year
- A simple, easy-to-hack Vector Database☆178Updated last year
- Comprehensive benchmark for RAG☆249Updated 6 months ago
- Evaluation tools for Retrieval-augmented Generation (RAG) methods.☆167Updated last year