jina-ai / late-chunkingLinks
Code for explaining and evaluating late chunking (chunked pooling)
☆453Updated 10 months ago
Alternatives and similar repositories for late-chunking
Users that are interested in late-chunking are comparing it to the libraries listed below
Sorting:
- HtmlRAG: HTML is Better Than Plain Text for Modeling Retrieval Results in RAG Systems (WWW 2025)☆447Updated 4 months ago
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆229Updated 3 weeks ago
- [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation☆308Updated last year
- Repository for "MultiHop-RAG: A Dataset for Evaluating Retrieval-Augmented Generation Across Documents" (COLM 2024)☆376Updated 6 months ago
- Meta-Chunking: Learning Efficient Text Segmentation via Logical Perception☆248Updated 3 weeks ago
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆390Updated 2 months ago
- ☆237Updated 4 months ago
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)☆337Updated 10 months ago
- Automated Evaluation of RAG Systems☆664Updated 6 months ago
- This is the official repository for Auto-RAG.☆225Updated 3 months ago
- Framework for enhancing LLMs for RAG tasks using fine-tuning.☆750Updated 5 months ago
- [EMNLP'25 findings] This is the official repo for the paper, HiRAG: Retrieval-Augmented Generation with Hierarchical Knowledge.☆432Updated 3 weeks ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,560Updated 4 months ago
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆543Updated 2 weeks ago
- ☆272Updated last year
- LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA☆507Updated 9 months ago
- The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.☆178Updated 5 months ago
- The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval☆1,434Updated last year
- Evaluation tools for Retrieval-augmented Generation (RAG) methods.☆166Updated 11 months ago
- Comprehensive benchmark for RAG☆222Updated 4 months ago
- RAGChecker: A Fine-grained Framework For Diagnosing RAG☆1,001Updated 10 months ago
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆336Updated 4 months ago
- A simple, easy-to-hack Vector Database☆168Updated 11 months ago
- Corrective Retrieval Augmented Generation☆415Updated last year
- Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.☆245Updated 2 months ago
- The official repository of NodeRAG☆365Updated 7 months ago
- This repository presents the original implementation of LumberChunker: Long-Form Narrative Document Segmentation by André V. Duarte, João…☆77Updated last year
- This package, developed as part of our research detailed in the Chroma Technical Report, provides tools for text chunking and evaluation.…☆429Updated 7 months ago
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆824Updated 8 months ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆179Updated last year