jina-ai / late-chunkingLinks
Code for explaining and evaluating late chunking (chunked pooling)
☆469Updated 11 months ago
Alternatives and similar repositories for late-chunking
Users that are interested in late-chunking are comparing it to the libraries listed below
Sorting:
- HtmlRAG: HTML is Better Than Plain Text for Modeling Retrieval Results in RAG Systems (WWW 2025)☆450Updated 5 months ago
- Official Implementation of "Multi-Head RAG: Solving Multi-Aspect Problems with LLMs"☆235Updated 2 months ago
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆242Updated last year
- This is an implementation of the paper: Searching for Best Practices in Retrieval-Augmented Generation (EMNLP2024)☆342Updated 11 months ago
- [EMNLP 2024: Demo Oral] RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation☆310Updated last year
- Repository for "MultiHop-RAG: A Dataset for Evaluating Retrieval-Augmented Generation Across Documents" (COLM 2024)☆396Updated 8 months ago
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆486Updated last month
- Meta-Chunking: Learning Efficient Text Segmentation via Logical Perception☆253Updated 2 months ago
- Automated Evaluation of RAG Systems☆674Updated 8 months ago
- ☆240Updated 5 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,579Updated 6 months ago
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆555Updated this week
- Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻🍳☆343Updated 6 months ago
- Framework for enhancing LLMs for RAG tasks using fine-tuning.☆758Updated 6 months ago
- Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.☆250Updated 3 months ago
- LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA☆513Updated 11 months ago
- [EMNLP'25 findings] This is the official repo for the paper, HiRAG: Retrieval-Augmented Generation with Hierarchical Knowledge.☆469Updated 2 weeks ago
- This is the official repository for Auto-RAG.☆229Updated 4 months ago
- The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval☆1,487Updated last year
- Use late-interaction multi-modal models such as ColPali in just a few lines of code.☆830Updated 10 months ago
- This repository presents the original implementation of LumberChunker: Long-Form Narrative Document Segmentation by André V. Duarte, João…☆83Updated last year
- This is a repository of RALM surveys containing a summary of state-of-the-art RAG and other technologies☆202Updated last year
- Corrective Retrieval Augmented Generation☆427Updated last year
- This package, developed as part of our research detailed in the Chroma Technical Report, provides tools for text chunking and evaluation.…☆451Updated 8 months ago
- Evaluation tools for Retrieval-augmented Generation (RAG) methods.☆167Updated last year
- RAGChecker: A Fine-grained Framework For Diagnosing RAG☆1,020Updated 11 months ago
- 🔥 Rankify: A Comprehensive Python Toolkit for Retrieval, Re-Ranking, and Retrieval-Augmented Generation 🔥. Our toolkit integrates 40 pr…☆524Updated last month
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆179Updated last year
- The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.☆183Updated 7 months ago
- Comprehensive benchmark for RAG☆242Updated 5 months ago