Alternatives and similar repositories for semchunk

Users that are interested in semchunk are comparing it to the libraries listed below

• aurelio-labs / semantic-chunkers
  ☆237Updated 4 months ago
• jina-ai / late-chunking
  Code for explaining and evaluating late chunking (chunked pooling)
  ☆453Updated 10 months ago
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆179Updated last year
• MinishLab / semhash
  Fast Semantic Text Deduplication & Filtering
  ☆823Updated 3 weeks ago
• PrithivirajDamodaran / FlashRank
  Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cro…
  ☆872Updated last month
• brandonstarxel / chunking_evaluation
  This package, developed as part of our research detailed in the Chroma Technical Report, provides tools for text chunking and evaluation.…
  ☆433Updated 7 months ago
• Unstructured-IO / unstructured-inference
  ☆196Updated this week
• agamm / semantic-split
  A Python library to chunk/group your texts based on semantic similarity.
  ☆97Updated last year
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆1,358Updated last month
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆626Updated this week
• docling-project / docling-parse
  Simple package to extract text with coordinates from programmatic PDFs
  ☆205Updated last week
• AnswerDotAI / rerankers
  A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
  ☆1,560Updated 4 months ago
• TonicAI / tonic_validate
  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
  ☆318Updated 3 months ago
• KarelDO / xmc.dspy
  In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.
  ☆441Updated last year
• tonywu71 / colpali-cookbooks
  Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻‍🍳
  ☆336Updated 4 months ago
• gkamradt / ChunkViz
  Visualize Different Text Splitting Methods
  ☆300Updated 9 months ago
• AnswerDotAI / byaldi
  Use late-interaction multi-modal models such as ColPali in just a few lines of code.
  ☆825Updated 8 months ago
• Knowledgator / GLiClass
  Generalist and Lightweight Model for Text Classification
  ☆163Updated 4 months ago
• jackboyla / GLiREL
  Generalist and Lightweight Model for Relation Extraction (Extract any relationship types from text)
  ☆243Updated 4 months ago
• castorini / rank_llm
  RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.
  ☆543Updated 3 weeks ago
• mixedbread-ai / baguetter
  Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…
  ☆190Updated last year
• quotient-ai / judges
  A small library of LLM judges
  ☆294Updated 2 months ago
• docling-project / docling-ibm-models
  ☆158Updated this week
• stanford-futuredata / ARES
  Automated Evaluation of RAG Systems
  ☆664Updated 6 months ago
• SapienzaNLP / relik
  Retrieve, Read and LinK: Fast and Accurate Entity Linking and Relation Extraction on an Academic Budget (ACL 2024)
  ☆466Updated 2 months ago
• illuin-tech / vidore-benchmark
  Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.
  ☆244Updated 2 months ago
• hitz-zentroa / GoLLIE
  Guideline following Large Language Model for Information Extraction
  ☆404Updated 11 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆302Updated 3 months ago
• sarthakrastogi / graph-rag
  ☆272Updated last year
• run-llama / workflows-py
  Workflows are an event-driven, async-first, step-based way to control the execution flow of AI applications like agents.
  ☆231Updated this week