A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.
☆660Jun 13, 2026Updated 2 months ago
Alternatives and similar repositories for semchunk
Users that are interested in semchunk are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The code used to create and update the Open Australian Legal Embeddings, the first open-source embeddings of Australian legislative and j…☆14Feb 17, 2024Updated 2 years ago
- text2markdown is a Python library for intelligently converting plain text into Markdown.☆19Jun 1, 2026Updated 2 months ago
- Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from R…☆625Updated this week
- The code used to create and update the Open Australian Legal Corpus, the first and only multijurisdictional open corpus of Australian leg…☆122May 26, 2025Updated last year
- 🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines☆4,687Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Guides and code illustrating how to use Isaacus AI models in practice to solve real problems.☆36Jun 30, 2026Updated last month
- The code used to evaluate embedding models on the Massive Legal Embedding Benchmark (MLEB).☆39Feb 24, 2026Updated 5 months ago
- Tool to apply Legal Matter Specification Standard (LMSS) to documents☆12Aug 15, 2024Updated 2 years ago
- Check for data drift between two OpenAI multi-turn chat jsonl files.☆39Apr 11, 2024Updated 2 years ago
- One library to split them all: Sentence, Code, Docs. Chunk smarter, not harder — built for LLMs, RAG pipelines, and beyond.☆84Aug 10, 2026Updated last week
- Fast BM25 search in Python, powered by Numpy and Numba☆1,764Updated this week
- A lightweight, high-performance Python library for parsing jsonl files.☆56Nov 9, 2023Updated 2 years ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,628Dec 20, 2025Updated 7 months ago
- Fast Multimodal Semantic Deduplication & Filtering☆960May 24, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Fast, Accurate, Lightweight Python library to make State of the Art Embedding☆3,149Updated this week
- Structured Outputs☆15,643Updated this week
- Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…☆15,325Updated this week
- Fast State-of-the-Art Static Embeddings☆2,179Updated this week
- DSPy: The framework for programming—not prompting—language models☆37,382Updated this week
- KL3M training data collection and preprocessing☆22Apr 14, 2025Updated last year
- High-performance retrieval engine for unstructured data☆1,589Nov 10, 2025Updated 9 months ago
- ☆257Jun 10, 2025Updated last year
- Get your documents ready for gen AI☆65,056Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,950May 17, 2025Updated last year
- A system for agentic LLM-powered data processing and ETL☆3,975Aug 10, 2026Updated last week
- Code for explaining and evaluating late chunking (chunked pooling)☆536Dec 23, 2024Updated last year
- Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali☆2,913Mar 24, 2026Updated 4 months ago
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆91Feb 10, 2026Updated 6 months ago
- The LLM Evaluation Framework☆17,668Updated this week
- 💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows☆12,895Updated this week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,372Updated this week
- FOLIO: Federated Open Legal Information Ontology☆45May 27, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- structured outputs for llms☆13,746Aug 9, 2026Updated last week
- Dataset Viber is your chill repo for data collection, annotation and vibe checks.☆47Sep 5, 2024Updated last year
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆162Jul 14, 2025Updated last year
- noslegal taxonomy facets and release notes☆44May 29, 2026Updated 2 months ago
- chunkipy is an extremely useful tool for segmenting long texts into smaller chunks, based on either a character or token count. With cust…☆37Mar 20, 2026Updated 4 months ago
- Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts)☆3,549Aug 10, 2026Updated last week
- A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive vi…☆38,427Aug 11, 2026Updated last week