gioelecrispo / chunkipy
chunkipy is an extremely useful tool for segmenting long texts into smaller chunks, based on either a character or token count. With customizable chunk sizes and splitting strategies, chunkipy provides flexibility and control for various text processing tasks.
☆36Updated last year
Alternatives and similar repositories for chunkipy
Users that are interested in chunkipy are comparing it to the libraries listed below
Sorting:
- Explore the use of DSPy for extracting features from PDFs 🔎☆39Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆66Updated 6 months ago
- 📝 Reference-Free automatic summarization evaluation with potential hallucination detection☆100Updated last year
- Writing Blog Posts with Generative Feedback Loops!☆47Updated last year
- ☆77Updated 11 months ago
- 🚀 A list of Haystack Integrations, maintained by the community or deepset.☆85Updated last week
- Dataset Viber is your chill repo for data collection, annotation and vibe checks.☆47Updated 8 months ago
- AI real estate agent☆34Updated last year
- ☆19Updated 7 months ago
- Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…☆49Updated 10 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆61Updated last year
- ☆14Updated last year
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆31Updated 8 months ago
- ☆68Updated 6 months ago
- Mistral + Haystack: build RAG pipelines that rock 🤘☆103Updated last year
- A tutorial on DSPy and whether automated prompt engineering lives up to the hype☆22Updated last year
- Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da☆103Updated last month
- A RAG that can scale 🧑🏻💻☆11Updated 11 months ago
- Overview and tutorials of the LlamaIndex Library☆18Updated last year
- ☆45Updated last year
- ☆122Updated 2 months ago
- Search your favorite websites and chat with them, on your desktop🌐☆30Updated 3 months ago
- Pre-train Static Word Embeddings☆60Updated last month
- A framework for evaluating function calls made by LLMs☆37Updated 9 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆69Updated 6 months ago
- Python library to use Pleias-RAG models☆49Updated 2 weeks ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆166Updated 7 months ago
- LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…☆99Updated 3 weeks ago
- Simple customizable evaluation for text retrieval performance of Sentence Transformers embedders on PDFs☆26Updated 3 months ago
- ☆17Updated last year