Split large texts into chunks with a maximum number of tokens. Split by fixed size or by sentence.
☆34Mar 1, 2024Updated 2 years ago
Alternatives and similar repositories for chunker
Users that are interested in chunker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. Pure JavaScript port of karpathy/minbpe☆18Feb 19, 2024Updated 2 years ago
- An ESLint plugin enforcing proper handling of neverthrow Result values.☆15Mar 11, 2025Updated last year
- Easy-to-plug integration of Apple Wallet Web Services with Fastify☆17Dec 25, 2024Updated last year
- CloudFlare API wrapper☆29Oct 8, 2024Updated last year
- Smart spinner helper for React, to manage the duration of loading states.☆10Mar 13, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Extremely fast, compact, binary serialization/deserialization for your structured data☆124Mar 27, 2024Updated 2 years ago
- A set of UI components to help you integrate Orama on your website or app.☆17Jun 19, 2025Updated last year
- Minimal Effect system for TypeScript. Lazy, composable, cancellable.☆16Feb 21, 2026Updated 6 months ago
- A CLI for building https://remix.run applications with Webpack.☆13Jun 19, 2022Updated 4 years ago
- A template to create new packages.☆14May 12, 2025Updated last year
- AI-driven edge caching of any origin, using Cloudflare Workers and Deepseek AI☆20Jan 31, 2025Updated last year
- Amazing and performant starter for documentation websites powered by Qwik☆16Jun 7, 2024Updated 2 years ago
- ☆10Dec 4, 2024Updated last year
- Document Management System: The system manages documents, users and user roles. Each document defines access rights; the document defines…☆18May 11, 2017Updated 9 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Custom hook for tracking client-side navigation performance in Remix/React-Router applications☆18Jun 5, 2022Updated 4 years ago
- Lightweight & low-level Node.js dependency for interfacing with Discord☆13Aug 21, 2026Updated last week
- A tiny (171B) utility to check if a hostname is local☆33Oct 13, 2019Updated 6 years ago
- Converts camelCase JavaScript objects to JSON snake_case and vise versa.☆19Mar 26, 2022Updated 4 years ago
- ☆17Feb 24, 2026Updated 6 months ago
- A DSL to define Remix routes with code☆21Aug 1, 2026Updated last month
- JavaScript module to parse and validate RFC6838/RFC9694 media types, anything from 'text/plain' to 'application/vnd.company.app.entity-v2…☆19Oct 15, 2025Updated 10 months ago
- 🌩 Benchmark ESLint rules with detailed performance metrics for CI and plugin development☆26Aug 15, 2026Updated 2 weeks ago
- RebelDB™ • A new database engine is brewing 🧪 Imagine if REBOL and SQLite had a rebellious offspring ⚡️☆17Dec 18, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- easily add CSP and other security headers to your web application.☆23Jun 13, 2025Updated last year
- ☆21Feb 13, 2024Updated 2 years ago
- A concurrent in-memory B+ tree featuring optimistic lock coupling.☆15May 30, 2026Updated 3 months ago
- React components for Cucumber☆38Updated this week
- Your next side project won't fail this time 💡☆16Dec 10, 2024Updated last year
- Build cross-platform libraries from single codebase 💪🏼☆14Dec 4, 2023Updated 2 years ago
- Provides the best regex for validating or extracting URLs☆12Apr 9, 2021Updated 5 years ago
- LangSmithGo is a Golang-based client library designed to interface with the LangSmith API for tracking and monitoring large language mode…☆16Feb 13, 2025Updated last year
- Generate adorable and unique animal IDs for your projects☆11Mar 17, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A dynamic imports polyfill for Deno Deploy and compiled executables☆31Jan 24, 2024Updated 2 years ago
- A ClerkStrategy for Remix Auth, based on the OAuth2Strategy☆23Jan 22, 2024Updated 2 years ago
- Cut version of cryptokitties contracts for demonstration of Ethereum Mainnet to xDai bridge☆12Jan 24, 2023Updated 3 years ago
- APNs Notifications happens, ship them delightfully☆20Nov 1, 2025Updated 10 months ago
- Akka.Js DOM framework☆12Jul 17, 2018Updated 8 years ago
- Efficient, compact binary format for serializing data structures with extensible typing☆37Jul 11, 2020Updated 6 years ago
- TigerBeetle Hackathon at Interledger Summit 2023☆14Nov 20, 2023Updated 2 years ago