Split large texts into chunks with a maximum number of tokens. Split by fixed size or by sentence.
☆34Mar 1, 2024Updated 2 years ago
Alternatives and similar repositories for chunker
Users that are interested in chunker are comparing it to the libraries listed below
Sorting:
- Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. Pure JavaScript port of karpathy/minbpe☆18Feb 19, 2024Updated 2 years ago
- 🚀 Demos & examples of Orama in the wild☆20Oct 27, 2023Updated 2 years ago
- ☆11Jul 24, 2024Updated last year
- Vite plugin that allows you to add react directives to any file☆16May 22, 2025Updated 9 months ago
- A set of UI components to help you integrate Orama on your website or app.☆17Jun 19, 2025Updated 8 months ago
- Smart spinner helper for React, to manage the duration of loading states.☆10Mar 13, 2024Updated last year
- A CLI for building https://remix.run applications with Webpack.☆13Jun 19, 2022Updated 3 years ago
- A simpler batcher for any async function☆14Dec 1, 2025Updated 3 months ago
- This plugin provides a cache system for Orama. The cache system is based on async-cache-dedupe.☆14Sep 20, 2024Updated last year
- A template to create new packages.☆14May 12, 2025Updated 9 months ago
- Custom hook for tracking client-side navigation performance in Remix/React-Router applications☆18Jun 5, 2022Updated 3 years ago
- Converts camelCase JavaScript objects to JSON snake_case and vise versa.☆19Mar 26, 2022Updated 3 years ago
- Easy-to-plug integration of Apple Wallet Web Services with Fastify☆17Dec 25, 2024Updated last year
- Document Management System: The system manages documents, users and user roles. Each document defines access rights; the document defines…☆18May 11, 2017Updated 8 years ago
- A DSL to define Remix routes with code☆21Jan 26, 2026Updated last month
- Erlang/OTP☆27Sep 22, 2023Updated 2 years ago
- ☆53Jul 16, 2021Updated 4 years ago
- A ClerkStrategy for Remix Auth, based on the OAuth2Strategy☆23Jan 22, 2024Updated 2 years ago
- Module which returns the offensive words in a string. A soft reminder to be nicer to each other ❤️.☆23Feb 16, 2019Updated 7 years ago
- My own agent skills for tools I use☆73Feb 1, 2026Updated last month
- A browser extension that allows you to highlight, tag, annotate, and export the best parts of your favorite YouTube videos and summarize …☆27Nov 3, 2024Updated last year
- dossi browser extension: Your own private GitHub notes on every page☆25Jul 19, 2024Updated last year
- A tiny (171B) utility to check if a hostname is local☆33Oct 13, 2019Updated 6 years ago
- AWS adapter for Remix☆26Oct 15, 2024Updated last year
- Clean Architecture, DDD, CQRS with testings in NodeJs and Typescript☆10Dec 8, 2025Updated 2 months ago
- Promisify a callback-style function, resolving with [err,val]☆31May 19, 2021Updated 4 years ago
- Validate routes referenced by <Link> and friends in a Remix app☆36Dec 23, 2023Updated 2 years ago
- Opinionated `fetch` (with retrying and DNS caching) optimized for use inside microservices☆23Nov 14, 2025Updated 3 months ago
- Distributed queue☆33Jul 1, 2025Updated 8 months ago
- Examples how to use Upstash with various tech☆40Apr 2, 2025Updated 11 months ago
- Extremely fast, compact, binary serialization/deserialization for your structured data☆120Mar 27, 2024Updated last year
- ☆32Mar 2, 2025Updated last year
- Polyfill Node.js built-ins for Rolldown☆30Updated this week
- A minimalistic blockchain implementation☆27Dec 8, 2022Updated 3 years ago
- Bidirectional Server-sent Events☆43Dec 2, 2021Updated 4 years ago
- Slugify a string. The minimal version.☆37Apr 29, 2022Updated 3 years ago
- Fast, StAX-like XML Parser for BEAM Languages☆36Jul 31, 2022Updated 3 years ago
- This is me playing around with https://remix.run☆33Nov 26, 2020Updated 5 years ago
- ☆12Mar 28, 2024Updated last year