Split large texts into chunks with a maximum number of tokens. Split by fixed size or by sentence.
ā34Mar 1, 2024Updated 2 years ago
Alternatives and similar repositories for chunker
Users that are interested in chunker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. Pure JavaScript port of karpathy/minbpeā18Feb 19, 2024Updated 2 years ago
- š Demos & examples of Orama in the wildā20Oct 27, 2023Updated 2 years ago
- Vite plugin that allows you to add react directives to any fileā16May 22, 2025Updated 10 months ago
- CloudFlare API wrapperā30Oct 8, 2024Updated last year
- A sample client for iPhone to get and add a pass to Apple Walletā10Sep 28, 2018Updated 7 years ago
- A template to create new packages.ā14May 12, 2025Updated 10 months ago
- A simpler batcher for any async functionā14Dec 1, 2025Updated 3 months ago
- AI-driven edge caching of any origin, using Cloudflare Workers and Deepseek AIā21Jan 31, 2025Updated last year
- Erlang/OTPā27Sep 22, 2023Updated 2 years ago
- Extremely fast, compact, binary serialization/deserialization for your structured dataā120Mar 27, 2024Updated last year
- .NET RabbitMQ client for AMQP 1.0ā21Updated this week
- Lightweight & low-level Node.js dependency for interfacing with Discordā10Feb 16, 2026Updated last month
- A DSL to define Remix routes with codeā21Jan 26, 2026Updated last month
- š safe secrets for the javascript ecosystemā23Dec 14, 2025Updated 3 months ago
- Wasm module dependency analysis for module resolutionā12Jul 29, 2025Updated 7 months ago
- ā20Feb 13, 2024Updated 2 years ago
- šāØ Rescue: better errors through types (a more type directed MonadThrow/MonadCatch)ā20Feb 1, 2022Updated 4 years ago
- Provides the best regex for validating or extracting URLsā12Apr 9, 2021Updated 4 years ago
- A dynamic imports polyfill for Deno Deploy and compiled executablesā31Jan 24, 2024Updated 2 years ago
- Sample TMDB App using Lightning and SolidJSā17May 18, 2024Updated last year
- Beautifully-designed, accessible search componentsā37Jul 15, 2025Updated 8 months ago
- In-browser semantic search demo using EmbeddingGemma and Transformers.js. No server required.ā31Sep 7, 2025Updated 6 months ago
- Logging library and SaaS with Deno KV (PoC)ā14Jun 17, 2023Updated 2 years ago
- š Simplify and Supercharge Your Links!ā17Mar 17, 2026Updated last week
- Opinionated collection of common JavaScript / TypeScript utilsā17Feb 28, 2026Updated 3 weeks ago
- A ClerkStrategy for Remix Auth, based on the OAuth2Strategyā23Jan 22, 2024Updated 2 years ago
- Brain backup - reducing learning curve for the peopleā13Feb 17, 2026Updated last month
- Efficient, compact binary format for serializing data structures with extensible typingā37Jul 11, 2020Updated 5 years ago
- ActiveAdmin plugin. Allow to hide any filter from sidebar filters panelā11May 25, 2022Updated 3 years ago
- Schedule work to be completed when the user agent is idle.ā44Mar 23, 2018Updated 8 years ago
- Showcasing Fastify in a modern Node.js project.ā16Jun 8, 2023Updated 2 years ago
- Computed properties with JavaScript Proxyā11Jun 9, 2017Updated 8 years ago
- The JavaScript client library for Subhosting API.ā11May 6, 2024Updated last year
- ā53Jul 16, 2021Updated 4 years ago
- Scroll to the current anchor in the url if possibleā11Jun 18, 2017Updated 8 years ago
- Effortless documentation for Svelte componentsā13Feb 5, 2025Updated last year
- ā17Nov 14, 2022Updated 3 years ago
- The Web Preference API aims to provide a way for sites to override the value for a given user preference (e.g. color-scheme preference) iā¦ā46May 8, 2025Updated 10 months ago
- A Deno Web bundler.ā14Mar 13, 2026Updated last week