Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. Pure JavaScript port of karpathy/minbpe
☆18Feb 19, 2024Updated 2 years ago
Alternatives and similar repositories for minbpe
Users that are interested in minbpe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Split large texts into chunks with a maximum number of tokens. Split by fixed size or by sentence.☆34Mar 1, 2024Updated 2 years ago
- JCS (JSON Canonicalization Scheme), JSON digests, and JSON Merkle hashes☆15Mar 10, 2024Updated 2 years ago
- NearForm multi-platform application accelerator☆35Jun 30, 2021Updated 5 years ago
- OpenJS's Collaboration Space for JavaScript Bundlers and Tooling Infrastructure.☆15Oct 29, 2025Updated 9 months ago
- Scroll to the current anchor in the url if possible☆11Jun 18, 2017Updated 9 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆11Jul 4, 2018Updated 8 years ago
- 🎯 A Single Class CSS Framework - Classic Form Styling With Ease☆10May 13, 2020Updated 6 years ago
- Customizable user flair system for Reddit☆16May 2, 2021Updated 5 years ago
- 📤 Magically generate `fetch` types from OpenAPI schemas for zero-cost browser-native api clients☆21Apr 17, 2025Updated last year
- Generate typescript model definitions with just the JSON schema (including reference resolution).☆14Feb 1, 2021Updated 5 years ago
- ☆11Jul 25, 2016Updated 10 years ago
- Build and manage the fast-json-stringify instances for the fastify framework☆15Aug 5, 2026Updated last week
- (Alternative) Visualizer for XState☆12Mar 2, 2023Updated 3 years ago
- ☆43Mar 6, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Demo of Apollo Federation☆12Apr 9, 2024Updated 2 years ago
- A stream that can substitute contents of a file in streaming fashion.☆14Aug 10, 2021Updated 5 years ago
- The same application, implemented and measured in both ReactN and redux.☆11Dec 10, 2020Updated 5 years ago
- Commander.js (command-line interfaces) for Deno.☆10Jul 22, 2020Updated 6 years ago
- DNS-SD (aka Zeroconf, Bonjour, Avahi) in TypeScript for Deno and Node.☆56Jul 14, 2024Updated 2 years ago
- A simple HTML avatar generator for Habbo.☆11Jun 29, 2016Updated 10 years ago
- Non-allocating command line flag parser☆18Mar 26, 2026Updated 4 months ago
- A collection of additional language phonology settings for use with VulgarLang.☆14Aug 19, 2022Updated 3 years ago
- JsonML library for node.js☆16Jan 25, 2013Updated 13 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Infra for serving Node.js downloads and documentation.☆57Updated this week
- woff font file (re)compressor☆24Aug 4, 2017Updated 9 years ago
- Lelylan API proxy☆13Dec 12, 2016Updated 9 years ago
- AssemblyScript version of Rust Option<T> and Result<O, E> etc.☆26May 9, 2024Updated 2 years ago
- Native app for botlist.co, 100% in JSON☆12Nov 2, 2016Updated 9 years ago
- Compilers for @effect/schema☆22Oct 14, 2024Updated last year
- Monitor millions of S3 objects without external dependencies☆24Feb 6, 2025Updated last year
- Website for genome.js☆15Nov 11, 2013Updated 12 years ago
- ☆18Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- an animated Mayan Calendar☆13Jan 12, 2014Updated 12 years ago
- List key diff algorithm.☆15Nov 10, 2015Updated 10 years ago
- A Database for the browser using compiled SQL queries in WASM☆16Mar 4, 2023Updated 3 years ago
- Component search application powered by Express and Redis☆15Sep 27, 2014Updated 11 years ago
- Painless platform portability - seamlessly run your app on your dev box and many PaaS providers.☆15Feb 3, 2016Updated 10 years ago
- A website that lets you know where to watch a movie built on Next.js and Meilisearch, deployed on Vercel with the Meilisearch + Vercel in…☆12Aug 10, 2023Updated 3 years ago
- Lightweight express, koa, and http middleware for efficient API endpoint monitoring☆12Mar 31, 2021Updated 5 years ago