Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization. Pure JavaScript port of karpathy/minbpe
☆18Feb 19, 2024Updated 2 years ago
Alternatives and similar repositories for minbpe
Users that are interested in minbpe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- data repository☆12Nov 21, 2024Updated last year
- Split large texts into chunks with a maximum number of tokens. Split by fixed size or by sentence.☆33Mar 1, 2024Updated 2 years ago
- JCS (JSON Canonicalization Scheme), JSON digests, and JSON Merkle hashes☆15Mar 10, 2024Updated 2 years ago
- An application to create nodejs.org distribution index files: index.json and index.tab☆23Oct 2, 2026Updated last week
- Parse Dat protocol SLEEP files.☆13Apr 28, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Serverless Scheduler and Queue system built on top of cloudflare workers, D1 and Durable Objects to handle scale and schedule/queue mil…☆11Dec 15, 2024Updated last year
- 🎯 A Single Class CSS Framework - Classic Form Styling With Ease☆10May 13, 2020Updated 6 years ago
- Generate typescript model definitions with just the JSON schema (including reference resolution).☆14Feb 1, 2021Updated 5 years ago
- Build and manage the fast-json-stringify instances for the fastify framework☆15Updated this week
- ☆44Mar 6, 2023Updated 3 years ago
- (Alternative) Visualizer for XState☆12Mar 2, 2023Updated 3 years ago
- Demo of Apollo Federation☆12Apr 9, 2024Updated 2 years ago
- A stream that can substitute contents of a file in streaming fashion.☆14Aug 10, 2021Updated 5 years ago
- The same application, implemented and measured in both ReactN and redux.☆11Dec 10, 2020Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- DNS-SD (aka Zeroconf, Bonjour, Avahi) in TypeScript for Deno and Node.☆56Jul 14, 2024Updated 2 years ago
- AWS CDK constructs for AWS ControlTower☆19Updated this week
- Non-allocating command line flag parser☆18Mar 26, 2026Updated 6 months ago
- Documentation generated from Servo’s source code in its master branch☆19Updated this week
- DEPRECATED: Use rofrischmann/inline-style-prefix-all instead☆11Mar 31, 2017Updated 9 years ago
- JsonML library for node.js☆16Jan 25, 2013Updated 13 years ago
- Lelylan API proxy☆13Dec 12, 2016Updated 9 years ago
- AssemblyScript version of Rust Option<T> and Result<O, E> etc.☆26May 9, 2024Updated 2 years ago
- Native app for botlist.co, 100% in JSON☆12Nov 2, 2016Updated 9 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Monitor millions of S3 objects without external dependencies☆25Sep 29, 2026Updated 2 weeks ago
- Compilers for @effect/schema☆22Oct 14, 2024Updated 2 years ago
- an animated Mayan Calendar☆13Jan 12, 2014Updated 12 years ago
- Plugin to deal with diagnostics_channel on Fastify☆20Feb 12, 2025Updated last year
- animation timing & handling☆15Jul 15, 2012Updated 14 years ago
- Convert boring text to 1337 text☆13Mar 15, 2016Updated 10 years ago
- ☆38Updated this week
- Graph retrieval augmented generation with OpenAI, LangChain and Neo4J☆12Aug 5, 2025Updated last year
- Component search application powered by Express and Redis☆15Sep 27, 2014Updated 12 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Painless platform portability - seamlessly run your app on your dev box and many PaaS providers.☆15Feb 3, 2016Updated 10 years ago
- A website that lets you know where to watch a movie built on Next.js and Meilisearch, deployed on Vercel with the Meilisearch + Vercel in…☆12Aug 10, 2023Updated 3 years ago
- Generate Sequelize model definitions from a Swagger 2.0 schema☆11Nov 13, 2020Updated 5 years ago
- Cross browser navigator.getUserMedia with a node api☆15Nov 22, 2016Updated 9 years ago
- Simple CSS manipulation.☆16Sep 17, 2015Updated 11 years ago
- An open source Vulcan.js app to post your awesome Vulcan related resources, packages and links☆13Dec 30, 2022Updated 3 years ago
- An implementation of wxAsteroids in javascript using UHC (Utrecht Haskell Compiler)☆12Dec 1, 2014Updated 11 years ago