a lightweight no-dependency fork from transformers.js (only tokenizers)
☆34May 16, 2026Updated 5 months ago
Alternatives and similar repositories for tokenizers
Users that are interested in tokenizers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Annotated AST for the purposes of LLM code repository context. Use this novel approach to pre-process your Github repository. This projec…☆38Dec 13, 2024Updated last year
- The best bash parser in JavaScript. Fast, complete, typed.☆139Updated this week
- WordPress themes and plugins development with Docker and Compose☆13Jul 16, 2015Updated 11 years ago
- Improved routing for WordPress☆13Apr 27, 2023Updated 3 years ago
- The code examples for the Level Up Tutorials course Web Components For Beginners.☆12Aug 31, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A PSR-16 wrapper for WP transients☆13Oct 13, 2023Updated 3 years ago
- Multi-turn dataset management tool for LLM trainers☆13Mar 31, 2025Updated last year
- A command-line tool that fetches data from google spreadsheets and saves it as json in the filesystem.☆10May 12, 2015Updated 11 years ago
- A static deobfuscator for JavaScript Malware☆14May 6, 2020Updated 6 years ago
- A Mustache view class for the Slim Framework☆14Jun 6, 2014Updated 12 years ago
- A hand-picked bookmark collection of subjectively modern/interesting plugins for WordPress by Swedish people☆11Jul 8, 2015Updated 11 years ago
- rotating proxy server☆11Sep 17, 2024Updated 2 years ago
- Create text-behind-image designs in seconds.☆13Sep 7, 2025Updated last year
- Review the artifact before you publish it: diffs the built npm/PyPI package against the last published version and pins risk signals to t…☆32Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Sentry.io Hackweek Submisison - A multiplayer editor for .md files that comits directly to GitHub☆12Aug 25, 2023Updated 3 years ago
- [READ-ONLY] Chain multiple PSR-6 Cache pools together for performance☆11Aug 20, 2026Updated last month
- ☆12May 31, 2023Updated 3 years ago
- MCP server for macOS notifications and sounds when Claude Desktop tasks complete.☆16May 19, 2026Updated 4 months ago
- Code similarity detection using treesitter☆87Sep 22, 2026Updated 3 weeks ago
- Helper plugin for easily creating localize-ready custom post types and custom taxonomies in WordPress☆12Mar 22, 2017Updated 9 years ago
- ☆16Updated this week
- 🌿 Sapling is a Node.js framework for faster-than-light web development.☆13May 11, 2023Updated 3 years ago
- Convert GitHub actions workflows to tangled pipelines and vice versa.☆43Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A correctness-first SCXML 1.0 interpreter (ECMAScript data model) with custom elements for interactive statecharts☆25Oct 10, 2026Updated last week
- Scripts for fbfrog-based FreeBASIC bindings☆18Mar 16, 2025Updated last year
- Analyze Emails☆11Dec 8, 2022Updated 3 years ago
- Essential utils for promises.☆10Nov 30, 2023Updated 2 years ago
- Example of a durable Pi harness running on Cloudflare☆63Updated this week
- Ymir PHP runtime☆18Updated this week
- 🐂 Tiny, portable JS library for parsing and transforming JS/TS/JSX, powered by oxc☆43Updated this week
- Compiler-backed CSS-in-TS for zero-runtime, deterministic styling in design systems.☆66Oct 2, 2026Updated 2 weeks ago
- Spotlight! but for Developers.☆18Dec 5, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Simple WordPress autoloader that will autoload classes or traits with namespace prefix☆14Dec 2, 2019Updated 6 years ago
- Converts CLIP models to ONNX☆11Jan 17, 2023Updated 3 years ago
- An example that shows how to use the Nightmare headless browser to capture web-based visualizations under Node.js.☆15Mar 25, 2024Updated 2 years ago
- REST API for TypeScript linting and type/error checking, leveraging TypeScript TwoSlash for enhanced code analysis. Available as standalo…☆11Jul 24, 2026Updated 2 months ago
- Mousemory remembers cursor position across multiple monitors.☆13Aug 16, 2022Updated 4 years ago
- This implements the python subprocess.communicate tool for rust☆13Nov 14, 2016Updated 9 years ago
- Chat Example Application Using SvelteJS and Chat☆17Dec 16, 2020Updated 5 years ago