a lightweight no-dependency fork from transformers.js (only tokenizers)
☆32May 16, 2026Updated last week
Alternatives and similar repositories for tokenizers
Users that are interested in tokenizers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Node.js module providing inference APIs for large language models, with simple CLI.☆24Dec 7, 2024Updated last year
- Helps you manage and autosave your extension's options, separately for each additional permission☆18Apr 4, 2026Updated last month
- Embedded, small and composable Zero-Trust Teamserver made for collaborative Go programs or CLI applications.☆13Jul 10, 2025Updated 10 months ago
- macOS touchid authentication library☆12Jul 21, 2023Updated 2 years ago
- Go Based Lightweight RAG / LLM Tool with CLI + API☆14Sep 28, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Go package with more powerful, flexible, and safe API for regular expressions based on lazy iterators☆15Apr 14, 2025Updated last year
- Scalable concurrent go pipeline for running multi-step async processes☆11Aug 16, 2023Updated 2 years ago
- 🌍 It is Simple & Flexible Web Search Library for DuckDuckGo, Qwant, Google, Yandex, Bing and a lot of more search providers☆16May 17, 2023Updated 3 years ago
- ☆20Updated this week
- mapreader is a tiny Golang library for accessing arbitrary keys from maps - especially useful when dealing with semi-unknown JSON payload…☆18Aug 13, 2024Updated last year
- A static deobfuscator for JavaScript Malware☆13May 6, 2020Updated 6 years ago
- WIP☆10Jun 19, 2024Updated last year
- rotating proxy server☆11Sep 17, 2024Updated last year
- ✂️ OpenAI's tiktoken tokenizer written in Go☆20Jan 31, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆10Apr 12, 2026Updated last month
- Apple iOS / macOS Assets.car decoder, write in golang☆17Feb 26, 2025Updated last year
- ☆16Feb 21, 2026Updated 3 months ago
- A work in progress theme generator for the UI components by shadcn☆13May 2, 2023Updated 3 years ago
- See https://github.com/bsky-watch/plc-mirror instead☆14Nov 18, 2024Updated last year
- Awesome curated list of coding assistants and related resources☆57Apr 12, 2024Updated 2 years ago
- A frontend for your PDS☆25Oct 20, 2025Updated 7 months ago
- A Go API for generating .go source files☆24Jul 12, 2022Updated 3 years ago
- Spotlight! but for Developers.☆18Dec 5, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A number of PHP CLI based classes and helpers☆21Apr 13, 2016Updated 10 years ago
- Bookmarking app for atproto☆15Updated this week
- This implements the python subprocess.communicate tool for rust☆13Nov 14, 2016Updated 9 years ago
- Simple proxy app made with HTML, Css, Javascript. Get random free Http/Https proxies.☆12Aug 25, 2024Updated last year
- ☆13Apr 15, 2024Updated 2 years ago
- ☆12Jul 28, 2021Updated 4 years ago
- Example of using Elysia with OpenTelemetry☆14Jul 13, 2024Updated last year
- An LLM-powered chatbot for fediverse. A tech demo for BotKit.☆14Dec 20, 2025Updated 5 months ago
- Example repository showing how to transform React to introduce i18n☆11Dec 26, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Lightweight embedded key-value store/database Rust library☆11Oct 28, 2021Updated 4 years ago
- Monorepo of open source npm packages by Valu Digital.☆13Mar 13, 2026Updated 2 months ago
- The Poor Man's Web Components☆14Oct 31, 2016Updated 9 years ago
- ☆14Aug 28, 2025Updated 8 months ago
- Build Remix sites using Notion☆16Feb 4, 2023Updated 3 years ago
- Adsensor is an anti-fraud and cloaking tool built in PHP and JS☆15Nov 8, 2018Updated 7 years ago
- A small function for converting HTML to Markdown.☆15Sep 24, 2023Updated 2 years ago