a lightweight no-dependency fork from transformers.js (only tokenizers)
☆32Jan 21, 2026Updated 3 months ago
Alternatives and similar repositories for tokenizers
Users that are interested in tokenizers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Node.js module providing inference APIs for large language models, with simple CLI.☆23Dec 7, 2024Updated last year
- Embedded, small and composable Zero-Trust Teamserver made for collaborative Go programs or CLI applications.☆13Jul 10, 2025Updated 9 months ago
- 🫠 A drop-in replacement for Go errors, with some added sugar! Error handling in Go made easy with codes, messages and more. Failure is y…☆14Sep 12, 2022Updated 3 years ago
- Go package to produce a repomap based on tree-sitter☆15Jan 29, 2025Updated last year
- mapreader is a tiny Golang library for accessing arbitrary keys from maps - especially useful when dealing with semi-unknown JSON payload…☆18Aug 13, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A collection of TurboRepo CLI tools to test, lint, build, version and publish packages in your Turborepo monorepo☆11Apr 13, 2026Updated 3 weeks ago
- A static deobfuscator for JavaScript Malware☆13May 6, 2020Updated 6 years ago
- WIP☆10Jun 19, 2024Updated last year
- A typesafe TS assertion library☆53Mar 4, 2023Updated 3 years ago
- ☆10Apr 12, 2026Updated 3 weeks ago
- A React renderer for FINAL FANTASY XIV☆20Jun 2, 2025Updated 11 months ago
- CafeKit is a library to display chinese tooltips of items and actions in FFXIV on any webpages easily.☆11Jul 2, 2024Updated last year
- ☆12May 21, 2025Updated 11 months ago
- Implement FlashAttention v2 with minimal code to learn.☆16Jun 12, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A work in progress theme generator for the UI components by shadcn☆13May 2, 2023Updated 3 years ago
- See https://github.com/bsky-watch/plc-mirror instead☆14Nov 18, 2024Updated last year
- My dotfiles☆10Apr 17, 2026Updated 2 weeks ago
- Awesome curated list of coding assistants and related resources☆57Apr 12, 2024Updated 2 years ago
- A frontend for your PDS☆24Oct 20, 2025Updated 6 months ago
- 一个试图缝合 minecract(mc), factorio(fto), 戴森球计划(dsp) 等同类游戏的工厂模拟游戏项目☆17Mar 16, 2025Updated last year
- generate rules from lists of words☆16Jul 9, 2021Updated 4 years ago
- Simple proxy app made with HTML, Css, Javascript. Get random free Http/Https proxies.☆12Aug 25, 2024Updated last year
- ☆13Apr 15, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆12Jul 28, 2021Updated 4 years ago
- Example of using Elysia with OpenTelemetry☆14Jul 13, 2024Updated last year
- ☆10Sep 12, 2025Updated 7 months ago
- ☆18Oct 16, 2013Updated 12 years ago
- 🐶 a multithreaded wrapper around `uglify`☆10Nov 10, 2017Updated 8 years ago
- Example repository showing how to transform React to introduce i18n☆11Dec 26, 2024Updated last year
- A TypeScript-first strictly typed utility helper library☆12Jan 5, 2024Updated 2 years ago
- Manage an active index that needs to be contained or wrapped.☆16Oct 18, 2023Updated 2 years ago
- A demo repo designed to benchmark Gatsby build times for sites with lots of large images. Full tutorial:☆12Feb 25, 2020Updated 6 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆14Aug 28, 2025Updated 8 months ago
- Build Remix sites using Notion☆16Feb 4, 2023Updated 3 years ago
- Adsensor is an anti-fraud and cloaking tool built in PHP and JS☆15Nov 8, 2018Updated 7 years ago
- A small function for converting HTML to Markdown.☆15Sep 24, 2023Updated 2 years ago
- Example app for using Visly with Next.js☆11Dec 15, 2020Updated 5 years ago
- Notebook and companion R script for the "R Basics: Stats" session at NICAR 2016.☆11Mar 13, 2016Updated 10 years ago
- Load and run Llama from safetensors files in C☆15Oct 24, 2024Updated last year