a lightweight no-dependency fork from transformers.js (only tokenizers)
☆32Jan 21, 2026Updated 2 months ago
Alternatives and similar repositories for tokenizers
Users that are interested in tokenizers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Node.js module providing inference APIs for large language models, with simple CLI.☆23Dec 7, 2024Updated last year
- LLM agent to generate workflow UML diagrams☆17Mar 25, 2024Updated 2 years ago
- 🔍 A code review tool with Github by ChatGPT☆15Jul 23, 2024Updated last year
- Potential Adaptive/Resposive Layouts for the Thematic Theme☆16Jul 7, 2011Updated 14 years ago
- ☆20Updated this week
- Data for our analysis of Amtrak 188 derailment.☆10May 14, 2015Updated 10 years ago
- AIOps (Papers, Tutorials, and Datasets)☆14Feb 8, 2021Updated 5 years ago
- A collection of TurboRepo CLI tools to test, lint, build, version and publish packages in your Turborepo monorepo☆11Mar 17, 2026Updated last week
- Render React apps on multiple clients synced via WebRTC☆11Mar 21, 2015Updated 11 years ago
- A static deobfuscator for JavaScript Malware☆13May 6, 2020Updated 5 years ago
- WIP☆10Jun 19, 2024Updated last year
- a python interface to ableton .als files.☆11Oct 7, 2015Updated 10 years ago
- A typesafe TS assertion library☆53Mar 4, 2023Updated 3 years ago
- CAL-ACCESS Campaign Power Search☆13Nov 2, 2017Updated 8 years ago
- A command-line tool that fetches data from google spreadsheets and saves it as json in the filesystem.☆10May 12, 2015Updated 10 years ago
- ☆10Jul 17, 2025Updated 8 months ago
- ☆16Feb 21, 2026Updated last month
- Implement FlashAttention v2 with minimal code to learn.☆15Jun 12, 2024Updated last year
- A woodcut inspired map for city streets.☆11Apr 29, 2015Updated 10 years ago
- A work in progress theme generator for the UI components by shadcn☆13May 2, 2023Updated 2 years ago
- See https://github.com/bsky-watch/plc-mirror instead☆14Nov 18, 2024Updated last year
- An ArchieML parser for Python☆11Dec 25, 2015Updated 10 years ago
- Javascript Library for Hecate, the persistent, mutable data store focused on GeoJSON first interchange☆16Apr 18, 2024Updated last year
- Multi-turn dataset management tool for LLM trainers☆12Mar 31, 2025Updated 11 months ago
- A tiny JavaScript snippet to make links snappy on touch devices☆180Aug 26, 2014Updated 11 years ago
- generate rules from lists of words☆16Jul 9, 2021Updated 4 years ago
- presentation for nicar 2011 (an exploration into the concepts behind backbone.js)☆12Feb 24, 2011Updated 15 years ago
- Predicator, a Rust crate for generating and running dynamic code☆16Sep 25, 2018Updated 7 years ago
- Responsive minimalist theme for the Ghost publishing platform☆19Apr 12, 2015Updated 10 years ago
- An example that shows how to use the Nightmare headless browser to capture web-based visualizations under Node.js.☆15Mar 25, 2024Updated last year
- ☆12Jul 28, 2021Updated 4 years ago
- writable stream for creating, appending, and replacing tables in cartodb☆11Nov 15, 2024Updated last year
- ☆10Sep 12, 2025Updated 6 months ago
- ☆18Oct 16, 2013Updated 12 years ago
- Example repository showing how to transform React to introduce i18n☆11Dec 26, 2024Updated last year
- Lightweight embedded key-value store/database Rust library☆11Oct 28, 2021Updated 4 years ago
- Zero allocation macros for retrieving multiple mutable indices from a mutable slice safely.☆15Jul 21, 2024Updated last year
- Nested lists published on GitHub.☆13Sep 7, 2022Updated 3 years ago
- A demo repo designed to benchmark Gatsby build times for sites with lots of large images. Full tutorial:☆12Feb 25, 2020Updated 6 years ago