transitive-bullshit / compare-tokenizers
A test suite comparing Node.js BPE tokenizers for use with AI models.
☆29Updated 11 months ago
Related projects ⓘ
Alternatives and complementary repositories for compare-tokenizers
- LLM tools used in production at Dexa☆77Updated last week
- JavaScript implementation of LiteLLM.☆95Updated 10 months ago
- OpenAI Function Calling in Typescript using Zod☆83Updated 10 months ago
- Minimal and opinionated OpenAI client powered by fetch.☆179Updated 2 weeks ago
- hnswlib-node provides Node.js bindings for Hnswlib☆100Updated this week
- OpenAI's tiktoken but with node bindings☆104Updated 5 months ago
- ☆61Updated last year
- A TypeScript library for building real-time, event-driven applications with XState and Cloudflare Workers. Seamlessly manage distributed …☆42Updated 3 weeks ago
- WebContainers, except it's a million times easier to use☆29Updated last year
- Web SDK for Promptable Website.☆36Updated last year
- Vercel AI Provider for running Large Language Models locally using LLamaCpp☆25Updated 6 months ago
- Convert Zod schemas to JSON schemas which are optionally compatible with OpenAI's structured outputs.☆13Updated 3 weeks ago
- Twitter / tweet utils that I find myself reusing often.☆15Updated 5 months ago
- Node.js bindings for faiss☆109Updated last year
- A VM module for Node.js that utilizes the secure environment provided by Deno☆69Updated 2 months ago
- Find unused class variables and methods in a typescript project☆18Updated last year
- ☆13Updated last year
- TypeScript library to access python functions in NodeJS, type-safe and easy to use.☆61Updated last year
- Undo Redo Manager☆38Updated 5 months ago
- A Cloudflare Page showing how to do semantic search☆45Updated last year
- Generate RSC Payloads using an LLM☆35Updated last week
- 🛒 An Open Source Headless cart management library that does all the heavy lifting of managing the cart state, storing them in local stor…☆15Updated last year
- Yet another library to extract text from MS Office and PDF files☆60Updated 3 months ago
- Export any Kindle book you own as text, PDF, EPUB, or as a custom, AI-narrated audiobook. 🔥☆41Updated 3 weeks ago
- A simple vector database built on idb☆67Updated 10 months ago
- ☆26Updated last year
- AI functions for Typescript☆79Updated last year
- Pushing pixels on 2d canvas☆34Updated 4 months ago
- ☆13Updated 9 months ago
- Starter template for building ModelFusion terminal apps with TypeScript.☆13Updated 8 months ago