transitive-bullshit / compare-tokenizers
A test suite comparing Node.js BPE tokenizers for use with AI models.
☆29Updated last year
Alternatives and similar repositories for compare-tokenizers:
Users that are interested in compare-tokenizers are comparing it to the libraries listed below
- Minimal and opinionated OpenAI client powered by fetch.☆183Updated last month
- Convert Zod schemas to JSON schemas which are optionally compatible with OpenAI's structured outputs.☆16Updated 4 months ago
- Audio Visual Playground, or Alien vs Predator? You decide...☆21Updated 4 months ago
- ☆64Updated last year
- A simple, fast, type-safe database on top of Redis☆43Updated last year
- A Visual Studio Code extension loads types(.d.ts) for esm.sh imports.☆32Updated 3 months ago
- support for type acquisition with url imports, npm, jsr prefixes☆15Updated 8 months ago
- A VM module for Node.js that utilizes the secure environment provided by Deno☆73Updated 5 months ago
- Node.js bindings for faiss☆118Updated last year
- 🚉 A typesafe event dispatch system inspired by TRPC☆20Updated last year
- A TypeScript library for building real-time, event-driven applications with XState and Cloudflare Workers. Seamlessly manage distributed …☆49Updated 2 months ago
- Generate RSC Payloads using an LLM☆37Updated 3 months ago
- Build your Cloudflare Workers, on Cloudflare Workers☆17Updated 2 years ago
- 🏜️ A sandbox that runs user-supplied JavaScript/TypeScript scripts.☆50Updated last year
- Super Simple API framework, type safe, automatic OpenAPI, MCP support, client RPC, streaming with SSE☆32Updated this week
- WebContainers, except it's a million times easier to use☆65Updated last year
- Split large texts into chunks with a maximum number of tokens. Split by fixed size or by sentence.☆28Updated 11 months ago
- This Tailwind CSS plugin provides custom variants to apply styles to apps that are running on the ToDesktop platform☆18Updated last year
- tRPC for extension and web 🧩🕸️☆31Updated 9 months ago
- ☆30Updated this week
- Partial JSON parser extracted from OpenAI's vendored version.☆13Updated 4 months ago
- Distance functions to compare vectors☆69Updated 3 months ago
- AI functions for Typescript☆79Updated last year
- 🪵 Fast effective logging for Cloudflare Workers☆54Updated 3 months ago
- OpenAI Function Calling in Typescript using Zod☆86Updated last year
- A simple vector database built on idb☆76Updated last year
- Web SDK for Promptable Website.☆36Updated 2 years ago
- CloudFlare API wrapper☆22Updated 4 months ago
- JavaScript implementation of LiteLLM.☆113Updated 3 weeks ago
- Hot module reloading for nodejs☆96Updated last week