transitive-bullshit / compare-tokenizers
A test suite comparing Node.js BPE tokenizers for use with AI models.
☆29Updated 11 months ago
Related projects ⓘ
Alternatives and complementary repositories for compare-tokenizers
- Convert Zod schemas to JSON schemas which are optionally compatible with OpenAI's structured outputs.☆13Updated last month
- OpenAI Function Calling in Typescript using Zod☆84Updated 11 months ago
- Audio Visual Playground, or Alien vs Predator? You decide...☆22Updated last month
- OpenAI's tiktoken but with node bindings☆104Updated 6 months ago
- Minimal and opinionated OpenAI client powered by fetch.☆180Updated last week
- JavaScript implementation of LiteLLM.☆97Updated 10 months ago
- LLM tools used in production at Dexa☆79Updated last week
- A Cloudflare Page showing how to do semantic search☆46Updated last year
- Generate RSC Payloads using an LLM☆35Updated 3 weeks ago
- Node.js bindings for faiss☆110Updated last year
- Partial JSON parser extracted from OpenAI's vendored version.☆13Updated last month
- hnswlib-node provides Node.js bindings for Hnswlib☆100Updated this week
- Pushing pixels on 2d canvas☆34Updated 4 months ago
- A Workers AI provider for the vercel AI SDK☆45Updated 3 months ago
- ☆13Updated last year
- support for type acquisition with url imports, npm, jsr prefixes☆14Updated 5 months ago
- Yet another library to extract text from MS Office and PDF files☆62Updated 4 months ago
- tRPC for extension and web 🧩🕸️☆25Updated 7 months ago
- 🏜️ A sandbox that runs user-supplied JavaScript/TypeScript scripts.☆45Updated last year
- Library to generate vector embeddings in NodeJS☆85Updated last week
- An example for using Vercel AI SDK with Hono☆24Updated 2 months ago
- Chat, with Durable Objects☆69Updated last week
- Simple, opinionated, JSON-typed, and traced LLM framework for TypeScript.☆35Updated 8 months ago
- A memory efficient upload handler for hono.☆17Updated 9 months ago
- Twitter / tweet utils that I find myself reusing often.☆15Updated 6 months ago
- Vercel AI Provider for running Large Language Models locally using LLamaCpp☆25Updated 6 months ago
- Enable your AWS Lambda hosted applications to stream responses via Cloudflare Workers.☆22Updated last year
- ☆62Updated last year
- Load module from string using require or import.☆49Updated 3 months ago