transitive-bullshit / compare-tokenizers
A test suite comparing Node.js BPE tokenizers for use with AI models.
☆29Updated last year
Alternatives and similar repositories for compare-tokenizers:
Users that are interested in compare-tokenizers are comparing it to the libraries listed below
- Minimal and opinionated OpenAI client powered by fetch.☆183Updated last month
- Convert Zod schemas to JSON schemas which are optionally compatible with OpenAI's structured outputs.☆16Updated 4 months ago
- hnswlib-node provides Node.js bindings for Hnswlib☆108Updated last week
- JavaScript implementation of LiteLLM.☆113Updated last month
- support for type acquisition with url imports, npm, jsr prefixes☆15Updated 8 months ago
- Yet another library to extract text from MS Office and PDF files☆70Updated 6 months ago
- Partial JSON parser extracted from OpenAI's vendored version.☆13Updated 4 months ago
- 👨💼 LinkedIn API for TypeScript☆36Updated 3 months ago
- Fake Apple AI product launch for April Fool's Day 2023.☆14Updated last year
- ☆35Updated last year
- ☆64Updated last year
- A TypeScript library for building real-time, event-driven applications with XState and Cloudflare Workers. Seamlessly manage distributed …☆49Updated 2 months ago
- Load module from string using require or import.☆50Updated 6 months ago
- ☆130Updated last year
- Node.js bindings for faiss☆118Updated last year
- Distance functions to compare vectors☆70Updated 4 months ago
- Enable your AWS Lambda hosted applications to stream responses via Cloudflare Workers.☆22Updated 2 years ago
- OpenAI Function Calling in Typescript using Zod☆86Updated last year
- Twitter / tweet utils that I find myself reusing often.☆15Updated 9 months ago
- 🏜️ A sandbox that runs user-supplied JavaScript/TypeScript scripts.☆50Updated last year
- 🐤 A minimal viable logger for Prompt/LLM Engineering. Use your IDE as Logging UI - a fast, simple, extensible, zero dependency Node.js l…☆123Updated 10 months ago
- Generate RSC Payloads using an LLM☆37Updated 3 months ago
- A Visual Studio Code extension loads types(.d.ts) for esm.sh imports.☆32Updated 3 months ago
- Merge multiple streams into a unified stream☆56Updated 3 months ago
- Super Simple API framework, type safe, automatic OpenAPI, MCP support, client RPC, streaming with SSE☆32Updated this week
- Programmatically start (AI) sandboxes on top of CodeSandbox☆49Updated this week
- hast utility to transform to estree (JavaScript AST) JSX☆20Updated last month
- Node.js SDK for Browserbase☆32Updated this week
- A memory efficient upload handler for hono.☆21Updated last year
- Securely spawn Deno workers from Node.js☆19Updated last month