Alternatives and similar repositories for compare-tokenizers

Users that are interested in compare-tokenizers are comparing it to the libraries listed below

• dexaai / openai-fetch
  Minimal and opinionated OpenAI client powered by fetch.
  ☆194Updated 11 months ago
• mljs / distance
  Distance functions to compare vectors
  ☆75Updated 2 months ago
• yoshoku / hnswlib-node
  hnswlib-node provides Node.js bindings for Hnswlib
  ☆127Updated 2 weeks ago
• oramasearch / chunker
  Split large texts into chunks with a maximum number of tokens. Split by fixed size or by sentence.
  ☆34Updated last year
• sindresorhus / merge-streams
  Merge multiple streams into a unified stream
  ☆62Updated last year
• exuanbo / module-from-string
  Load module from string using require or import.
  ☆53Updated last year
• holdenmatt / openai-zod-functions
  OpenAI Function Calling in Typescript using Zod
  ☆91Updated 2 years ago
• gamemaker1 / office-text-extractor
  Yet another library to extract text from MS Office and PDF files
  ☆84Updated this week
• prisma / accelerate-speed-test
  ☆22Updated 4 months ago
• souporserious / tsxmod
  Refactor code, migrate to new APIs, and better understand your codebase.
  ☆113Updated last year
• jacob-ebey / cf-lambda-streaming
  Enable your AWS Lambda hosted applications to stream responses via Cloudflare Workers.
  ☆23Updated 2 years ago
• overlookmotel / livepack
  Serialize live running code to Javascript
  ☆47Updated last year
• ceifa / tiktoken-node
  OpenAI's tiktoken but with node bindings
  ☆106Updated last year
• replit / codemirror-vscode-keymap
  VSCode keyboard shortcuts for CodeMirror 6
  ☆42Updated 2 years ago
• jumploops / magic
  AI functions for Typescript
  ☆78Updated 2 years ago
• TimMikeladze / huggingface
  Typescript wrapper for the Hugging Face Inference API.
  ☆28Updated 2 years ago
• ewfian / faiss-node
  Node.js bindings for faiss
  ☆138Updated 2 years ago
• SukkaW / fast-escape-regexp
  Fastest, plain JavaScript-based, regexp escaping library for JavaScript, works in both Node.js and browser.
  ☆45Updated 3 months ago
• rickyrobinett / langchainjs-workers
  ☆68Updated 2 years ago
• remorses / spiceflow
  Super Simple API framework, type safe, automatic OpenAPI, MCP support, client RPC, streaming with SSE
  ☆81Updated 3 weeks ago
• Interactions-as-a-Service / esbuild-worker-demo
  Build your Cloudflare Workers, on Cloudflare Workers
  ☆19Updated 3 years ago
• transitive-bullshit / openai-zod-to-json-schema
  Convert Zod schemas to JSON schemas which are optionally compatible with OpenAI's structured outputs.
  ☆20Updated 5 months ago
• val-town / deno-ata
  support for type acquisition with url imports, npm, jsr prefixes
  ☆16Updated last year
• Anush008 / fastembed-js
  Generate vector embeddings in NodeJS
  ☆169Updated 2 weeks ago
• jacob-ebey / cf-react-server-template
  An experimental playground starting point to build React Server applications on the Cloudflare platform using Vite.
  ☆16Updated 11 months ago
• transitive-bullshit / openai-partial-json-parser
  Partial JSON parser extracted from OpenAI's vendored version.
  ☆14Updated 5 months ago
• botisan-ai / gpt3-tokenizer
  Isomorphic JavaScript/TypeScript Tokenizer for GPT-3 and Codex Models by OpenAI.
  ☆172Updated 2 years ago
• sindresorhus / temporary-path
  Get a random temporary path
  ☆34Updated 2 years ago
• maraisr / workers-logger
  🪵 Fast effective logging for Cloudflare Workers
  ☆56Updated last year
• Ethan-Arrowood / mddl
  markdown documentation language
  ☆31Updated 5 months ago