Alternatives and similar repositories for compare-tokenizers

Users that are interested in compare-tokenizers are comparing it to the libraries listed below

• dexaai / openai-fetch
  Minimal and opinionated OpenAI client powered by fetch.
  ☆191Updated 6 months ago
• yoshoku / hnswlib-node
  hnswlib-node provides Node.js bindings for Hnswlib
  ☆115Updated 2 weeks ago
• holdenmatt / openai-zod-functions
  OpenAI Function Calling in Typescript using Zod
  ☆89Updated last year
• ceifa / tiktoken-node
  OpenAI's tiktoken but with node bindings
  ☆105Updated last year
• mljs / distance
  Distance functions to compare vectors
  ☆72Updated 9 months ago
• sindresorhus / merge-streams
  Merge multiple streams into a unified stream
  ☆57Updated 9 months ago
• oramasearch / chunker
  Split large texts into chunks with a maximum number of tokens. Split by fixed size or by sentence.
  ☆32Updated last year
• transitive-bullshit / openai-partial-json-parser
  Partial JSON parser extracted from OpenAI's vendored version.
  ☆13Updated 2 weeks ago
• platformatic / mcp-node
  ☆49Updated 3 months ago
• remorses / spiceflow
  Super Simple API framework, type safe, automatic OpenAPI, MCP support, client RPC, streaming with SSE
  ☆64Updated this week
• souporserious / tsxmod
  Refactor code, migrate to new APIs, and better understand your codebase.
  ☆113Updated 11 months ago
• galvez / fastify-edge
  Use Fastify idioms for writing Cloudflare Workers and Bun servers
  ☆99Updated last year
• val-town / deno-ata
  support for type acquisition with url imports, npm, jsr prefixes
  ☆16Updated last year
• Ethan-Arrowood / mddl
  markdown documentation language
  ☆31Updated 2 weeks ago
• sindresorhus / p-mutex
  Async mutex lock for managing access to a shared resource
  ☆128Updated 3 weeks ago
• sachinraja / uttp
  write your request handlers once, run anywhere
  ☆36Updated 3 months ago
• jamiebuilds / cirbuf
  A tiny and fast circular buffer
  ☆54Updated 2 years ago
• isaacs / catcher
  ☆126Updated last year
• gamemaker1 / office-text-extractor
  Yet another library to extract text from MS Office and PDF files
  ☆80Updated last year
• Anush008 / fastembed-js
  Library to generate vector embeddings in NodeJS
  ☆136Updated 3 months ago
• transitive-bullshit / scikit-learn-ts
  Powerful machine learning library for Node.js – uses Python's scikit-learn under the hood.
  ☆198Updated 2 weeks ago
• transitive-bullshit / pnpm-update-catalogs
  pnpm update for pnpm workspace catalogs.
  ☆13Updated 4 months ago
• maraisr / workers-logger
  🪵 Fast effective logging for Cloudflare Workers
  ☆56Updated 9 months ago
• JacksonKearl / gjp-4-gpt
  JSON parser for streaming objects live from an LLM's output
  ☆34Updated last year
• josephrocca / gpt-2-3-tokenizer
  GPT-2/3 tokenizer based on @latitudegames/GPT-3-Encoder that works in the browser and Deno
  ☆32Updated last year
• malerba118 / pkgbox
  Experimental browser ide for building typescript libraries.
  ☆49Updated last year
• alvarlagerlof / rsc-generator
  Generate RSC Payloads using an LLM
  ☆38Updated 9 months ago
• exuanbo / module-from-string
  Load module from string using require or import.
  ☆52Updated last year
• transitive-bullshit / linkedin-api
  👨‍💼 LinkedIn API for TypeScript
  ☆46Updated 2 weeks ago
• beerose / semantic-search
  🕵️‍♀️ An OpenAI-powered CLI to build a semantic search index from your MDX files.
  ☆92Updated 2 years ago