Alternatives and similar repositories for compare-tokenizers:

Users that are interested in compare-tokenizers are comparing it to the libraries listed below

• val-town / deno-ata
  support for type acquisition with url imports, npm, jsr prefixes
  ☆15Updated 9 months ago
• ewfian / faiss-node
  Node.js bindings for faiss
  ☆121Updated last year
• oramasearch / chunker
  Split large texts into chunks with a maximum number of tokens. Split by fixed size or by sentence.
  ☆29Updated last year
• sister-software / gpt-token-utils
  Isomorphic utilities for GPT-3 tokenization and prompt building.
  ☆11Updated last year
• sindresorhus / merge-streams
  Merge multiple streams into a unified stream
  ☆56Updated 4 months ago
• remorses / spiceflow
  Super Simple API framework, type safe, automatic OpenAPI, MCP support, client RPC, streaming with SSE
  ☆43Updated this week
• mljs / distance
  Distance functions to compare vectors
  ☆70Updated 5 months ago
• janek26 / trpc-browser
  tRPC for extension and web 🧩🕸️
  ☆36Updated 3 weeks ago
• transitive-bullshit / openai-partial-json-parser
  Partial JSON parser extracted from OpenAI's vendored version.
  ☆13Updated 5 months ago
• dexaai / openai-fetch
  Minimal and opinionated OpenAI client powered by fetch.
  ☆184Updated 2 months ago
• yoshoku / hnswlib-node
  hnswlib-node provides Node.js bindings for Hnswlib
  ☆108Updated last week
• transitive-bullshit / openai-zod-to-json-schema
  Convert Zod schemas to JSON schemas which are optionally compatible with OpenAI's structured outputs.
  ☆17Updated 5 months ago
• esm-dev / vscode
  A Visual Studio Code extension loads types(.d.ts) for esm.sh imports.
  ☆33Updated 4 months ago
• healeycodes / deno-script-sandbox
  🏜️ A sandbox that runs user-supplied JavaScript/TypeScript scripts.
  ☆51Updated last year
• zya / litellmjs
  JavaScript implementation of LiteLLM.
  ☆118Updated 2 months ago
• rickyrobinett / langchainjs-workers
  ☆65Updated last year
• Ethan-Arrowood / mddl
  markdown documentation language
  ☆30Updated 5 months ago
• holdenmatt / openai-zod-functions
  OpenAI Function Calling in Typescript using Zod
  ☆87Updated last year
• TimMikeladze / huggingface
  Typescript wrapper for the Hugging Face Inference API.
  ☆27Updated 2 years ago
• oramasearch / cloudflare-api
  CloudFlare API wrapper
  ☆22Updated 5 months ago
• alvarlagerlof / rsc-generator
  Generate RSC Payloads using an LLM
  ☆38Updated 4 months ago
• WebReflection / buffer-to-base64
  A base64 encoder/decoder with gzip or deflate abilities.
  ☆36Updated 4 months ago
• ToDesktop / tailwind-variants
  This Tailwind CSS plugin provides custom variants to apply styles to apps that are running on the ToDesktop platform
  ☆18Updated last year
• jacob-ebey / cf-lambda-streaming
  Enable your AWS Lambda hosted applications to stream responses via Cloudflare Workers.
  ☆23Updated 2 years ago
• casual-simulation / node-deno-vm
  A VM module for Node.js that utilizes the secure environment provided by Deno
  ☆75Updated 7 months ago
• Anush008 / fastembed-js
  Library to generate vector embeddings in NodeJS
  ☆109Updated 4 months ago
• TMeerhof / fractional-indexing-jittered
  ☆32Updated 2 months ago
• exuanbo / module-from-string
  Load module from string using require or import.
  ☆50Updated 7 months ago
• josephrocca / gpt-2-3-tokenizer
  GPT-2/3 tokenizer based on @latitudegames/GPT-3-Encoder that works in the browser and Deno
  ☆32Updated last year