Alternatives and similar repositories for compare-tokenizers

Users that are interested in compare-tokenizers are comparing it to the libraries listed below

• dexaai / openai-fetch
  Minimal and opinionated OpenAI client powered by fetch.
  ☆194Updated 10 months ago
• ceifa / tiktoken-node
  OpenAI's tiktoken but with node bindings
  ☆106Updated last year
• mljs / distance
  Distance functions to compare vectors
  ☆74Updated 3 weeks ago
• yoshoku / hnswlib-node
  hnswlib-node provides Node.js bindings for Hnswlib
  ☆123Updated this week
• holdenmatt / openai-zod-functions
  OpenAI Function Calling in Typescript using Zod
  ☆91Updated last year
• jumploops / magic
  AI functions for Typescript
  ☆79Updated 2 years ago
• sindresorhus / merge-streams
  Merge multiple streams into a unified stream
  ☆59Updated last year
• oramasearch / chunker
  Split large texts into chunks with a maximum number of tokens. Split by fixed size or by sentence.
  ☆34Updated last year
• Anush008 / fastembed-js
  Library to generate vector embeddings in NodeJS
  ☆156Updated 2 months ago
• tmcdos / custompatch
  Tool for patching buggy NPM packages without forking them
  ☆29Updated 3 months ago
• exuanbo / module-from-string
  Load module from string using require or import.
  ☆53Updated last year
• ewfian / faiss-node
  Node.js bindings for faiss
  ☆138Updated 2 years ago
• transitive-bullshit / scikit-learn-ts
  Powerful machine learning library for Node.js – uses Python's scikit-learn under the hood.
  ☆208Updated 4 months ago
• val-town / codemirror-codeium
  Codeium code completion integration for CodeMirror 6
  ☆83Updated 2 months ago
• val-town / deno-ata
  support for type acquisition with url imports, npm, jsr prefixes
  ☆16Updated last year
• sachinraja / uttp
  write your request handlers once, run anywhere
  ☆36Updated 6 months ago
• remorses / spiceflow
  Super Simple API framework, type safe, automatic OpenAPI, MCP support, client RPC, streaming with SSE
  ☆74Updated 3 weeks ago
• jacob-ebey / cf-lambda-streaming
  Enable your AWS Lambda hosted applications to stream responses via Cloudflare Workers.
  ☆23Updated 2 years ago
• casual-simulation / node-deno-vm
  A VM module for Node.js that utilizes the secure environment provided by Deno
  ☆84Updated 6 months ago
• josephrocca / gpt-2-3-tokenizer
  GPT-2/3 tokenizer based on @latitudegames/GPT-3-Encoder that works in the browser and Deno
  ☆32Updated 2 years ago
• fabiospampinato / lande
  A tiny neural network for natural language detection.
  ☆85Updated 2 years ago
• jamiebuilds / cirbuf
  A tiny and fast circular buffer
  ☆54Updated 2 years ago
• TimMikeladze / huggingface
  Typescript wrapper for the Hugging Face Inference API.
  ☆28Updated 2 years ago
• ccontrols / structured-types
  Extract structured type information from javascript and typescript files
  ☆60Updated 3 years ago
• overlookmotel / livepack
  Serialize live running code to Javascript
  ☆47Updated 10 months ago
• ryanflorence / basic-cf-pages-template
  Basic Cloudflare Pages template
  ☆16Updated last year
• JacksonKearl / gjp-4-gpt
  JSON parser for streaming objects live from an LLM's output
  ☆36Updated last year
• OutdatedVersion / trpc-sse-link
  Send tRPC `subscription`s over Server-sent-events
  ☆23Updated last year
• beerose / semantic-search
  🕵️‍♀️ An OpenAI-powered CLI to build a semantic search index from your MDX files.
  ☆92Updated 2 years ago
• zaguiini / typescript-virtual-barrel
  Stop manually creating and managing barrel files!
  ☆34Updated last year