Alternatives and similar repositories for gpt-2-3-tokenizer

Users that are interested in gpt-2-3-tokenizer are comparing it to the libraries listed below

• yoshoku / hnswlib-node
  hnswlib-node provides Node.js bindings for Hnswlib
  ☆117Updated this week
• transitive-bullshit / compare-tokenizers
  A test suite comparing Node.js BPE tokenizers for use with AI models.
  ☆31Updated last year
• Motif-Archived / yfs
  Synchronize text files between browser and disk using Yjs and the File System Access API
  ☆176Updated 2 years ago
• beerose / semantic-search
  🕵️‍♀️ An OpenAI-powered CLI to build a semantic search index from your MDX files.
  ☆92Updated 2 years ago
• pocesar / react-use-comlink
  Three ways to use Comlink web workers through React Hooks (and in a typesafe manner).
  ☆50Updated 5 years ago
• zxch3n / loro-react-flow-example
  ☆14Updated 10 months ago
• valtiojs / valtio-persist
  ☆95Updated 3 months ago
• alloc / use-element-size
  Track the size of a react-dom element in 540 bytes (without ResizeObserver)
  ☆16Updated 2 years ago
• dexaai / openai-fetch
  Minimal and opinionated OpenAI client powered by fetch.
  ☆191Updated 7 months ago
• praeclarum / web-transformers
  Transformer neural networks in the browser
  ☆91Updated 2 years ago
• scandinavianairlines / remix-workers-poc
  A proof of concept for adding Remix loaders and actions in a service-worker
  ☆12Updated 2 years ago
• streamich / thingies
  Kitchen sink of helpful utilities.
  ☆54Updated last week
• joeltg / react-lezer-highlighter
  A tiny syntax highlighter for React using Lezer parsers
  ☆40Updated 6 months ago
• pomber / record-talk-with-remotion
  ☆51Updated 4 years ago
• dzucconi / use-keyboard-list-navigation
  A React hook to navigate through lists with your keyboard
  ☆16Updated last year
• microlinkhq / splashy
  Given any image (GIF, PNG, WebP, AVIF, etc) extract predominant & palette colors.
  ☆114Updated 3 weeks ago
• oramasearch / chunker
  Split large texts into chunks with a maximum number of tokens. Split by fixed size or by sentence.
  ☆34Updated last year
• astahmer / jotai-yjs
  jotai-yjs makes yjs state even easier
  ☆39Updated 4 years ago
• drivly / state.do
  Finite State Machine implementation with Durable Objects
  ☆45Updated 11 months ago
• zasource-dev / React-Serialize
  ☆43Updated 2 years ago
• Interactions-as-a-Service / esbuild-worker-demo
  Build your Cloudflare Workers, on Cloudflare Workers
  ☆19Updated 2 years ago
• joebobmiles / y-react
  React bindings for Yjs.
  ☆34Updated last year
• jquense / jarle
  Just Another React Live Editor
  ☆66Updated 3 months ago
• srsholmes / react-code-input
  A minimal Code Input Component for react JS.
  ☆59Updated 2 years ago
• holepunchto / tiny-fs-native
  Native fs for Javascript
  ☆24Updated last year
• bradyjoslin / encrypt-workers-kv
  Encrypted put and get functions for Cloudflare Workers KV
  ☆37Updated 2 years ago
• n1ru4l / react-use-transition
  ☆13Updated last week
• Kikobeats / reachable-url
  Given an URL, it resolves as fast as possible, performing a GET without downloading the body.
  ☆42Updated 3 weeks ago
• fabiospampinato / lande
  A tiny neural network for natural language detection.
  ☆84Updated last year
• soederpop / active-mdx
  Use collections of MDX files as a database
  ☆15Updated 3 years ago