Alternatives and similar repositories for llama3-tokenizer-js

Users that are interested in llama3-tokenizer-js are comparing it to the libraries listed below

• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆221Updated last year
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆284Updated last year
• do-me / SemanticFinder
  SemanticFinder - frontend-only live semantic search with transformers.js
  ☆308Updated 8 months ago
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆141Updated last year
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆362Updated last year
• yusufhilmi / client-vector-search
  A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…
  ☆222Updated last year
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆51Updated last year
• praeclarum / transformers-js
  Browser-compatible JS library for running language models
  ☆232Updated 3 years ago
• poloclub / mememo
  A JavaScript library that brings vector search and RAG to your browser!
  ☆157Updated last year
• themaximalist / llm.js
  Universal LLM Interface
  ☆121Updated last month
• zya / litellmjs
  JavaScript implementation of LiteLLM.
  ☆142Updated 8 months ago
• Shubin123 / kokorojs
  kokoro text to speech using javascript
  ☆63Updated 10 months ago
• epicure / llama2.js
  Inference Llama 2 in one file of pure JavaScript(HTML)
  ☆34Updated 6 months ago
• cztomsik / ggml-js
  JavaScript bindings for the ggml-js library
  ☆44Updated 3 weeks ago
• babycommando / entity-db
  EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly
  ☆257Updated 7 months ago
• josephrocca / openai-clip-js
  OpenAI's CLIP model ported to JavaScript using the ONNX web runtime
  ☆157Updated 2 years ago
• frost-beta / llama3.js
  A JavaScript implementation of Llama 3 using node-mlx.
  ☆73Updated last year
• IntrinsicLabsAI / grammar-builder
  Generates grammer files from typescript for LLM generation
  ☆38Updated last year
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆164Updated 2 years ago
• hyparam / hyllama
  llama.cpp gguf file parser for javascript
  ☆50Updated 11 months ago
• dmarcos / llama2.c-web
  Simple repo that compiles and runs llama2.c on the Web
  ☆58Updated 2 years ago
• ShravanSunder / hnswlib-wasm
  hnswlib-wasm attempts to create a browser friendly version of hnswlib
  ☆59Updated 2 years ago
• imoneoi / mistral-tokenizer
  ☆21Updated last year
• xenova / phonemizer.js
  Simple text to phones converter using eSpeak NG.
  ☆40Updated 10 months ago
• lucasgelfond / webgpu-sam2
  Segment Anything 2, 100% in the browser (with WebGPU!)
  ☆157Updated 11 months ago
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆106Updated 2 years ago
• PaulKinlan / idb-vector
  A simple vector database built on idb
  ☆101Updated last year
• deepfates / hnsw
  Hierarchical Navigable Small Worlds in the browser
  ☆66Updated 3 weeks ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆179Updated last year
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆54Updated 2 years ago