Alternatives and similar repositories for llama3-tokenizer-js

Users that are interested in llama3-tokenizer-js are comparing it to the libraries listed below

• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆283Updated last year
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆360Updated last year
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆140Updated last year
• do-me / SemanticFinder
  SemanticFinder - frontend-only live semantic search with transformers.js
  ☆300Updated 7 months ago
• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆219Updated last year
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆50Updated last year
• praeclarum / transformers-js
  Browser-compatible JS library for running language models
  ☆232Updated 3 years ago
• babycommando / entity-db
  EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly
  ☆232Updated 5 months ago
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆53Updated 2 years ago
• themaximalist / llm.js
  Universal LLM Interface
  ☆117Updated last week
• IntrinsicLabsAI / grammar-builder
  Generates grammer files from typescript for LLM generation
  ☆38Updated last year
• cztomsik / ggml-js
  JavaScript bindings for the ggml-js library
  ☆44Updated 7 months ago
• zya / litellmjs
  JavaScript implementation of LiteLLM.
  ☆140Updated 7 months ago
• epicure / llama2.js
  Inference Llama 2 in one file of pure JavaScript(HTML)
  ☆34Updated 5 months ago
• josephrocca / openai-clip-js
  OpenAI's CLIP model ported to JavaScript using the ONNX web runtime
  ☆158Updated 2 years ago
• poloclub / mememo
  A JavaScript library that brings vector search and RAG to your browser!
  ☆152Updated last year
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆177Updated last year
• ShravanSunder / hnswlib-wasm
  hnswlib-wasm attempts to create a browser friendly version of hnswlib
  ☆55Updated 2 years ago
• PaulKinlan / idb-vector
  A simple vector database built on idb
  ☆101Updated last year
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆164Updated last year
• frost-beta / llama3.js
  A JavaScript implementation of Llama 3 using node-mlx.
  ☆72Updated last year
• TimMikeladze / huggingface
  Typescript wrapper for the Hugging Face Inference API.
  ☆28Updated 2 years ago
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆920Updated 3 weeks ago
• nitaiaharoni1 / vector-storage
  Vector Storage is a vector database that enables semantic similarity searches on text documents in the browser's local storage. It uses O…
  ☆237Updated 10 months ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆221Updated last year
• Anush008 / fastembed-js
  Library to generate vector embeddings in NodeJS
  ☆154Updated last month
• pdufour / llm-coder
  In-browser LLM website generator
  ☆50Updated 9 months ago
• hyparam / hyllama
  llama.cpp gguf file parser for javascript
  ☆49Updated 10 months ago
• AlexBuz / llama-zip
  LLM-powered lossless compression tool
  ☆288Updated last year
• yoshoku / hnswlib-node
  hnswlib-node provides Node.js bindings for Hnswlib
  ☆122Updated last week