Alternatives and similar repositories for llama3-tokenizer-js

Users that are interested in llama3-tokenizer-js are comparing it to the libraries listed below

• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆215Updated last year
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆139Updated last year
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆359Updated last year
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆280Updated last year
• do-me / SemanticFinder
  SemanticFinder - frontend-only live semantic search with transformers.js
  ☆296Updated 5 months ago
• yusufhilmi / client-vector-search
  A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…
  ☆217Updated last year
• cztomsik / ggml-js
  JavaScript bindings for the ggml-js library
  ☆44Updated 5 months ago
• praeclarum / transformers-js
  Browser-compatible JS library for running language models
  ☆231Updated 3 years ago
• PaulKinlan / idb-vector
  A simple vector database built on idb
  ☆99Updated last year
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆51Updated last year
• zya / litellmjs
  JavaScript implementation of LiteLLM.
  ☆139Updated 5 months ago
• poloclub / mememo
  A JavaScript library that brings vector search and RAG to your browser!
  ☆142Updated last year
• themaximalist / llm.js
  Universal LLM Interface
  ☆105Updated 2 months ago
• babycommando / entity-db
  EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly
  ☆215Updated 4 months ago
• IntrinsicLabsAI / grammar-builder
  Generates grammer files from typescript for LLM generation
  ☆38Updated last year
• frost-beta / llama3.js
  A JavaScript implementation of Llama 3 using node-mlx.
  ☆73Updated last year
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆160Updated last year
• Anush008 / fastembed-js
  Library to generate vector embeddings in NodeJS
  ☆144Updated this week
• deepfates / hnsw
  Hierarchical Navigable Small Worlds in the browser
  ☆65Updated 8 months ago
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆103Updated 2 years ago
• epicure / llama2.js
  Inference Llama 2 in one file of pure JavaScript(HTML)
  ☆33Updated 3 months ago
• ShravanSunder / hnswlib-wasm
  hnswlib-wasm attempts to create a browser friendly version of hnswlib
  ☆54Updated 2 years ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆176Updated last year
• lucasgelfond / webgpu-sam2
  Segment Anything 2, 100% in the browser (with WebGPU!)
  ☆144Updated 9 months ago
• Locutusque / TinyMistral-train-eval
  The training notebooks that were similar to the original script used to train TinyMistral.
  ☆22Updated last year
• yoshoku / hnswlib-node
  hnswlib-node provides Node.js bindings for Hnswlib
  ☆119Updated last week
• Stevenic / vectra
  Vectra is a local vector database for Node.js with features similar to pinecone but built using local files.
  ☆521Updated 4 months ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆118Updated last year
• frost-beta / node-mlx
  Machine learning framework for Node.js.
  ☆265Updated 4 months ago
• QuixiAI / OpenChatML
  ☆161Updated last month