belladoreai / llama3-tokenizer-jsLinks
JS tokenizer for LLaMA 3 and LLaMA 3.1
β117Updated 5 months ago
Alternatives and similar repositories for llama3-tokenizer-js
Users that are interested in llama3-tokenizer-js are comparing it to the libraries listed below
Sorting:
- Run Large-Language Models (LLMs) π directly in your browser!β222Updated last year
- TypeScript generator for llama.cpp Grammar directly from TypeScript interfacesβ141Updated last year
- A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.β51Updated last year
- JS tokenizer for LLaMA 1 and 2β362Updated last year
- WebAssembly (Wasm) Build and Bindings for llama.cppβ285Updated last year
- SemanticFinder - frontend-only live semantic search with transformers.jsβ319Updated 9 months ago
- Browser-compatible JS library for running language modelsβ232Updated 3 years ago
- A JavaScript library that brings vector search and RAG to your browser!β158Updated last year
- Generates grammer files from typescript for LLM generationβ38Updated last year
- A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenAβ¦β224Updated last year
- JavaScript implementation of LiteLLM.β145Updated 9 months ago
- JavaScript bindings for the ggml-js libraryβ45Updated 2 months ago
- EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssemblyβ261Updated 8 months ago
- Inference Llama 2 in one file of pure JavaScript(HTML)β35Updated 7 months ago
- A JavaScript implementation of Llama 3 using node-mlx.β74Updated last year
- OpenAI's CLIP model ported to JavaScript using the ONNX web runtimeβ157Updated 2 years ago
- Vercel and web-llm template to run wasm models directly in the browser.β166Updated 2 years ago
- Universal LLM Interfaceβ129Updated 2 months ago
- Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPUβ107Updated 2 years ago
- kokoro text to speech using javascriptβ63Updated 11 months ago
- Generate vector embeddings in NodeJSβ170Updated last month
- A simple vector database built on idbβ102Updated 2 years ago
- Vector Storage is a vector database that enables semantic similarity searches on text documents in the browser's local storage. It uses Oβ¦β242Updated last year
- Low-Rank adapter extraction for fine-tuned transformers modelsβ180Updated last year
- llama.cpp gguf file parser for javascriptβ50Updated last year
- hnswlib-wasm attempts to create a browser friendly version of hnswlibβ62Updated 2 years ago
- β33Updated 2 years ago
- LLM-powered lossless compression toolβ298Updated 2 weeks ago
- Cog wrapper for Coqui / xtts-v2β80Updated last year
- hnswlib-node provides Node.js bindings for Hnswlibβ130Updated last week