Alternatives and similar repositories for llama3-tokenizer-js:

Users that are interested in llama3-tokenizer-js are comparing it to the libraries listed below

• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆351Updated 10 months ago
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆135Updated 10 months ago
• poloclub / mememo
  A JavaScript library that brings vector search and RAG to your browser!
  ☆116Updated 8 months ago
• Shubin123 / kokorojs
  kokoro text to speech using javascript
  ☆56Updated 3 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆173Updated last year
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆54Updated last year
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆47Updated 9 months ago
• babycommando / entity-db
  EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly
  ☆150Updated 4 months ago
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆257Updated 9 months ago
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆237Updated 11 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated last year
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆70Updated 6 months ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆223Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆66Updated last year
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆75Updated 2 months ago
• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆203Updated 8 months ago
• yusufhilmi / client-vector-search
  A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…
  ☆201Updated 11 months ago
• cztomsik / ggml-js
  JavaScript bindings for the ggml-js library
  ☆43Updated last month
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆208Updated 9 months ago
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆102Updated last year
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆178Updated 8 months ago
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆40Updated last year
• themaximalist / llm.js
  Simple LLM library for JavaScript
  ☆58Updated last week
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• PaulKinlan / idb-vector
  A simple vector database built on idb
  ☆85Updated last year
• sam-paech / antislop-sampler
  ☆288Updated last month
• EQ-bench / EQ-Bench
  A benchmark for emotional intelligence in large language models
  ☆289Updated 9 months ago
• jeffrey-fong / Invoker
  The one who calls upon functions - Function-Calling Language Model
  ☆36Updated last year