Alternatives and similar repositories for llama3-tokenizer-js:

Users that are interested in llama3-tokenizer-js are comparing it to the libraries listed below

• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆350Updated 8 months ago
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆136Updated 8 months ago
• Shubin123 / kokorojs
  kokoro text to speech using javascript
  ☆55Updated last month
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated 10 months ago
• cognitivecomputations / OpenChatML
  ☆152Updated 8 months ago
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆233Updated 9 months ago
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆47Updated 7 months ago
• zya / litellmjs
  JavaScript implementation of LiteLLM.
  ☆118Updated 2 months ago
• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆188Updated 6 months ago
• TheProxyCompany / proxy-structuring-engine
  Dynamically structure language models to produce outputs that adhere to specific requirements without sacrificing their creative capabili…
  ☆118Updated last week
• sam-paech / antislop-sampler
  ☆273Updated last month
• babycommando / entity-db
  EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly
  ☆137Updated 2 months ago
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆71Updated 2 weeks ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆224Updated 10 months ago
• Vaibhavs10 / github-issue-generator-webgpu
  ☆36Updated 3 months ago
• bdambrosio / AllTheWorldAPlay
  All the world is a play, we are but actors in it.
  ☆47Updated this week
• frost-beta / node-mlx
  Machine learning framework for Node.js.
  ☆193Updated this week
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆38Updated last year
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆244Updated 7 months ago
• rogeriochaves / driver
  ☆125Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• LeonEricsson / llmcontext
  Pressure testing the context window of open LLMs
  ☆23Updated 6 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆171Updated 10 months ago
• do-me / SemanticFinder
  SemanticFinder - frontend-only live semantic search with transformers.js
  ☆263Updated 3 months ago
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆215Updated 5 months ago
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆178Updated 7 months ago
• teknium1 / ShareGPT-Builder
  ☆111Updated 3 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆85Updated 7 months ago
• themaximalist / llm.js
  Simple LLM library for JavaScript
  ☆50Updated last month