Alternatives and similar repositories for llama3-tokenizer-js

Users that are interested in llama3-tokenizer-js are comparing it to the libraries listed below

• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆353Updated 11 months ago
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆137Updated 11 months ago
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆269Updated 11 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆173Updated last year
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆55Updated 2 years ago
• pdufour / llm-coder
  In-browser LLM website generator
  ☆49Updated 4 months ago
• babycommando / entity-db
  EntityDB is an in-browser vector database wrapping indexedDB and Transformers.js over WebAssembly
  ☆178Updated last month
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆222Updated last year
• do-me / SemanticFinder
  SemanticFinder - frontend-only live semantic search with transformers.js
  ☆277Updated 2 months ago
• epicure / llama2.js
  Inference Llama 2 in one file of pure JavaScript(HTML)
  ☆33Updated last month
• Shubin123 / kokorojs
  kokoro text to speech using javascript
  ☆58Updated 4 months ago
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆102Updated 2 years ago
• cztomsik / ggml-js
  JavaScript bindings for the ggml-js library
  ☆43Updated 3 months ago
• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆209Updated 9 months ago
• IntrinsicLabsAI / grammar-builder
  Generates grammer files from typescript for LLM generation
  ☆38Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆66Updated last year
• yusufhilmi / client-vector-search
  A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…
  ☆209Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆183Updated last year
• frost-beta / llama3.js
  A JavaScript implementation of Llama 3 using node-mlx.
  ☆73Updated 11 months ago
• Locutusque / TinyMistral-train-eval
  The training notebooks that were similar to the original script used to train TinyMistral.
  ☆22Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆47Updated 10 months ago
• zya / litellmjs
  JavaScript implementation of LiteLLM.
  ☆127Updated 3 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• cognitivecomputations / OpenChatML
  ☆157Updated 11 months ago
• TheProxyCompany / proxy-structuring-engine
  Guaranteed Structured Output from any Language Model via Hierarchical State Machines
  ☆136Updated 3 weeks ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated last year
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆68Updated last year
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆78Updated last year