Alternatives and similar repositories for llama-tokenizer-js

Users that are interested in llama-tokenizer-js are comparing it to the libraries listed below

• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆140Updated last year
• r2d4 / openlm
  OpenAI-compatible Python client that can call any LLM
  ☆372Updated 2 years ago
• okuvshynov / slowllama
  Finetune llama2-70b and codellama on MacBook Air without quantization
  ☆448Updated last year
• lastmile-ai / llama-retrieval-plugin
  LLaMa retrieval plugin script using OpenAI's retrieval plugin
  ☆323Updated 2 years ago
• lxe / wasm-gpt
  Tensor library for machine learning
  ☆273Updated 2 years ago
• ColinEberhardt / langchain-mini
  🦜️🔗 This is a very simple re-implementation of LangChain, in ~100 lines of code
  ☆254Updated last year
• automorphic-ai / trex
  Enforce structured output from LLMs 100% of the time
  ☆250Updated last year
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆151Updated 2 years ago
• newhouseb / clownfish
  Constrained Decoding for LLMs against JSON Schema
  ☆329Updated 2 years ago
• valine / NeuralFlow
  Visualize the intermediate output of Mistral 7B
  ☆371Updated 8 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆223Updated last year
• do-me / SemanticFinder
  SemanticFinder - frontend-only live semantic search with transformers.js
  ☆299Updated 6 months ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆118Updated last year
• belladoreai / llama3-tokenizer-js
  JS tokenizer for LLaMA 3 and LLaMA 3.1
  ☆116Updated 2 months ago
• simonmesmith / agentflow
  Complex LLM Workflows from Simple JSON.
  ☆311Updated 2 years ago
• persimmon-ai-labs / adept-inference
  Inference code for Persimmon-8B
  ☆414Updated 2 years ago
• llmonpy / needle-in-a-needlestack
  ☆116Updated 8 months ago
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆137Updated last year
• lxe / llavavision
  A simple "Be My Eyes" web app with a llama.cpp/llava backend
  ☆492Updated last year
• definitive-io / code-indexer-loop
  Code Indexer Loop is a Python library for indexing and retrieving source code files through an integrated vector database that's continuo…
  ☆176Updated last year
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆221Updated last year
• kuutsav / llm-toys
  Small finetuned LLMs for a diverse set of useful tasks
  ☆128Updated 2 years ago
• pulzeai-oss / knn-router
  ☆111Updated last year
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆104Updated 2 years ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆455Updated 2 years ago
• mithril-security / blind_chat
  A fully in-browser privacy solution to make Conversational AI privacy-friendly
  ☆230Updated 11 months ago
• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆217Updated last year
• QuixiAI / OpenChatML
  ☆162Updated 2 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated 2 years ago