Alternatives and similar repositories for llama-tokenizer-js

Users that are interested in llama-tokenizer-js are comparing it to the libraries listed below

• okuvshynov / slowllama
  Finetune llama2-70b and codellama on MacBook Air without quantization
  ☆448Updated last year
• ColinEberhardt / langchain-mini
  🦜️🔗 This is a very simple re-implementation of LangChain, in ~100 lines of code
  ☆254Updated last year
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆139Updated last year
• lxe / wasm-gpt
  Tensor library for machine learning
  ☆275Updated 2 years ago
• lastmile-ai / llama-retrieval-plugin
  LLaMa retrieval plugin script using OpenAI's retrieval plugin
  ☆323Updated 2 years ago
• automorphic-ai / trex
  Enforce structured output from LLMs 100% of the time
  ☆249Updated last year
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆118Updated 11 months ago
• simonmesmith / agentflow
  Complex LLM Workflows from Simple JSON.
  ☆308Updated last year
• r2d4 / openlm
  OpenAI-compatible Python client that can call any LLM
  ☆372Updated 2 years ago
• do-me / SemanticFinder
  SemanticFinder - frontend-only live semantic search with transformers.js
  ☆290Updated 4 months ago
• newhouseb / clownfish
  Constrained Decoding for LLMs against JSON Schema
  ☆329Updated 2 years ago
• dmarcos / llama2.c-web
  Simple repo that compiles and runs llama2.c on the Web
  ☆57Updated last year
• yusufhilmi / client-vector-search
  A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…
  ☆216Updated last year
• definitive-io / code-indexer-loop
  Code Indexer Loop is a Python library for indexing and retrieving source code files through an integrated vector database that's continuo…
  ☆175Updated last year
• replicate / cog-llama-template
  LLaMA Cog template
  ☆306Updated last year
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆274Updated last year
• praeclarum / transformers-js
  Browser-compatible JS library for running language models
  ☆228Updated 2 years ago
• belladoreai / llama3-tokenizer-js
  JS tokenizer for LLaMA 3 and LLaMA 3.1
  ☆116Updated last week
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆221Updated last year
• iaalm / llama-api-server
  A OpenAI API compatible REST server for llama.
  ☆208Updated 5 months ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆456Updated last year
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆151Updated 2 years ago
• lxe / llavavision
  A simple "Be My Eyes" web app with a llama.cpp/llava backend
  ☆490Updated last year
• rahuldshetty / llm.js
  Run Large-Language Models (LLMs) 🚀 directly in your browser!
  ☆212Updated 10 months ago
• nestordemeure / question_extractor
  Generate question/answer training pairs out of raw text.
  ☆227Updated last year
• valine / NeuralFlow
  Visualize the intermediate output of Mistral 7B
  ☆367Updated 6 months ago
• ggml-org / p1
  LLM-based code completion engine
  ☆194Updated 6 months ago
• llmonpy / needle-in-a-needlestack
  ☆116Updated 6 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆146Updated last year