Alternatives and similar repositories for llama-tokenizer-js

Users that are interested in llama-tokenizer-js are comparing it to the libraries listed below

• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆137Updated 10 months ago
• okuvshynov / slowllama
  Finetune llama2-70b and codellama on MacBook Air without quantization
  ☆447Updated last year
• r2d4 / openlm
  OpenAI-compatible Python client that can call any LLM
  ☆372Updated 2 years ago
• lastmile-ai / llama-retrieval-plugin
  LLaMa retrieval plugin script using OpenAI's retrieval plugin
  ☆323Updated 2 years ago
• lxe / wasm-gpt
  Tensor library for machine learning
  ☆275Updated 2 years ago
• ColinEberhardt / langchain-mini
  🦜️🔗 This is a very simple re-implementation of LangChain, in ~100 lines of code
  ☆253Updated last year
• belladoreai / llama3-tokenizer-js
  JS tokenizer for LLaMA 3 and LLaMA 3.1
  ☆109Updated 2 months ago
• npi-ai / npi
  Action library for AI Agent
  ☆214Updated 2 months ago
• newhouseb / clownfish
  Constrained Decoding for LLMs against JSON Schema
  ☆327Updated 2 years ago
• automorphic-ai / trex
  Enforce structured output from LLMs 100% of the time
  ☆249Updated 10 months ago
• simonmesmith / agentflow
  Complex LLM Workflows from Simple JSON.
  ☆301Updated last year
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆217Updated 11 months ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 9 months ago
• jondurbin / airoboros
  Customizable implementation of the self-instruct paper.
  ☆1,043Updated last year
• SkunkworksAI / hydra-moe
  ☆412Updated last year
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆222Updated last year
• valine / NeuralFlow
  Visualize the intermediate output of Mistral 7B
  ☆363Updated 4 months ago
• yusufhilmi / client-vector-search
  A client side vector search library that can embed, store, search, and cache vectors. Works on the browser and node. It outperforms OpenA…
  ☆203Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• persimmon-ai-labs / adept-inference
  Inference code for Persimmon-8B
  ☆415Updated last year
• llm-edge / hal-9100
  Edge full-stack LLM platform. Written in Rust
  ☆379Updated last year
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆102Updated last year
• cognitivecomputations / OpenChatML
  ☆157Updated 10 months ago
• 567-labs / fastllm
  A collection of LLM services you can self host via docker or modal labs to support your applications development
  ☆187Updated last year
• r2d4 / rellm
  Exact structure out of any language model completion.
  ☆510Updated last year
• amalshehu / langchain-js-realworld
  Langchain realworld examples in JS
  ☆182Updated 3 months ago
• llmonpy / needle-in-a-needlestack
  ☆116Updated 4 months ago
• replicate / cog-llama-template
  LLaMA Cog template
  ☆307Updated last year
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆132Updated 10 months ago
• rmihaylov / falcontune
  Tune any FALCON in 4-bit
  ☆467Updated last year