Alternatives and similar repositories for llama-tokenizer-js

Users that are interested in llama-tokenizer-js are comparing it to the libraries listed below

• lastmile-ai / llama-retrieval-plugin
  LLaMa retrieval plugin script using OpenAI's retrieval plugin
  ☆324Updated 2 years ago
• r2d4 / openlm
  OpenAI-compatible Python client that can call any LLM
  ☆372Updated last year
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆136Updated 10 months ago
• ColinEberhardt / langchain-mini
  🦜️🔗 This is a very simple re-implementation of LangChain, in ~100 lines of code
  ☆253Updated last year
• okuvshynov / slowllama
  Finetune llama2-70b and codellama on MacBook Air without quantization
  ☆448Updated last year
• automorphic-ai / trex
  Enforce structured output from LLMs 100% of the time
  ☆249Updated 9 months ago
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 8 months ago
• simonmesmith / agentflow
  Complex LLM Workflows from Simple JSON.
  ☆299Updated last year
• newhouseb / clownfish
  Constrained Decoding for LLMs against JSON Schema
  ☆327Updated 2 years ago
• dmarcos / llama2.c-web
  Simple repo that compiles and runs llama2.c on the Web
  ☆55Updated last year
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆223Updated last year
• zphang / minimal-llama
  ☆458Updated last year
• definitive-io / code-indexer-loop
  Code Indexer Loop is a Python library for indexing and retrieving source code files through an integrated vector database that's continuo…
  ☆175Updated last year
• llmonpy / needle-in-a-needlestack
  ☆113Updated 3 months ago
• cognitivecomputations / OpenChatML
  ☆156Updated 10 months ago
• abacaj / openhermes-function-calling
  ☆135Updated last year
• belladoreai / llama3-tokenizer-js
  JS tokenizer for LLaMA 3 and LLaMA 3.1
  ☆109Updated 2 months ago
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆147Updated last year
• replicate / cog-llama-template
  LLaMA Cog template
  ☆308Updated last year
• Nuggt-dev / Nuggt
  An Autonomous LLM Agent that runs on Wizcoder-15B
  ☆335Updated 6 months ago
• manyoso / haltt4llm
  This project is an attempt to create a common metric to test LLM's for progress in eliminating hallucinations which is the most serious c…
  ☆222Updated 2 years ago
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆149Updated last year
• declare-lab / flan-alpaca
  This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as…
  ☆352Updated last year
• mshumer / anthropic_with_functions
  ☆198Updated last year
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆102Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• SkunkworksAI / hydra-moe
  ☆412Updated last year
• Birch-san / falcon-play
  Command-line script for inferencing from models such as falcon-7b-instruct
  ☆76Updated last year
• yasyf / compress-gpt
  Self-extracting GPT prompts for ~70% token savings
  ☆218Updated 2 years ago
• lxe / llavavision
  A simple "Be My Eyes" web app with a llama.cpp/llava backend
  ☆489Updated last year