Alternatives and similar repositories for llama-tokenizer-js:

Users that are interested in llama-tokenizer-js are comparing it to the libraries listed below

• okuvshynov / slowllama
  Finetune llama2-70b and codellama on MacBook Air without quantization
  ☆447Updated 10 months ago
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆134Updated 7 months ago
• automorphic-ai / trex
  Enforce structured output from LLMs 100% of the time
  ☆246Updated 7 months ago
• r2d4 / openlm
  OpenAI-compatible Python client that can call any LLM
  ☆371Updated last year
• valine / NeuralFlow
  Visualize the intermediate output of Mistral 7B
  ☆339Updated 3 weeks ago
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆222Updated 9 months ago
• newhouseb / clownfish
  Constrained Decoding for LLMs against JSON Schema
  ☆325Updated last year
• ColinEberhardt / langchain-mini
  🦜️🔗 This is a very simple re-implementation of LangChain, in ~100 lines of code
  ☆251Updated last year
• simonmesmith / agentflow
  Complex LLM Workflows from Simple JSON.
  ☆291Updated last year
• cognitivecomputations / OpenChatML
  ☆152Updated 7 months ago
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆127Updated 7 months ago
• lastmile-ai / llama-retrieval-plugin
  LLaMa retrieval plugin script using OpenAI's retrieval plugin
  ☆324Updated last year
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 5 months ago
• catid / self-discover
  Implementation of Google's SELF-DISCOVER
  ☆289Updated 6 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• belladoreai / llama3-tokenizer-js
  JS tokenizer for LLaMA 3 and LLaMA 3.1
  ☆103Updated 6 months ago
• amalshehu / langchain-js-realworld
  Langchain realworld examples in JS
  ☆180Updated last week
• apoorvumang / prompt-lookup-decoding
  ☆502Updated 5 months ago
• persimmon-ai-labs / adept-inference
  Inference code for Persimmon-8B
  ☆416Updated last year
• lxe / wasm-gpt
  Tensor library for machine learning
  ☆278Updated last year
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆222Updated this week
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆147Updated last year
• definitive-io / code-indexer-loop
  Code Indexer Loop is a Python library for indexing and retrieving source code files through an integrated vector database that's continuo…
  ☆171Updated 10 months ago
• nitaiaharoni1 / vector-storage
  Vector Storage is a vector database that enables semantic similarity searches on text documents in the browser's local storage. It uses O…
  ☆214Updated 2 months ago
• do-me / SemanticFinder
  SemanticFinder - frontend-only live semantic search with transformers.js
  ☆251Updated 2 months ago
• replicate / cog-llama-template
  LLaMA Cog template
  ☆308Updated last year
• meistrari / cursive-py
  ✦ The intuitive python LLM framework
  ☆171Updated 2 months ago
• SkunkworksAI / hydra-moe
  ☆412Updated last year
• declare-lab / flan-alpaca
  This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as…
  ☆350Updated last year
• mquan / api2ai
  Create API agents from OpenAPI Specs
  ☆178Updated last year