Alternatives and similar repositories for mistral-tokenizer

Users that are interested in mistral-tokenizer are comparing it to the libraries listed below

• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆65Updated 2 years ago
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆141Updated last year
• do-me / SemanticFinder
  SemanticFinder - frontend-only live semantic search with transformers.js
  ☆321Updated 10 months ago
• Technoculture / personal-graph
  Simple Graph Memory for AI applications
  ☆90Updated 8 months ago
• abacaj / openhermes-function-calling
  ☆135Updated 2 years ago
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆106Updated 2 years ago
• granawkins / latent-dictionary
  A dictionary, but it shows you position in embedding space relative to some synonyms/antonyms instead of a definition.
  ☆74Updated 2 months ago
• andreasjansson / AutoCog
  ☆40Updated 8 months ago
• simple-bench / SimpleBench
  ☆190Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated 2 years ago
• IntrinsicLabsAI / grammar-builder
  Generates grammer files from typescript for LLM generation
  ☆38Updated last year
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆100Updated 2 years ago
• nova-land / gbnf-compiler
  Plug n Play GBNF Compiler for llama.cpp
  ☆28Updated 2 years ago
• ChuloAI / oasis
  Local LLaMAs/Models in VSCode
  ☆54Updated 2 years ago
• 0hq / chessgpt
  ☆19Updated 2 years ago
• glaive-ai / function-calling-server
  ☆36Updated 2 years ago
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆363Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆36Updated 2 years ago
• mzbac / mlx-lora
  ☆38Updated last year
• teknium1 / ShareGPT-Builder
  ☆119Updated last year
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆69Updated 2 months ago
• teknium1 / stanford_alpaca-replit
  Modified Stanford-Alpaca Trainer for Training Replit's Code Model
  ☆42Updated 2 years ago
• normal-computing / extended-mind-transformers
  ☆125Updated last year
• tairov / QStarLearning.mojo
  ☆112Updated 2 years ago
• ColinEberhardt / langchain-mini
  🦜️🔗 This is a very simple re-implementation of LangChain, in ~100 lines of code
  ☆254Updated 2 years ago
• bananaml / potassium
  An HTTP serving framework by Banana
  ☆101Updated 2 years ago
• zya / litellmjs
  JavaScript implementation of LiteLLM.
  ☆145Updated 10 months ago
• 567-labs / fastllm
  A collection of LLM services you can self host via docker or modal labs to support your applications development
  ☆198Updated last year
• thegpvc / gpt-aria
  gpt + aria = ability to read browser contents
  ☆73Updated 2 years ago
• Alignment-Lab-AI / Our-Projects
  A repository of projects and datasets under active development by Alignment Lab AI
  ☆22Updated 2 years ago