Alternatives and similar repositories for mistral-tokenizer

Users that are interested in mistral-tokenizer are comparing it to the libraries listed below

• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• mzbac / mlx-lora
  ☆38Updated last year
• nexusflowai / nexusraven-pip
  ☆38Updated last year
• markokraemer / OACE
  ☆22Updated 10 months ago
• andreasjansson / AutoCog
  ☆39Updated this week
• FL33TW00D / laserbeak
  Add local LLMs to your Web or Electron apps! Powered by Rust + WebGPU
  ☆102Updated last year
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆136Updated 10 months ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• glaive-ai / function-calling-server
  ☆35Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• abacaj / openhermes-function-calling
  ☆135Updated last year
• omkaark / agenata
  Build Web Datasets with Ease
  ☆33Updated 10 months ago
• abetlen / ai-voice-chat
  Browser-based Voice Assistant
  ☆44Updated 2 years ago
• bananaml / potassium
  An HTTP serving framework by Banana
  ☆98Updated last year
• hwchase17 / chain-of-verification
  ☆32Updated last year
• swyxio / openlangmem
  ☆47Updated last year
• modal-labs / mistral-finetuning
  ☆32Updated last year
• Technoculture / personal-graph
  Simple Graph Memory for AI applications
  ☆84Updated 9 months ago
• video-db / ocr-benchmark
  Benchmarking Vision-Language Models on OCR tasks in Dynamic Video Environments
  ☆38Updated 3 months ago
• yoheinakajima / predictivechat
  Demo of AI chatbot that predicts user message to generate response quickly.
  ☆102Updated last year
• shrahimim / Boosting-Theory-of-Mind-in-LLMs-with-Prompting
  ☆32Updated 2 years ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• cfahlgren1 / natural-functions
  Mistral-7B finetuned for function calling
  ☆16Updated last year
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆47Updated 9 months ago
• teknium1 / stanford_alpaca-replit
  Modified Stanford-Alpaca Trainer for Training Replit's Code Model
  ☆40Updated last year
• ialacol / text-inference-batcher
  A high performance batching router optimises max throughput for text inference workload
  ☆16Updated last year
• ggerganov / seamless_communication
  Foundational Models for State-of-the-Art Speech and Text Translation
  ☆31Updated last year
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆149Updated last year
• tedcheng / ai-hackers-field-manual
  ☆22Updated last year
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆54Updated last year