Alternatives and similar repositories for mistral-tokenizer

Users that are interested in mistral-tokenizer are comparing it to the libraries listed below

• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆141Updated last year
• abacaj / openhermes-function-calling
  ☆135Updated 2 years ago
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆65Updated 2 years ago
• IntrinsicLabsAI / grammar-builder
  Generates grammer files from typescript for LLM generation
  ☆38Updated last year
• mzbac / mlx-lora
  ☆38Updated last year
• 567-labs / fastllm
  A collection of LLM services you can self host via docker or modal labs to support your applications development
  ☆198Updated last year
• cfahlgren1 / natural-functions
  Mistral-7B finetuned for function calling
  ☆16Updated 2 years ago
• dzhng / llamaflow
  The Typescript-first prompt engineering toolkit for working with chat based LLMs.
  ☆112Updated 2 years ago
• ColinEberhardt / langchain-mini
  🦜️🔗 This is a very simple re-implementation of LangChain, in ~100 lines of code
  ☆253Updated 2 years ago
• TheMind-AI / fluid-db
  Fluid Database
  ☆113Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated 2 years ago
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆362Updated last year
• glaive-ai / function-calling-server
  ☆36Updated last year
• taylorai / mlx_embedding_models
  run embeddings in MLX
  ☆97Updated last year
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆76Updated 2 years ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆100Updated last year
• markokraemer / OACE
  ☆22Updated last year
• granawkins / latent-dictionary
  A dictionary, but it shows you position in embedding space relative to some synonyms/antonyms instead of a definition.
  ☆74Updated 2 months ago
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆78Updated last year
• do-me / SemanticFinder
  SemanticFinder - frontend-only live semantic search with transformers.js
  ☆320Updated 10 months ago
• Technoculture / personal-graph
  Simple Graph Memory for AI applications
  ☆90Updated 8 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆32Updated 2 years ago
• hrishioa / wasm-ai
  Vercel and web-llm template to run wasm models directly in the browser.
  ☆169Updated 2 years ago
• llmco / llamaapi-python
  ☆92Updated 2 years ago
• jamesmurdza / codechain
  Code generation with LLMs 🔗
  ☆53Updated 2 years ago
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆84Updated last year
• zya / litellmjs
  JavaScript implementation of LiteLLM.
  ☆145Updated 10 months ago
• QuixiAI / OpenChatML
  ☆165Updated 5 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆69Updated 2 months ago
• foobarbaz-inc / conversation-memory-streamlit
  Demo of ConversationEntityMemory in Streamlit.
  ☆52Updated 3 years ago