Alternatives and similar repositories for llama-cpp-guidance

Users that are interested in llama-cpp-guidance are comparing it to the libraries listed below

• mzbac / mlx-lora
  ☆38Updated last year
• nova-land / gbnf-compiler
  Plug n Play GBNF Compiler for llama.cpp
  ☆25Updated last year
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆45Updated 8 months ago
• cognitivecomputations / kraken
  ☆66Updated last year
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆50Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆66Updated last year
• multiplexerai / Complex-to-Simple-RAG
  ☆39Updated last year
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆87Updated last week
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆75Updated last year
• itsPreto / VECTR8
  Embed anything.
  ☆28Updated last year
• Maximilian-Winter / llama_cpp_function_calling
  ☆30Updated last year
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆26Updated 7 months ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• teknium1 / ShareGPT-Builder
  ☆113Updated 5 months ago
• deployradiant / pychatml
  Chat Markup Language conversation library
  ☆55Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆181Updated last year
• pipizhaoa / Pandalyst
  large language model for mastering data analysis using pandas
  ☆47Updated last year
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 6 months ago
• emrgnt-cmplxty / zero-shot-replication
  ☆72Updated last year
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• OoriData / OgbujiPT
  Client-side toolkit for using large language models, including where self-hosted
  ☆111Updated 6 months ago
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆108Updated 10 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆72Updated 8 months ago
• neoxelox / dspy-inspector
  DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.
  ☆35Updated last year
• jeffrey-fong / Invoker
  The one who calls upon functions - Function-Calling Language Model
  ☆36Updated last year
• spyglass-search / talos
  Easily create LLM automation/agent workflows
  ☆59Updated last year
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆90Updated 4 months ago