Alternatives and similar repositories for llama-cpp-guidance:

Users that are interested in llama-cpp-guidance are comparing it to the libraries listed below

• nexusflowai / nexusraven-pip
  ☆38Updated last year
• nova-land / gbnf-compiler
  Plug n Play GBNF Compiler for llama.cpp
  ☆24Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆66Updated last year
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated last year
• jeffrey-fong / Invoker
  The one who calls upon functions - Function-Calling Language Model
  ☆36Updated last year
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆45Updated 6 months ago
• mzbac / mlx-lora
  ☆38Updated last year
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆74Updated last year
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆86Updated last month
• wassname / prob_jsonformer
  Generate Structured JSON with probs from Language Models
  ☆16Updated 3 weeks ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆50Updated 10 months ago
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆25Updated 5 months ago
• neoxelox / dspy-inspector
  DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.
  ☆33Updated last year
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• teknium1 / ShareGPT-Builder
  ☆112Updated 3 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆67Updated 5 months ago
• itsPreto / VECTR8
  Embed anything.
  ☆29Updated 10 months ago
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆55Updated last year
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆75Updated last year
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 7 months ago
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆147Updated last year
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated last year
• spyglass-search / talos
  Easily create LLM automation/agent workflows
  ☆59Updated last year
• emrgnt-cmplxty / SmolTrainer
  ☆20Updated last year
• kerekovskik / autologic
  autologic is a Python package that implements the SELF-DISCOVER framework proposed in the paper SELF-DISCOVER: Large Language Models Self…
  ☆57Updated last year
• cognitivecomputations / OpenChatML
  ☆153Updated 8 months ago
• bodaay / HuggingChatAllInOne
  One Repo To Quickly Build One Docker File for HuggingChat Front and BackEnd
  ☆26Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆183Updated 11 months ago