Alternatives and similar repositories for lemonade

Users that are interested in lemonade are comparing it to the libraries listed below

• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆187Updated last week
• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆198Updated 2 weeks ago
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆111Updated last week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆608Updated this week
• iluxu / llmbasedos
  Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.
  ☆247Updated this week
• theroyallab / YALS
  ☆78Updated this week
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆183Updated this week
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆214Updated last year
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆308Updated 3 months ago
• teabranch / open-responses-server
  Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…
  ☆58Updated last week
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆77Updated this week
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆86Updated this week
• AMD-AIG-AIMA / Instella
  Fully Open Language Models with Stellar Performance
  ☆231Updated 2 weeks ago
• TheProxyCompany / proxy-structuring-engine
  Guaranteed Structured Output from any Language Model via Hierarchical State Machines
  ☆136Updated 3 weeks ago
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆48Updated last month
• kalavai-net / kalavai-client
  Turns devices into a scalable LLM platform
  ☆144Updated last week
• google-ai-edge / LiteRT-LM
  ☆234Updated this week
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆94Updated this week
• matteoserva / GraphLLM
  ☆204Updated last month
• chigkim / Ollama-MMLU-Pro
  ☆95Updated 6 months ago
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆86Updated 7 months ago
• amd / gaia
  Run LLM Agents on Ryzen AI PCs in Minutes
  ☆421Updated last week
• Anemll / anemll-bench
  ☆28Updated 3 months ago
• StacklokLabs / mockllm
  MockLLM, when you want it to do what you tell it to do!
  ☆54Updated last week
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆349Updated 9 months ago
• platinum-hill / cobolt
  This is a cross-platform desktop application that allows you to chat with locally hosted LLMs and enjoy features like MCP support
  ☆221Updated last week
• andrewkchan / deepseek.cpp
  CPU inference for the DeepSeek family of large language models in C++
  ☆302Updated 3 weeks ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆184Updated last week
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆408Updated last week
• fairydreaming / llama.cpp
  LLM inference in C/C++
  ☆21Updated 3 months ago