Alternatives and similar repositories for cot_proxy

Users that are interested in cot_proxy are comparing it to the libraries listed below

• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• rodrigobaron / anthill
  ☆24Updated 3 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆61Updated this week
• fairydreaming / lineage-bench
  Testing LLM reasoning abilities with lineage relationship quizzes.
  ☆27Updated 2 months ago
• iluxu / llmbasedos
  Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.
  ☆98Updated this week
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆80Updated 5 months ago
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆71Updated 7 months ago
• Forest-Person / smolResearcher
  Use smol agents to do research and then update csv coumns with its findings.
  ☆40Updated 3 months ago
• pnmartinez / simple-computer-use
  Open source implementation for computer use, using light OCR models and LLMs.
  ☆21Updated this week
• hypergrok / chunkit
  Convert URLs into LLM-friendly markdown chunks
  ☆64Updated 8 months ago
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆91Updated 9 months ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆115Updated 11 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆54Updated 9 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆62Updated 3 months ago
• menloresearch / ichigo-demo
  ☆91Updated this week
• multiplexerai / Complex-to-Simple-RAG
  ☆39Updated last year
• severian42 / Computational-Model-for-Symbolic-Representations
  Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …
  ☆49Updated 3 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆40Updated 2 months ago
• cognitivecomputations / dolphin-logger
  ☆72Updated last week
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆61Updated 8 months ago
• FarFetchd / sleepyllama
  an auto-sleeping and -waking framework around llama.cpp
  ☆11Updated 3 months ago
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆40Updated last year
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 8 months ago
• zenforic / csm-multi
  Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…
  ☆23Updated last month
• teknium1 / ShareGPT-Builder
  ☆114Updated 4 months ago
• TC-Zheng / ActuosusAI
  AI management tool
  ☆115Updated 6 months ago
• AaronFeng753 / Qwen3-Gemini2.5
  Make Qwen3 Think like Gemini 2.5 Pro | Open webui function
  ☆19Updated last week
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆116Updated 5 months ago
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆91Updated 10 months ago