Alternatives and similar repositories for cot_proxy:

Users that are interested in cot_proxy are comparing it to the libraries listed below

• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆87Updated 8 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆77Updated 4 months ago
• rodrigobaron / anthill
  ☆24Updated 3 months ago
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆39Updated last year
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆90Updated 10 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆56Updated 2 months ago
• hypergrok / chunkit
  Convert URLs into LLM-friendly markdown chunks
  ☆64Updated 7 months ago
• pnmartinez / simple-computer-use
  Open source implementation for computer use, using light OCR models and LLMs.
  ☆18Updated last week
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆71Updated 7 months ago
• cognitivecomputations / kraken
  ☆66Updated 11 months ago
• theroyallab / YALS
  ☆60Updated this week
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• tolitius / towel
  "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"
  ☆48Updated 6 months ago
• itsPreto / VECTR8
  Embed anything.
  ☆29Updated 11 months ago
• menloresearch / ichigo-demo
  ☆91Updated 3 months ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆115Updated 11 months ago
• severian42 / Computational-Model-for-Symbolic-Representations
  Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …
  ☆49Updated 2 months ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆90Updated 3 months ago
• mzbac / mlx-lora
  ☆38Updated last year
• chigkim / Ollama-MMLU-Pro
  ☆85Updated 4 months ago
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆62Updated 2 months ago
• desik1998 / MathWithLLMs
  ☆49Updated 11 months ago
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆89Updated last year
• mshumer / portal
  ☆29Updated 4 months ago
• yoheinakajima / babyagi_og
  The original BabyAGI, updated with LiteLLM and no vector database reliance (csv instead)
  ☆21Updated 6 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆54Updated 8 months ago
• FarFetchd / sleepyllama
  an auto-sleeping and -waking framework around llama.cpp
  ☆11Updated 2 months ago
• Birch-san / falcon-play
  Command-line script for inferencing from models such as falcon-7b-instruct
  ☆76Updated last year
• multiplexerai / Complex-to-Simple-RAG
  ☆39Updated last year