Alternatives and similar repositories for cot_proxy:

Users that are interested in cot_proxy are comparing it to the libraries listed below

• thooton / muse
  Let's create synthetic textbooks together :)
  ☆74Updated last year
• yamalight / litlytics
  🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis
  ☆97Updated 4 months ago
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆89Updated last year
• menloresearch / ichigo-demo
  ☆91Updated 2 months ago
• av / klmbr
  klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs
  ☆71Updated 6 months ago
• Forest-Person / smolResearcher
  Use smol agents to do research and then update csv coumns with its findings.
  ☆37Updated last month
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆87Updated 7 months ago
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated 11 months ago
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆91Updated 9 months ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆115Updated 10 months ago
• Technoculture / personal-graph
  Simple Graph Memory for AI applications
  ☆84Updated 8 months ago
• multiplexerai / Complex-to-Simple-RAG
  ☆39Updated last year
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆114Updated 3 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• yoheinakajima / autofinetune
  auto fine tune of models with synthetic data
  ☆75Updated last year
• amirrezasalimi / synthify
  Synthify: Seamlessly generate ai datasets with a no-code UI | https://synthify.toolstack.run
  ☆48Updated last month
• teknium1 / ShareGPT-Builder
  ☆111Updated 3 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆73Updated 3 months ago
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆71Updated 3 weeks ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆62Updated last month
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆59Updated 7 months ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated last year
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆46Updated 5 months ago
• remichu-ai / gallama
  ☆125Updated this week
• mshumer / portal
  ☆29Updated 3 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 6 months ago
• RichardAragon / MultiAgentLLM
  ☆53Updated last year
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 3 weeks ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆55Updated last month