Alternatives and similar repositories for runpod-vllm

Users that are interested in runpod-vllm are comparing it to the libraries listed below

• fsndzomga / baby_agi_dspy
  a version of baby agi using dspy and typed predictors
  ☆17Updated last year
• omkaark / spotty
  Simple orchestration for EC2 spot containers
  ☆19Updated 9 months ago
• omkaark / agenata
  Build Web Datasets with Ease
  ☆33Updated last year
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 3 months ago
• The-Swarm-Corporation / swarm-ecosystem
  The Swarm Ecosystem
  ☆22Updated 11 months ago
• Attunewise / GPT
  OpenAI GPT hosted Agent Framework for Windows and MacOS
  ☆36Updated last year
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆61Updated last year
• burningion / pydantic-video-editing-agent
  ☆18Updated last week
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• g-aggarwal / mlx-hub
  A python command-line tool to download & manage MLX AI models from Hugging Face.
  ☆18Updated 10 months ago
• TextGeneratorio / text-generator.io
  Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io
  ☆35Updated this week
• cartesia-ai / dev-showcase
  Developer showcase of projects built on Cartesia
  ☆17Updated 10 months ago
• vintrocode / curation-buddy
  Don't bug your friends with articles they'll never read. AI's have infinite attention, leverage them instead! Use the curation buddy to e…
  ☆22Updated last year
• Arbaaz-Mahmood / cognosis-II
  ☆4Updated 10 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 8 months ago
• mzbac / mlx-lora
  ☆38Updated last year
• ivanfioravanti / autogram
  Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.
  ☆82Updated last year
• simonw / llm-anyscale-endpoints
  LLM plugin for models hosted by Anyscale Endpoints
  ☆33Updated last year
• ivanleomk / modal-grpo
  ☆20Updated 4 months ago
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆42Updated 3 weeks ago
• The-Swarm-Corporation / swarms-core
  Multi-threading, Concurrency, Asynchrony, and various Execution Methods implemented in a Rust backend for bleeding edge performance.
  ☆12Updated 8 months ago
• markokraemer / OACE
  ☆22Updated last year
• nateraw / modal-examples
  Apps that run on modal.com
  ☆12Updated last week
• Prismadic / magnet
  the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly
  ☆31Updated 8 months ago
• jmanhype / dspy-self-discover-framework
  Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…
  ☆62Updated last year
• simonw / llm-mlx-llama
  Run Llama 2 using MLX on macOS
  ☆34Updated last year
• spirobel / bunny-llama
  iterate quickly with llama.cpp hot reloading. use the llama.cpp bindings with bun.sh
  ☆50Updated last year
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆58Updated last year
• fxnai / fxn
  Run Python functions on desktop, mobile, web, and in the cloud. https://fxn.ai/explore
  ☆64Updated last week
• AnswerDotAI / llm-ctx
  Create an LLM XML context document from an llms.txt file
  ☆21Updated 10 months ago