Alternatives and similar repositories for runpod-vllm:

Users that are interested in runpod-vllm are comparing it to the libraries listed below

• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 2 weeks ago
• mzbac / mlx-lora
  ☆38Updated last year
• TextGeneratorio / text-generator.io
  Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io
  ☆35Updated last week
• fsndzomga / baby_agi_dspy
  a version of baby agi using dspy and typed predictors
  ☆17Updated last year
• g-aggarwal / mlx-hub
  A python command-line tool to download & manage MLX AI models from Hugging Face.
  ☆17Updated 7 months ago
• cartesia-ai / dev-showcase
  Developer showcase of projects built on Cartesia
  ☆17Updated 7 months ago
• agentsea / agentd
  A daemon that makes a desktop OS accessible to AI agents
  ☆25Updated last week
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆58Updated last year
• modal-labs / cadre
  🛠 Self-hosted, fast, and consistent remote configuration for apps.
  ☆15Updated 2 years ago
• vintrocode / curation-buddy
  Don't bug your friends with articles they'll never read. AI's have infinite attention, leverage them instead! Use the curation buddy to e…
  ☆22Updated 11 months ago
• alexminnaar / Diagify
  convert natural language into technical diagrams
  ☆14Updated 4 months ago
• jmanhype / dspy-self-discover-framework
  Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…
  ☆60Updated 9 months ago
• markokraemer / OACE
  ☆22Updated 9 months ago
• yasyf / anthropic-computer-use-modal
  Anthropic Computer Use with Modal Sandboxes
  ☆31Updated 6 months ago
• seanchatmangpt / dslmodel
  Structured outputs from DSPy and Jinja2
  ☆23Updated 4 months ago
• mshumer / portal
  ☆29Updated 4 months ago
• simonw / llm-mlx-llama
  Run Llama 2 using MLX on macOS
  ☆34Updated last year
• omkaark / agenata
  Build Web Datasets with Ease
  ☆33Updated 10 months ago
• nateraw / modal-examples
  Apps that run on modal.com
  ☆12Updated 10 months ago
• Attunewise / GPT
  OpenAI GPT hosted Agent Framework for Windows and MacOS
  ☆36Updated 9 months ago
• yoheinakajima / babyagi_og
  The original BabyAGI, updated with LiteLLM and no vector database reliance (csv instead)
  ☆21Updated 6 months ago
• aigeek0x0 / radiantloom-email-assist-7b
  Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…
  ☆14Updated last year
• omkaark / spotty
  Simple orchestration for EC2 spot containers
  ☆20Updated 6 months ago
• The-Swarm-Corporation / swarm-ecosystem
  The Swarm Ecosystem
  ☆20Updated 8 months ago
• yoheinakajima / quick_email_scripts
  A couple scripts to grab stats from email
  ☆42Updated 7 months ago
• lucataco / cog-whisperspeech
  Cog wrapper for collabora/WhisperSpeech
  ☆24Updated last year
• N8python / mlx-gpt
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆28Updated 3 months ago
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆39Updated 2 months ago
• FL33TW00D / embd
  GPU accelerated client-side embeddings for vector search, RAG etc.
  ☆66Updated last year
• a16z-infra / sunlight
  Server-side logic for an LLM application to make your prose clearer and more objective.
  ☆25Updated last year