Alternatives and similar repositories for runpod-vllm

Users that are interested in runpod-vllm are comparing it to the libraries listed below

• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 2 months ago
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆60Updated last year
• g-aggarwal / mlx-hub
  A python command-line tool to download & manage MLX AI models from Hugging Face.
  ☆17Updated 9 months ago
• aigeek0x0 / radiantloom-email-assist-7b
  Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…
  ☆14Updated last year
• omkaark / spotty
  Simple orchestration for EC2 spot containers
  ☆19Updated 8 months ago
• modal-labs / cadre
  🛠 Self-hosted, fast, and consistent remote configuration for apps.
  ☆15Updated 2 years ago
• The-Swarm-Corporation / swarm-ecosystem
  The Swarm Ecosystem
  ☆21Updated 10 months ago
• fsndzomga / baby_agi_dspy
  a version of baby agi using dspy and typed predictors
  ☆17Updated last year
• cartesia-ai / dev-showcase
  Developer showcase of projects built on Cartesia
  ☆17Updated 9 months ago
• vintrocode / curation-buddy
  Don't bug your friends with articles they'll never read. AI's have infinite attention, leverage them instead! Use the curation buddy to e…
  ☆22Updated last year
• alexminnaar / Diagify
  convert natural language into technical diagrams
  ☆14Updated 5 months ago
• yoheinakajima / quick_email_scripts
  A couple scripts to grab stats from email
  ☆42Updated 8 months ago
• n4ze3m / vexasearch
  A function to do all
  ☆36Updated last year
• aniemerg / smolcc
  A lightweight code assistant with tool-using capabilities built on HuggingFace's smolagents.
  ☆23Updated this week
• MaximeRivest / funnydspy
  Vanilla-Python ergonomics on top of DSPy
  ☆29Updated this week
• Attunewise / GPT
  OpenAI GPT hosted Agent Framework for Windows and MacOS
  ☆36Updated 10 months ago
• simonw / llm-anyscale-endpoints
  LLM plugin for models hosted by Anyscale Endpoints
  ☆33Updated last year
• bachittle / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆32Updated last year
• Arbaaz-Mahmood / cognosis-II
  ☆4Updated 9 months ago
• InfrHQ / desktop-client
  An Infr app that automates data collection from your PC, macOS or Linux client.
  ☆11Updated last year
• morgangiraud / text-to-sql-proto
  A text-to-SQL prototype on the northwind sqlite dataset
  ☆12Updated 8 months ago
• Prismadic / magnet
  the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly
  ☆31Updated 7 months ago
• nateraw / modal-examples
  Apps that run on modal.com
  ☆12Updated last year
• kyegomez / MLXTransformer
  Simple Implementation of a Transformer in the new framework MLX by Apple
  ☆20Updated 6 months ago
• jmanhype / dspy-self-discover-framework
  Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…
  ☆60Updated 10 months ago
• mzbac / mlx-lora
  ☆38Updated last year
• agentsea / agentd
  A daemon that makes a desktop OS accessible to AI agents
  ☆29Updated last week
• The-Swarm-Corporation / swarms-core
  Multi-threading, Concurrency, Asynchrony, and various Execution Methods implemented in a Rust backend for bleeding edge performance.
  ☆12Updated 6 months ago
• Alignment-Lab-AI / AutoMaticAssistant
  ☆24Updated last year
• cartesia-ai / cartesia-livekit-voice-agent
  Voice agent using LiveKit (orchestration), Cartesia (TTS), OpenAI (LLM), and Deepgram (STT)
  ☆16Updated 4 months ago