Alternatives and similar repositories for runpod-vllm:

Users that are interested in runpod-vllm are comparing it to the libraries listed below

• vintrocode / curation-buddy
  Don't bug your friends with articles they'll never read. AI's have infinite attention, leverage them instead! Use the curation buddy to e…
  ☆22Updated 8 months ago
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆57Updated last year
• fsndzomga / baby_agi_dspy
  a version of baby agi using dspy and typed predictors
  ☆17Updated 10 months ago
• cartesia-ai / dev-showcase
  Developer showcase of projects built on Cartesia
  ☆16Updated 5 months ago
• chimezie / mlx-tuning-fork
  Very basic framework for parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT. Architecture …
  ☆36Updated this week
• Attunewise / GPT
  OpenAI GPT hosted Agent Framework for Windows and MacOS
  ☆36Updated 6 months ago
• enjalot / fineweb-modal
  Using modal.com to process FineWeb-edu data
  ☆19Updated last month
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆23Updated 7 months ago
• aigeek0x0 / radiantloom-email-assist-7b
  Radiantloom Email Assist 7B is an email-assistant large language model fine-tuned from Zephyr-7B-Beta, over a custom-curated dataset of 1…
  ☆14Updated last year
• yoheinakajima / quick_email_scripts
  A couple scripts to grab stats from email
  ☆40Updated 4 months ago
• simonw / llm-anyscale-endpoints
  LLM plugin for models hosted by Anyscale Endpoints
  ☆32Updated 9 months ago
• kookaburracodes / investor-education-chatchain
  Not financial advice.
  ☆28Updated last year
• markokraemer / OACE
  ☆22Updated 7 months ago
• mzbac / mlx-lora
  ☆38Updated 10 months ago
• N8python / mlx-gpt
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆26Updated 2 weeks ago
• armbues / SiLLM-examples
  Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon
  ☆17Updated 2 months ago
• bachittle / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆32Updated 10 months ago
• g-aggarwal / mlx-hub
  A python command-line tool to download & manage MLX AI models from Hugging Face.
  ☆17Updated 5 months ago
• simonw / llm-mlx-llama
  Run Llama 2 using MLX on macOS
  ☆32Updated last year
• jmanhype / dspy-self-discover-framework
  Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…
  ☆58Updated 6 months ago
• Alignment-Lab-AI / AutoMaticAssistant
  ☆24Updated last year
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• swyxio / openlangmem
  ☆46Updated 9 months ago
• cg123 / rathe
  Tools for formatting large language model prompts.
  ☆12Updated last year
• yasyf / anthropic-computer-use-modal
  Anthropic Computer Use with Modal Sandboxes
  ☆26Updated 3 months ago
• yoheinakajima / babyagi_og
  The original BabyAGI, updated with LiteLLM and no vector database reliance (csv instead)
  ☆21Updated 3 months ago
• Arbaaz-Mahmood / cognosis-II
  ☆4Updated 5 months ago
• replicate / cog-vllm
  Run LLMs on Replicate with vLLM
  ☆15Updated 3 months ago
• lucataco / cog-whisperspeech
  Cog wrapper for collabora/WhisperSpeech
  ☆25Updated 10 months ago
• noco-ai / spellbook-ui
  ☆15Updated 10 months ago