Alternatives and similar repositories for worker-vllm:

Users that are interested in worker-vllm are comparing it to the libraries listed below

• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆223Updated 10 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆180Updated 10 months ago
• TheBlokeAI / dockerLLM
  TheBloke's Dockerfiles
  ☆305Updated 11 months ago
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆215Updated 5 months ago
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆233Updated 9 months ago
• basetenlabs / truss-examples
  Examples of models deployable with Truss
  ☆161Updated this week
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆170Updated 10 months ago
• jondurbin / bagel
  A bagel, with everything.
  ☆316Updated 10 months ago
• severian42 / Vodalus-Expert-LLM-Forge
  Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …
  ☆176Updated 7 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• runpod / runpod-python
  🐍 | Python library for RunPod API and serverless worker SDK.
  ☆212Updated last month
• galatolofederico / microchain
  function calling-based LLM agents
  ☆283Updated 5 months ago
• cognitivecomputations / OpenChatML
  ☆152Updated 7 months ago
• remichu-ai / gallama
  ☆124Updated last month
• Vaibhavs10 / optimise-my-whisper
  ☆199Updated 9 months ago
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆538Updated 2 weeks ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆226Updated 2 months ago
• teknium1 / ShareGPT-Builder
  ☆111Updated 2 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• QuangBK / localLLM_guidance
  Local LLM ReAct Agent with Guidance
  ☆156Updated last year
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆484Updated 3 weeks ago
• PygmalionAI / training-code
  The code we currently use to fine-tune models.
  ☆113Updated 9 months ago
• statchamber / ebook-to-chatml-conversion
  idea: https://github.com/nyxkrage/ebook-groupchat/
  ☆86Updated 6 months ago
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆157Updated last year
• mzbac / qlora-fine-tune
  ☆168Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆156Updated last week
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,314Updated this week
• georgesung / llm_qlora
  Fine-tuning LLMs using QLoRA
  ☆249Updated 8 months ago
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆205Updated 6 months ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆146Updated 9 months ago