Alternatives and similar repositories for pipeline

Users that are interested in pipeline are comparing it to the libraries listed below

• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated last year
• andreasjansson / AutoCog
  ☆40Updated 5 months ago
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆97Updated 8 months ago
• jina-ai / jerboa
  LLM finetuning
  ☆41Updated 2 years ago
• huggingface / api-inference-community
  ☆170Updated 8 months ago
• basetenlabs / truss-examples
  Examples of models deployable with Truss
  ☆206Updated this week
• skypilot-org / skypilot-tutorial
  Tutorial to get started with SkyPilot!
  ☆57Updated last year
• jina-ai / rungpt
  An open-source cloud-native of large multi-modal models (LMMs) serving framework.
  ☆164Updated 2 years ago
• Lightning-Universe / DiffusionWithAutoscaler
  DiffusionWithAutoscaler
  ☆29Updated last year
• Preemo-Inc / text-generation-inference
  ☆197Updated last year
• autonomi-ai / nos
  ⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.
  ☆145Updated last year
• substratusai / vllm-docker
  ☆64Updated 7 months ago
• AGiXT / streamlit
  Streamlit Web UI for AGiXT
  ☆28Updated 4 months ago
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆57Updated 2 years ago
• slai-labs / get-beam
  Run GPU inference and training jobs on serverless infrastructure that scales with you.
  ☆102Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆63Updated 2 years ago
• discus-labs / discus
  A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ
  ☆63Updated last year
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated last year
• amosjyng / vcr-langchain
  Record and replay LLM interactions for langchain
  ☆82Updated last year
• fw-ai / cookbook
  Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.
  ☆124Updated last week
• huggingface / discord-bots
  ☆50Updated 2 years ago
• zozoheir / tinyllm
  Develop, evaluate and monitor LLM applications at scale
  ☆98Updated 10 months ago
• qnguyen3 / hermes-llava
  ☆53Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆37Updated 2 years ago
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆99Updated 2 years ago
• QuixiAI / kraken
  ☆67Updated last year
• kyegomez / Kosmos-X
  The Next Generation Multi-Modality Superintelligence
  ☆69Updated last year
• AUTOMATIC1111 / llm-political-compass
  Web page with political compass quiz results for open LLMs
  ☆35Updated last year
• ialacol / text-inference-batcher
  A high performance batching router optimises max throughput for text inference workload
  ☆16Updated 2 years ago
• NEOS-AI / Neosearch
  AI-based search done right
  ☆20Updated 3 weeks ago