Alternatives and similar repositories for openmodelz:

Users that are interested in openmodelz are comparing it to the libraries listed below

• tensorchord / modelz-llm
  OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
  ☆276Updated last year
• jina-ai / rungpt
  An open-source cloud-native of large multi-modal models (LMMs) serving framework.
  ☆163Updated last year
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆144Updated 6 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆126Updated last week
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆102Updated 7 months ago
• ray-project / langchain-ray
  Examples on how to use LangChain and Ray
  ☆229Updated last year
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆51Updated 4 months ago
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆54Updated 8 months ago
• index-labs / evalgpt
  EvalGPT is an code interpreter framework that utilizes large language models to automate the process of code-writing and execution, deliv…
  ☆250Updated last year
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆65Updated last year
• skai-x / elastic-jupyter-operator
  Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.
  ☆197Updated 3 years ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆107Updated last week
• milvus-io / milvus-lite
  A lightweight version of Milvus
  ☆322Updated last week
• ray-project / ray-llm
  RayLLM - LLMs on Ray (Archived). Read README for more info.
  ☆1,261Updated last month
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆351Updated this week
• star-whale / starwhale
  an MLOps/LLMOps platform
  ☆228Updated 4 months ago
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆58Updated last month
• leptonai / examples
  Lepton Examples
  ☆141Updated last month
• triton-inference-server / vllm_backend
  ☆253Updated this week
• run-ai / runai-model-streamer
  ☆207Updated this week
• coolbeevip / langchain_plantuml
  Subscribe to events using a callback and store them in PlantUML format to easily visualize LangChain workflow in Activity Diagram and Seq…
  ☆73Updated 3 months ago
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆225Updated 2 months ago
• bentoml / llm-bench
  ☆50Updated 5 months ago
• myscale / ChatData
  ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…
  ☆171Updated 6 months ago
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated last year
• ray-project / llmperf-leaderboard
  ☆457Updated last year
• zozoheir / tinyllm
  Develop, evaluate and monitor LLM applications at scale
  ☆99Updated 5 months ago
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆437Updated this week
• myscale / vector-db-benchmark
  Framework for benchmarking fully-managed vector databases
  ☆78Updated 7 months ago
• shroominic / codebox-api
  👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.
  ☆345Updated 3 months ago