Alternatives and similar repositories for openmodelz

Users that are interested in openmodelz are comparing it to the libraries listed below

• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆148Updated 10 months ago
• tensorchord / modelz-llm
  OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
  ☆276Updated last year
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆107Updated 11 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆128Updated last week
• index-labs / evalgpt
  EvalGPT is an code interpreter framework that utilizes large language models to automate the process of code-writing and execution, deliv…
  ☆249Updated last year
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆70Updated last year
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆53Updated 7 months ago
• bentoml / BentoOCR
  Turn any OCR models into online inference API endpoint 🚀 🌖
  ☆56Updated 5 months ago
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆56Updated 11 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆140Updated 2 weeks ago
• star-whale / starwhale
  an MLOps/LLMOps platform
  ☆231Updated 8 months ago
• jina-ai / rungpt
  An open-source cloud-native of large multi-modal models (LMMs) serving framework.
  ☆167Updated last year
• VQLite / VQLite
  VQLite - Simple and Lightweight Vector Search Engine based on Google ScaNN
  ☆92Updated last year
• vtuber-plan / olah
  Self-hosted huggingface mirror service. 自建huggingface镜像服务。
  ☆186Updated last month
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆147Updated 2 weeks ago
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆17Updated 5 months ago
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆413Updated this week
• skai-x / elastic-jupyter-operator
  Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.
  ☆201Updated 3 years ago
• huggingface / xet-core
  xet client tech, used in huggingface_hub
  ☆171Updated this week
• ray-project / langchain-ray
  Examples on how to use LangChain and Ray
  ☆229Updated 2 years ago
• kemingy / vllm-env
  setup the env for vllm users
  ☆16Updated last year
• tensorchord / vechord
  Turn PostgreSQL into your search engine in a Pythonic way.
  ☆50Updated 2 weeks ago
• run-ai / runai-model-streamer
  ☆238Updated last week
• substratusai / sandboxai
  Run AI generated code in isolated sandboxes
  ☆96Updated 6 months ago
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆86Updated last year
• leptonai / examples
  Lepton Examples
  ☆145Updated last week
• pandodao / botastic
  An AI framework for building cool things.
  ☆210Updated 2 years ago
• myscale / ChatData
  ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…
  ☆177Updated 9 months ago
• milvus-io / milvus-lite
  A lightweight version of Milvus
  ☆359Updated this week
• tensorchord / deepseek-api-arena
  A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.
  ☆29Updated 4 months ago