Alternatives and similar repositories for openmodelz

Users that are interested in openmodelz are comparing it to the libraries listed below

• tensorchord / modelz-llm
  OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
  ☆275Updated 2 years ago
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆151Updated last year
• jina-ai / rungpt
  An open-source cloud-native of large multi-modal models (LMMs) serving framework.
  ☆165Updated 2 years ago
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆109Updated last year
• bentoml / BentoOCR
  Turn any OCR models into online inference API endpoint 🚀 🌖
  ☆57Updated 2 months ago
• index-labs / evalgpt
  EvalGPT is an code interpreter framework that utilizes large language models to automate the process of code-writing and execution, deliv…
  ☆249Updated 2 years ago
• star-whale / starwhale
  an MLOps/LLMOps platform
  ☆234Updated last year
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆57Updated last year
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆78Updated last year
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆131Updated 3 months ago
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆53Updated last year
• VQLite / VQLite
  VQLite - Simple and Lightweight Vector Search Engine based on Google ScaNN
  ☆92Updated last year
• leptonai / examples
  Lepton Examples
  ☆146Updated 2 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆163Updated last month
• zozoheir / tinyllm
  Develop, evaluate and monitor LLM applications at scale
  ☆99Updated last year
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆88Updated 11 months ago
• vtuber-plan / olah
  Self-hosted huggingface mirror service. 自建huggingface镜像服务。
  ☆211Updated 5 months ago
• kemingy / vllm-env
  setup the env for vllm users
  ☆16Updated 2 years ago
• ray-project / langchain-ray
  Examples on how to use LangChain and Ray
  ☆232Updated 2 years ago
• substratusai / vllm-docker
  ☆67Updated 9 months ago
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆468Updated last week
• shroominic / codebox-api
  👾📦 CodeBoxAPI is the simplest sandboxing infrastructure for your LLM Apps and Services.
  ☆361Updated 11 months ago
• vectorch-ai / ScaleLLM
  A high-performance inference system for large language models, designed for production environments.
  ☆489Updated 3 weeks ago
• pingcap / tidb-vector-python
  TiDB Vector SDK for Python, including code examples. Join our Discord: https://discord.gg/XzSW23Jg9p
  ☆61Updated 6 months ago
• rag-wtf / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆165Updated last year
• myscale / ChatData
  ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…
  ☆177Updated last year
• dbpunk-labs / octogen
  Octogen is an Open-Source Code Interpreter Agent Framework
  ☆257Updated last year
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆17Updated 10 months ago
• rizerphe / local-llm-function-calling
  A tool for generating function arguments and choosing what function to call with local LLMs
  ☆434Updated last year
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated 2 years ago