Alternatives and similar repositories for openmodelz:

Users that are interested in openmodelz are comparing it to the libraries listed below

• tensorchord / modelz-llm
  OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
  ☆270Updated last year
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆93Updated 4 months ago
• index-labs / evalgpt
  EvalGPT is an code interpreter framework that utilizes large language models to automate the process of code-writing and execution, deliv…
  ☆250Updated last year
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆47Updated 3 weeks ago
• vtuber-plan / olah
  Self-hosted huggingface mirror service.
  ☆103Updated last week
• myscale / ChatData
  ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…
  ☆161Updated 2 months ago
• bentoml / BentoOCR
  Turn any OCR models into online inference API endpoint 🚀 🌖
  ☆51Updated last year
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆135Updated 3 months ago
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆96Updated this week
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆36Updated this week
• jina-ai / rungpt
  An open-source cloud-native of large multi-modal models (LMMs) serving framework.
  ☆161Updated last year
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆270Updated this week
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆58Updated 3 weeks ago
• ray-project / langchain-ray
  Examples on how to use LangChain and Ray
  ☆225Updated last year
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆50Updated 4 months ago
• limcheekin / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆142Updated 6 months ago
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated last year
• leptonai / examples
  Lepton Examples
  ☆141Updated last month
• dottxt-ai / prompts
  A prompting library
  ☆154Updated 4 months ago
• pulzeai-oss / knn-router
  ☆106Updated 8 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆60Updated 9 months ago
• ssheng / BentoChain
  A voice-enabled chatbot application built using of 🦜️🔗 LangChain, text-to-speech, and speech-to-text models from 🤗 Hugging Face, and …
  ☆193Updated last year
• Muhtasham / pod-helper
  🎧 Pod-Helper: Real-time audio transcription and repair on consumer hardware
  ☆78Updated 11 months ago
• soulteary / sparrow
  ChatGPT Style client-compatible Backend Server, open source implementation.
  ☆94Updated 9 months ago
• dbpunk-labs / octogen
  Octogen is an Open-Source Code Interpreter Agent Framework
  ☆256Updated 5 months ago
• karminski / streaming-json-py
  A streamlined, user-friendly JSON streaming preprocessor, crafted in Python.
  ☆86Updated 4 months ago
• wsvn53 / docker-colab-runtime-local
  This is a Docker container that replicates the Google colab(https://colab.research.google.com/) runtime environment, used to quickly laun…
  ☆68Updated last year
• ninehills / LLM-Fusion-API
  ☆32Updated last year
• VQLite / VQLite
  VQLite - Simple and Lightweight Vector Search Engine based on Google ScaNN
  ☆87Updated 6 months ago
• zzzgydi / webscraper
  Scrape the webpage convert it into Markdown, and enhance AI search applications.
  ☆240Updated 8 months ago