Alternatives and similar repositories for openmodelz:

Users that are interested in openmodelz are comparing it to the libraries listed below

• tensorchord / modelz-llm
  OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
  ☆275Updated last year
• tensorchord / ai-infra-landscape
  This is a landscape of the infrastructure that powers the generative AI ecosystem
  ☆141Updated 5 months ago
• index-labs / evalgpt
  EvalGPT is an code interpreter framework that utilizes large language models to automate the process of code-writing and execution, deliv…
  ☆250Updated last year
• myscale / ChatData
  ChatData 🔍 📖 brings RAG to real applications with FREE✨ knowledge bases. Now enjoy your chat with 6 million wikipedia pages and 2 milli…
  ☆169Updated 5 months ago
• jina-ai / rungpt
  An open-source cloud-native of large multi-modal models (LMMs) serving framework.
  ☆161Updated last year
• ray-project / langchain-ray
  Examples on how to use LangChain and Ray
  ☆227Updated last year
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆101Updated 6 months ago
• abacusai / Long-Context
  This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and bench…
  ☆585Updated last year
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆51Updated 3 months ago
• milvus-io / milvus-lite
  A lightweight version of Milvus
  ☆313Updated 2 weeks ago
• ray-project / ray-llm
  RayLLM - LLMs on Ray (Archived). Read README for more info.
  ☆1,263Updated 3 weeks ago
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆86Updated 3 weeks ago
• VQLite / VQLite
  VQLite - Simple and Lightweight Vector Search Engine based on Google ScaNN
  ☆90Updated 8 months ago
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆58Updated 3 months ago
• dbpunk-labs / octogen
  Octogen is an Open-Source Code Interpreter Agent Framework
  ☆256Updated 8 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆124Updated last week
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆65Updated last year
• mosecorg / mosec
  A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
  ☆835Updated last week
• star-whale / starwhale
  an MLOps/LLMOps platform
  ☆227Updated 3 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆135Updated 8 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆100Updated this week
• Muhtasham / pod-helper
  🎧 Pod-Helper: Real-time audio transcription and repair on consumer hardware
  ☆77Updated last year
• tensorchord / vechord
  Turn PostgreSQL into your search engine in a Pythonic way.
  ☆38Updated last week
• pandodao / botastic
  An AI framework for building cool things.
  ☆210Updated last year
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆53Updated 7 months ago
• vtuber-plan / olah
  Self-hosted huggingface mirror service. 自建huggingface镜像服务。
  ☆151Updated 3 weeks ago
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆83Updated 2 months ago
• guangzhengli / vectorhub
  Quickly and easily build AI website or application by using embeddings!
  ☆378Updated 9 months ago
• huggingface / xet-core
  xet client tech, used in huggingface_hub
  ☆79Updated this week
• bentoml / llm-bench
  ☆49Updated 4 months ago