Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
โ282Nov 3, 2023Updated 2 years ago
Alternatives and similar repositories for openmodelz
Users that are interested in openmodelz are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ๐๏ธ Reproducible development environment for humans and agentsโ2,214Jul 10, 2026Updated 2 weeks ago
- OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)โ276Oct 11, 2023Updated 2 years ago
- A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machineโ904Jul 11, 2026Updated 2 weeks ago
- This repository contains statistics about the AI Infrastructure products.โ16Feb 27, 2025Updated last year
- With Dejavu, you can have a perfect memory by capturing and organizing your visual recordings efficiently.โ133Sep 1, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer โข AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This is a landscape of the infrastructure that powers the generative AI ecosystemโ155Oct 16, 2024Updated last year
- my bachelor's thesis in SJTU about https://github.com/caicloud/cycloneโ12Jan 4, 2018Updated 8 years ago
- โ19Apr 11, 2024Updated 2 years ago
- Kexplain is an interactive kubectl explainโ12Oct 23, 2023Updated 2 years ago
- Docker for Your ML/DL Models Based on OCI Artifactsโ473Jan 26, 2024Updated 2 years ago
- An awesome & curated list of best LLMOps tools for developersโ5,894May 21, 2026Updated 2 months ago
- EvalGPT is an code interpreter framework that utilizes large language models to automate the process of code-writing and execution, delivโฆโ248Sep 17, 2023Updated 2 years ago
- Turn PostgreSQL into your search engine in a Pythonic way.โ51Aug 29, 2025Updated 10 months ago
- Personal Blog in github.ioโ11Feb 25, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient โข AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- โ143Dec 6, 2023Updated 2 years ago
- Custom Scheduler to deploy ML models to TRTIS for GPU Sharingโ12Apr 1, 2020Updated 6 years ago
- An AI framework for building cool things.โ211Jun 5, 2023Updated 3 years ago
- OpenAI compatible API for open source LLMsโ16Oct 30, 2023Updated 2 years ago
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprisesโ27Apr 24, 2025Updated last year
- The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build cuโฆโ10,382Updated this week
- Create informative READMEs effortlessly using AI-driven templates with the README Creator powered by Language Model (LLM). Simplify documโฆโ14Aug 11, 2023Updated 2 years ago
- RayLLM - LLMs on Ray (Archived). Read README for more info.โ1,262Mar 13, 2025Updated last year
- A userspace filesystem backing by Apache OpenDAL.โ40Jun 2, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer โข AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.โ2,180Feb 26, 2025Updated last year
- โ15Mar 22, 2026Updated 4 months ago
- A toolkit to run Ray applications on Kubernetesโ2,606Updated this week
- Run your deep learning workloads on Kubernetes more easily and efficiently.โ532Mar 4, 2024Updated 2 years ago
- The inference code of RVC-Boss/GPT-SoVITS that can be developer-friendly.โ16Sep 29, 2024Updated last year
- A Survey of AI startupsโ401Aug 27, 2023Updated 2 years ago
- AI-based search done rightโ20Dec 25, 2025Updated 6 months ago
- An experimental tool to modify YAMLs without losing (most of) comment lines.โ16Sep 25, 2022Updated 3 years ago
- a fast cross platform AI inference engine ๐ค using Rust ๐ฆ and WebGPU ๐ฎโ470Jan 4, 2025Updated last year
- Managed Database hosting by DigitalOcean โข AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Model Deployment at Scale on Kubernetes ๐ฆ๏ธโ843May 30, 2026Updated last month
- A tricky compiler generatorโ13Nov 11, 2015Updated 10 years ago
- A powerful prompt template engine built upon Jinjaโ12Oct 22, 2025Updated 9 months ago
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.โ8,106Jul 11, 2025Updated last year
- A diverse, simple, and secure all-in-one LLMOps platformโ113Sep 21, 2024Updated last year
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.โ31Mar 28, 2025Updated last year
- ไธญๅฝๅผๅ่ ๆดปๅจๆฅ็จ๏ผๅ ณๆณจ็น๏ผๅผๆบใๅผๅ่ ใไบๅ็๏ผโ26Updated this week