alibaba / OpenSandboxLinks
A universal sandbox platform for AI application scenarios, providing multi-language SDKs, unified sandbox protocols, and sandbox runtimes for LLM-related capabilities.
☆66Updated this week
Alternatives and similar repositories for OpenSandbox
Users that are interested in OpenSandbox are comparing it to the libraries listed below
Sorting:
- agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.☆531Updated this week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆282Updated 2 weeks ago
- 🎉 An awesome & curated list of best LLMOps tools.☆179Updated last week
- Kubernetes-native AI serving platform for scalable model serving.☆95Updated this week
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆25Updated last year
- ✨Kubewizard is An AI-Agent for automated Kubernetes troubleshooting, and management, based on LangChain and k8s related tools.☆29Updated 11 months ago
- A workload for deploying LLM inference services on Kubernetes☆148Updated this week
- HTNN: A cloud-native gateway offering seamless extensibility for Istio and Envoy, in a native way by Go.☆122Updated 3 weeks ago
- Your AI Kubernetes Expert☆186Updated 2 years ago
- A Model Context Protocol (MCP) server implementation that enables comprehensive configuration and management of Higress.☆22Updated 9 months ago
- A Cloudflare Native AI Gateway☆20Updated last year
- The LLM abstraction layer for modern AI agent applications.☆500Updated this week
- init to record my learning path of AI Infra, especially on inference.☆115Updated this week
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆24Updated 8 months ago
- Zero instrucment LLM and AI agent (e.g. claude code, gemini-cli) observability in eBPF☆172Updated last month
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆33Updated last week
- Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec☆57Updated last week
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆30Updated 9 months ago
- A distributed system for Agentic AI☆35Updated this week
- Automated pull requests reviewing and issues triaging with ChatGPT.☆74Updated last year
- 中国开发者活动日程(关注点:开源、开发者、云原生)☆22Updated last week
- A diverse, simple, and secure all-in-one LLMOps platform☆109Updated last year
- 🧘 Extensive LLM endpoints, expended capabilities through your favorite protocols, 🕸️ GraphQL, ↔️ gRPC, ♾️ WebSocket. Extended SOTA supp…☆18Updated last week
- AIEvo is a multi-agent framework open sourced by Ant Group. Through this framework, you can create a multi-agent application.☆95Updated 2 weeks ago
- ☆91Updated 8 months ago
- The Volcano Descheduler☆21Updated 11 months ago
- Manage K8S like managing local files☆29Updated 2 years ago
- The Intelligent Inference Scheduler for Large-scale Inference Services.☆48Updated this week
- Fleetboard establishes an independent and unified parallel network, facilitating cross-cluster service discovery even in cases of IP over…☆31Updated 7 months ago
- The limitless expansion of Kubernetes. Make Kubernetes without boundaries☆256Updated 5 months ago