lingticio / llmg
🧘 Extensive LLM endpoints, expended capabilities through your favorite protocols, 🕸️ GraphQL, ↔️ gRPC, ♾️ WebSocket. Extended SOTA support for structured data, function calling, instruction mapping, load balancing, grouping, intelli-routing. Advanced tracing and inference tracking.
☆14Updated this week
Alternatives and similar repositories for llmg:
Users that are interested in llmg are comparing it to the libraries listed below
- ☆12Updated last year
- caniuse.com, but for kubernetes☆18Updated last month
- A clean, lightweight music player for macOS.☆15Updated 2 weeks ago
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆69Updated this week
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated last year
- d.run website☆13Updated this week
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆26Updated last month
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆20Updated 2 months ago
- 🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫☆139Updated this week
- Kubernetes APIServer 高性能代理组件,代理 APIServer 的 List 请求,其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且,CKube 100% 兼容原生 kubectl 和 ku…☆19Updated 2 years ago
- A QA system based on k8s-specific knowledge build on ChatGLM2-6B, serving by Ray.☆9Updated last year
- 🧠 Simple and easy agent framework, include various of structured data manipulation, agent and function compositing, code editing, fs and…☆27Updated this week
- Manage K8S like managing local files☆29Updated last year
- Easiest way to write, build, run & share your OpenAI prompts. Do prompt engineer with confidence.☆34Updated last year
- 🏭 Fully implemented wrapper for Factorio headless server console as RESTful and gRPC for easier management through APIs☆14Updated this week
- Your AI Kubernetes Expert☆175Updated last year
- Automated pull requests reviewing and issues triaging with ChatGPT.☆70Updated last year
- helm repo add daocloud https://daocloud.github.io/dce-charts-repackage/☆11Updated this week
- 2023 中国开源年度报告;2023 China Open Source Report☆15Updated 9 months ago
- MirageDebug: Local remote debugging for Kubernetes apps, enabling fully authentic environment debugging.☆56Updated 8 months ago
- Following the same workflows as Kubernetes.☆9Updated this week
- opensource.win website☆20Updated this week
- ☆15Updated 5 months ago
- API Extensions for core KubeVela.☆11Updated this week
- GenAI inference performance benchmarking tool☆17Updated this week
- [Moved to https://github.com/kubernetes-sigs/kwok] fake-k8s is a tool for running Fake Kubernetes clusters, It can be used as an alternat…☆18Updated 2 years ago
- 🐳 Build OCI images for Bentos in k8s☆15Updated this week
- Collect Repos Star/Fork/Watch Counts Everyday☆14Updated this week
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆62Updated 3 weeks ago