lingticio / llmg
🧘 Extensive LLM endpoints, expended capabilities through your favorite protocols, 🕸️ GraphQL, ↔️ gRPC, ♾️ WebSocket. Extended SOTA support for structured data, function calling, instruction mapping, load balancing, grouping, intelli-routing. Advanced tracing and inference tracking.
☆14Updated last week
Alternatives and similar repositories for llmg:
Users that are interested in llmg are comparing it to the libraries listed below
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆15Updated 3 months ago
- ☆12Updated 3 weeks ago
- 🧠 Simple and easy agent framework, include various of structured data manipulation, agent and function compositing, code editing, fs and…☆27Updated 2 weeks ago
- ☆12Updated last year
- ✨ Yet another simple, nearly zero dependency, structural log compliance logger implementation.☆18Updated last week
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated last year
- A QA system based on k8s-specific knowledge build on ChatGLM2-6B, serving by Ray.☆10Updated last year
- A clean, lightweight music player for macOS.☆19Updated last week
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆29Updated 3 months ago
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆105Updated last week
- 🐳 Build OCI images for Bentos in k8s☆17Updated 2 weeks ago
- 2023 中国开源年度报告;2023 China Open Source Report☆15Updated 10 months ago
- caniuse.com, but for kubernetes☆23Updated 3 months ago
- Note-taking app for multiple distributions (desktop, web, chrome extension, react native)☆32Updated last year
- opensource.win website☆20Updated 3 weeks ago
- d.run website☆14Updated this week
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆20Updated 3 months ago
- A Cloudflare Native AI Gateway☆15Updated 4 months ago
- 🪐 Universal external Golang utilities, implementations, and even experimental coding patterns, designs☆12Updated 3 weeks ago
- 🐵 Build Workflow-Centric AI applications☆39Updated this week
- 🏭 Fully implemented wrapper for Factorio headless server console as RESTful and gRPC for easier management through APIs☆15Updated 3 weeks ago
- Kubernetes APIServer 高性能代理组件,代理 APIServer 的 List 请求,其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且,CKube 100% 兼容原生 kubectl 和 ku…☆19Updated 2 years ago
- 🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫☆175Updated this week
- Following the same workflows as Kubernetes.☆11Updated 2 weeks ago
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.☆29Updated 3 weeks ago
- Easiest way to write, build, run & share your OpenAI prompts. Do prompt engineer with confidence.☆34Updated last year
- ☆15Updated this week
- Bendan Bot☆18Updated 10 months ago
- 🎉 An awesome & curated list of best LLMOps tools.☆63Updated last week
- universal plugin framework for web application☆32Updated last year