lingticio / llmgLinks
🧘 Extensive LLM endpoints, expended capabilities through your favorite protocols, 🕸️ GraphQL, ↔️ gRPC, ♾️ WebSocket. Extended SOTA support for structured data, function calling, instruction mapping, load balancing, grouping, intelli-routing. Advanced tracing and inference tracking.
☆16Updated this week
Alternatives and similar repositories for llmg
Users that are interested in llmg are comparing it to the libraries listed below
Sorting:
- 🐳🧩 Easy to use MCP builder & launcher for all possible MCP servers, just like Ollama for models!☆22Updated 3 months ago
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆20Updated 3 months ago
- 🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫☆201Updated this week
- 中国开发者活动日程（关注点：开源、开发者、云原生）☆18Updated last week
- init to record my learning path of AI Infra, especially on inference.☆39Updated this week
- Easiest way to write, build, run & share your OpenAI prompts. Do prompt engineer with confidence.☆35Updated 2 years ago
- A Cloudflare Native AI Gateway☆20Updated 9 months ago
- 🗣️🔊 Your Text-to-Speech Services, All-in-One.☆37Updated 2 months ago
- 🤗💬 Transformers.js provider for xsAI. Running Embedding, Whisper, and LLMs right in your browser!☆24Updated last month
- Your AI Kubernetes Expert☆183Updated 2 years ago
- caniuse.com, but for kubernetes☆24Updated 7 months ago
- Automated pull requests reviewing and issues triaging with ChatGPT.☆72Updated last year
- 2023 中国开源年度报告；2023 China Open Source Report☆16Updated last year
- Trace packets as they go through iptables chains☆67Updated 10 months ago
- 🧠 Simple and easy agent framework, include various of structured data manipulation, agent and function compositing, code editing, fs and…☆63Updated last week
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated 2 years ago
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆24Updated 8 months ago
- The storage system of sealos, aims to be a high-performance, high-reliability, and auto-scaling distributed file system☆154Updated last year
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.☆50Updated 5 months ago
- ✍️ Develop prompts with Vue SFC or Markdown like pro.☆32Updated 3 weeks ago
- Sealaf is a product that deeply integrates Laf and Sealos. As a function computing application of Sealos, it can leverage the powerful Ba…☆27Updated 8 months ago
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆31Updated last week
- Zero instrucment LLM and AI agent (e.g. claude code, gemini-cli) observability in eBPF☆50Updated this week
- HTNN: A cloud-native gateway offering seamless extensibility for Istio and Envoy, in a native way by Go.☆117Updated 3 weeks ago
- 周报爱好者的索引☆10Updated 2 years ago
- opensource.win website☆20Updated last week
- A QA system based on k8s-specific knowledge build on ChatGLM2-6B, serving by Ray.☆10Updated last year
- Kubernetes APIServer 高性能代理组件，代理 APIServer 的 List 请求，其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且，CKube 100% 兼容原生 kubectl 和 ku…☆19Updated 2 years ago
- A Model Context Protocol (MCP) server for interacting with Kong Konnect APIs, allowing AI assistants to query and analyze Kong Gateway co…☆33Updated 4 months ago
- 🌊 Simple, event-driven and stream oriented workflow for TypeScript☆195Updated this week