lingticio / llmgLinks
🧘 Extensive LLM endpoints, expended capabilities through your favorite protocols, 🕸️ GraphQL, ↔️ gRPC, ♾️ WebSocket. Extended SOTA support for structured data, function calling, instruction mapping, load balancing, grouping, intelli-routing. Advanced tracing and inference tracking.
☆18Updated last week
Alternatives and similar repositories for llmg
Users that are interested in llmg are comparing it to the libraries listed below
Sorting:
- 中国开发者活动日程(关注点:开源、开发者、云原生)☆23Updated this week
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆25Updated 8 months ago
- 🐳🧩 Easy to use MCP builder & launcher for all possible MCP servers, just like Ollama for models!☆33Updated 8 months ago
- 🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫☆227Updated last week
- 🤗💬 Transformers.js provider for xsAI. Running Embedding, Whisper, and LLMs right in your browser!☆38Updated last month
- Automated pull requests reviewing and issues triaging with ChatGPT.☆74Updated last year
- A Cloudflare Native AI Gateway☆20Updated last year
- 🧠 Simple and easy agent framework, include various of structured data manipulation, agent and function compositing, code editing, fs and…☆66Updated this week
- caniuse.com, but for kubernetes☆27Updated last year
- Simplified Data Management and Sharing for Kubernetes☆16Updated 3 weeks ago
- Your AI Kubernetes Expert☆186Updated 2 years ago
- 🤖📎 extra-small MCP SDK.☆47Updated 5 months ago
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆25Updated last year
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated 2 years ago
- 2023 中国开源年度报告;2023 China Open Source Report☆16Updated last year
- 🗣️🔊 Your Text-to-Speech Services, All-in-One.☆67Updated this week
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆33Updated 3 weeks ago
- Bendan Bot☆18Updated last year
- containerd sandbox runtime using vms☆69Updated this week
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.☆62Updated 10 months ago
- 🌊 Simple, event-driven and stream oriented workflow for TypeScript☆253Updated last month
- 👩💻✍️ Prompt orchestration with stacks you familiar with, such as Vue.☆38Updated 3 weeks ago
- ✨ Yet another simple, nearly zero dependency, structural log compliance logger implementation.☆20Updated 3 weeks ago
- A CLI tool for managing Claude instances with git worktree☆161Updated last month
- ☆25Updated last year
- d.run website☆15Updated this week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆284Updated 3 weeks ago
- Pluto provides a unified programming interface that allows you to seamlessly tap into cloud capabilities and develop your cloud and AI ap…☆93Updated 11 months ago
- Kubernetes APIServer 高性能代理组件,代理 APIServer 的 List 请求,其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且,CKube 100% 兼容原生 kubectl 和 ku…☆19Updated 3 years ago
- Easily obtain selected text on all platforms (macOS, Windows, Linux).☆36Updated last year