lingticio / llmgLinks
π§ Extensive LLM endpoints, expended capabilities through your favorite protocols, πΈοΈ GraphQL, βοΈ gRPC, βΎοΈ WebSocket. Extended SOTA support for structured data, function calling, instruction mapping, load balancing, grouping, intelli-routing. Advanced tracing and inference tracking.
β16Updated this week
Alternatives and similar repositories for llmg
Users that are interested in llmg are comparing it to the libraries listed below
Sorting:
- π³π§© Easy to use MCP builder & launcher for all possible MCP servers, just like Ollama for models!β21Updated 2 months ago
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprisesβ20Updated 2 months ago
- δΈε½εΌεθ ζ΄»ε¨ζ₯η¨οΌε ³ζ³¨ηΉοΌεΌζΊγεΌεθ γδΊεηοΌβ16Updated this week
- init to record my learning path of AI Infra, especially on inference.β27Updated this week
- π’ Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! π«β196Updated this week
- Automated pull requests reviewing and issues triaging with ChatGPT.β72Updated last year
- π£οΈπ Your Text-to-Speech Services, All-in-One.β33Updated last month
- A Cloudflare Native AI Gatewayβ20Updated 8 months ago
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.β48Updated 4 months ago
- d.run websiteβ16Updated this week
- β12Updated 2 years ago
- A diverse, simple, and secure all-in-one LLMOps platformβ107Updated 9 months ago
- π€π extra-small MCP SDK.β38Updated last month
- Easiest way to write, build, run & share your OpenAI prompts. Do prompt engineer with confidence.β35Updated 2 years ago
- π€π¬ Transformers.js provider for xsAI. Running Embedding, Whisper, and LLMs right in your browser!β22Updated 2 weeks ago
- π§ Simple and easy agent framework, include various of structured data manipulation, agent and function compositing, code editing, fs andβ¦β62Updated last week
- π§― Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.β30Updated last week
- 2023 δΈε½εΌζΊεΉ΄εΊ¦ζ₯εοΌ2023 China Open Source Reportβ16Updated last year
- Your AI Kubernetes Expertβ183Updated 2 years ago
- opensource.win websiteβ20Updated last week
- Zeabur's official command line toolβ49Updated 2 weeks ago
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, iβ¦β12Updated 2 years ago
- caniuse.com, but for kubernetesβ24Updated 6 months ago
- π« A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIβ¦β24Updated 7 months ago
- β¨ Yet another simple, nearly zero dependency, structural log compliance logger implementation.β18Updated 2 months ago
- πͺ Universal external Golang utilities, implementations, and even experimental coding patterns, designsβ12Updated last week
- π Simple, event-driven and stream oriented workflow for TypeScriptβ180Updated this week
- Sealaf is a product that deeply integrates Laf and Sealos. As a function computing application of Sealos, it can leverage the powerful Baβ¦β27Updated 7 months ago
- π΅ Build Workflow-Centric AI applicationsβ44Updated this week
- envd Websiteβ12Updated 2 months ago