lingticio / llmgLinks
π§ Extensive LLM endpoints, expended capabilities through your favorite protocols, πΈοΈ GraphQL, βοΈ gRPC, βΎοΈ WebSocket. Extended SOTA support for structured data, function calling, instruction mapping, load balancing, grouping, intelli-routing. Advanced tracing and inference tracking.
β18Updated last week
Alternatives and similar repositories for llmg
Users that are interested in llmg are comparing it to the libraries listed below
Sorting:
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprisesβ25Updated 8 months ago
- π³π§© Easy to use MCP builder & launcher for all possible MCP servers, just like Ollama for models!β33Updated 8 months ago
- δΈε½εΌεθ ζ΄»ε¨ζ₯η¨οΌε ³ζ³¨ηΉοΌεΌζΊγεΌεθ γδΊεηοΌβ23Updated this week
- π§ Simple and easy agent framework, include various of structured data manipulation, agent and function compositing, code editing, fs andβ¦β66Updated last week
- π’ Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! π«β227Updated last week
- π€π extra-small MCP SDK.β47Updated 5 months ago
- Simplified Data Management and Sharing for Kubernetesβ16Updated 3 weeks ago
- Automated pull requests reviewing and issues triaging with ChatGPT.β74Updated last year
- π€π¬ Transformers.js provider for xsAI. Running Embedding, Whisper, and LLMs right in your browser!β38Updated last month
- π£οΈπ Your Text-to-Speech Services, All-in-One.β67Updated last week
- π¦π Easy to use wrapper and Drizzle ORM driver for DuckDB WASMβ42Updated last month
- caniuse.com, but for kubernetesβ27Updated last year
- A Cloudflare Native AI Gatewayβ20Updated last year
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, iβ¦β12Updated 2 years ago
- Sealaf is a product that deeply integrates Laf and Sealos. As a function computing application of Sealos, it can leverage the powerful Baβ¦β28Updated last month
- Your AI Kubernetes Expertβ186Updated 2 years ago
- π« A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIβ¦β25Updated last year
- A diverse, simple, and secure all-in-one LLMOps platformβ109Updated last year
- Bendan Botβ18Updated last year
- 2023 δΈε½εΌζΊεΉ΄εΊ¦ζ₯εοΌ2023 China Open Source Reportβ16Updated last year
- Pluto provides a unified programming interface that allows you to seamlessly tap into cloud capabilities and develop your cloud and AI apβ¦β93Updated 11 months ago
- containerd sandbox runtime using vmsβ69Updated this week
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.β62Updated 10 months ago
- A CLI tool for managing Claude instances with git worktreeβ161Updated last month
- π§― Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.β33Updated 3 weeks ago
- π©βπ»βοΈ Prompt orchestration with stacks you familiar with, such as Vue.β38Updated 3 weeks ago
- π Simple, event-driven and stream oriented workflow for TypeScriptβ253Updated last month
- β¨ Yet another simple, nearly zero dependency, structural log compliance logger implementation.β20Updated 3 weeks ago
- A simple Hello World MCP server for CI/CD testβ21Updated 6 months ago
- Tauri π¬β61Updated last year