lingticio / llmgLinks
π§ Extensive LLM endpoints, expended capabilities through your favorite protocols, πΈοΈ GraphQL, βοΈ gRPC, βΎοΈ WebSocket. Extended SOTA support for structured data, function calling, instruction mapping, load balancing, grouping, intelli-routing. Advanced tracing and inference tracking.
β18Updated this week
Alternatives and similar repositories for llmg
Users that are interested in llmg are comparing it to the libraries listed below
Sorting:
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprisesβ26Updated 9 months ago
- δΈε½εΌεθ ζ΄»ε¨ζ₯η¨οΌε ³ζ³¨ηΉοΌεΌζΊγεΌεθ γδΊεηοΌβ23Updated last week
- A Cloudflare Native AI Gatewayβ20Updated last year
- π’ Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! π«β229Updated this week
- π€π extra-small MCP SDK.β47Updated 6 months ago
- Automated pull requests reviewing and issues triaging with ChatGPT.β74Updated 2 years ago
- Your AI Kubernetes Expertβ186Updated 2 years ago
- π¦π Easy to use wrapper and Drizzle ORM driver for DuckDB WASMβ42Updated 2 months ago
- π« A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIβ¦β25Updated last year
- π£οΈπ Your Text-to-Speech Services, All-in-One.β70Updated 3 weeks ago
- π§ Simple and easy agent framework, include various of structured data manipulation, agent and function compositing, code editing, fs andβ¦β68Updated this week
- caniuse.com, but for kubernetesβ27Updated last year
- Sealaf is a product that deeply integrates Laf and Sealos. As a function computing application of Sealos, it can leverage the powerful Baβ¦β28Updated 2 months ago
- Bendan Botβ18Updated last year
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, iβ¦β12Updated 2 years ago
- Easiest way to write, build, run & share your OpenAI prompts. Do prompt engineer with confidence.β35Updated 2 years ago
- π Simple, event-driven and stream oriented workflow for TypeScriptβ255Updated 2 months ago
- π€π¬ Transformers.js provider for xsAI. Running Embedding, Whisper, and LLMs right in your browser!β41Updated 2 months ago
- 2023 δΈε½εΌζΊεΉ΄εΊ¦ζ₯εοΌ2023 China Open Source Reportβ16Updated last year
- Simplified Data Management and Sharing for Kubernetesβ17Updated this week
- π©βπ»βοΈ Prompt orchestration with stacks you familiar with, such as Vue.β38Updated last month
- Zeabur's official command line toolβ52Updated this week
- Pluto provides a unified programming interface that allows you to seamlessly tap into cloud capabilities and develop your cloud and AI apβ¦β93Updated last year
- π§― Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.β34Updated 2 weeks ago
- The storage system of sealos, aims to be a high-performance, high-reliability, and auto-scaling distributed file systemβ155Updated 2 years ago
- A diverse, simple, and secure all-in-one LLMOps platformβ109Updated last year
- β¨ Yet another simple, nearly zero dependency, structural log compliance logger implementation.β20Updated last month
- β25Updated last year
- Note-taking app for multiple distributions (desktop, web, chrome extension, react native)β32Updated 2 years ago
- Kubernetes-native AI serving platform for scalable model serving.β173Updated this week