lingticio / llmgLinks
π§ Extensive LLM endpoints, expended capabilities through your favorite protocols, πΈοΈ GraphQL, βοΈ gRPC, βΎοΈ WebSocket. Extended SOTA support for structured data, function calling, instruction mapping, load balancing, grouping, intelli-routing. Advanced tracing and inference tracking.
β18Updated this week
Alternatives and similar repositories for llmg
Users that are interested in llmg are comparing it to the libraries listed below
Sorting:
- π³π§© Easy to use MCP builder & launcher for all possible MCP servers, just like Ollama for models!β30Updated 5 months ago
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprisesβ24Updated 5 months ago
- δΈε½εΌ εθ ζ΄»ε¨ζ₯η¨οΌε ³ζ³¨ηΉοΌεΌζΊγεΌεθ γδΊεηοΌβ21Updated this week
- π§ Simple and easy agent framework, include various of structured data manipulation, agent and function compositing, code editing, fs andβ¦β64Updated 2 weeks ago
- π£οΈπ Your Text-to-Speech Services, All-in-One.β61Updated 2 weeks ago
- π’ Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! π«β219Updated this week
- A Cloudflare Native AI Gatewayβ20Updated 11 months ago
- Automated pull requests reviewing and issues triaging with ChatGPT.β73Updated last year
- caniuse.com, but for kubernetesβ26Updated 9 months ago
- agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.β99Updated last week
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, iβ¦β12Updated 2 years ago
- Sealaf is a product that deeply integrates Laf and Sealos. As a function computing application of Sealos, it can leverage the powerful Baβ¦β27Updated 10 months ago
- Your AI Kubernetes Expertβ186Updated 2 years ago
- π« A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIβ¦β24Updated 10 months ago
- π Simple, event-driven and stream oriented workflow for TypeScriptβ229Updated 2 weeks ago
- π€π extra-small MCP SDK.β47Updated 2 months ago
- 2023 δΈε½εΌζΊεΉ΄εΊ¦ζ₯εοΌ2023 China Open Source Reportβ16Updated last year
- Bendan Botβ19Updated last year
- π©βπ»βοΈ Prompt orchestration with stacks you familiar with, such as Vue.β37Updated last week
- π¦π Easy to use wrapper and Drizzle ORM driver for DuckDB WASMβ24Updated last week
- A diverse, simple, and secure all-in-one LLMOps platformβ107Updated last year
- π€π¬ Transformers.js provider for xsAI. Running Embedding, Whisper, and LLMs right in your browser!β34Updated this week
- d.run websiteβ15Updated this week
- β17Updated 3 weeks ago
- π§― Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.β33Updated this week
- Trace packets as they go through iptables chainsβ67Updated last year
- β17Updated 3 months ago
- π One-click solution to set VSCode or Cursor as the default application for development files.β22Updated 9 months ago
- Note-taking app for multiple distributions (desktop, web, chrome extension, react native)β32Updated last year
- An open-source, all-in-one AI API routerβ241Updated 3 weeks ago