lingticio / llmg

🧘 Extensive LLM endpoints, expended capabilities through your favorite protocols, 🕸️ GraphQL, ↔️ gRPC, ♾️ WebSocket. Extended SOTA support for structured data, function calling, instruction mapping, load balancing, grouping, intelli-routing. Advanced tracing and inference tracking.
14Updated this week

Alternatives and similar repositories for llmg:

Users that are interested in llmg are comparing it to the libraries listed below