neferdata / allmsLinks
allms: One Rust Library to rule them aLLMs
β107Updated last week
Alternatives and similar repositories for allms
Users that are interested in allms are comparing it to the libraries listed below
Sorting:
- Anthropic Rust SDK π¦ with async support.β67Updated this week
- A set of Rust macros for working with OpenAI function/tool calls.β55Updated last year
- Model Context Protocol (MCP) CLI server template for Rustβ81Updated 8 months ago
- Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.β139Updated 7 months ago
- Rust application development framework for native and web applicationsβ70Updated 6 months ago
- β40Updated 8 months ago
- A type-safe implementation of the official Model Context Protocol (MCP) schema in Rust.β72Updated last week
- Structured outputs for LLMsβ52Updated last year
- An adapter to easily run an Axum server in a Cloudflare worker.β83Updated last week
- A concurrent, append-only vector.β209Updated 5 months ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.β47Updated 10 months ago
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.β65Updated last year
- Community Rust SDK for Deepgram.β62Updated last month
- pgvector support for Rustβ189Updated this week
- Rust SDK for the Model Context Protocol (MCP)β132Updated 5 months ago
- An unofficial Rust client for the Anthropic/Claude API.β40Updated 10 months ago
- Build tools for LLMs in Rust using Model Context Protocolβ37Updated 10 months ago
- A very fast Key-Value store in pure rustβ219Updated 3 weeks ago
- Support library for building Agentic MCP and Agent2Agent-based services.β28Updated 7 months ago
- A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, Eleβ¦β279Updated this week
- Run Generative AI models directly on your hardwareβ41Updated last year
- Server-sent events (SSE) client implementation for Rustβ104Updated this week
- OpenAI Dive is an unofficial async Rust library that allows you to interact with the OpenAI API.β78Updated 3 weeks ago
- A high-performance, asynchronous toolkit for building MCP servers and clients in Rust.β136Updated last week
- Anthropic Rust SDK: Supports streaming and asyncβ34Updated last year
- A lightweight, high-performance text embedding model implemented in Rust.β73Updated 8 months ago
- Minimalistic Rust Implementation Of Model Context Protocol from Anthropicβ61Updated 5 months ago
- Reports when tokio runtime threads are blockingβ66Updated last year
- OpenAI SDKβ75Updated 2 years ago
- β47Updated last year