neferdata / allmsLinks
allms: One Rust Library to rule them aLLMs
β104Updated last week
Alternatives and similar repositories for allms
Users that are interested in allms are comparing it to the libraries listed below
Sorting:
- A set of Rust macros for working with OpenAI function/tool calls.β55Updated last year
- Anthropic Rust SDK π¦ with async support.β66Updated 9 months ago
- Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.β138Updated 6 months ago
- OpenAI Dive is an unofficial async Rust library that allows you to interact with the OpenAI API.β75Updated 3 weeks ago
- An adapter to easily run an Axum server in a Cloudflare worker.β82Updated last week
- Model Context Protocol (MCP) CLI server template for Rustβ81Updated 7 months ago
- An MCP server for rust crate docsβ57Updated 3 months ago
- Structured outputs for LLMsβ52Updated last year
- β40Updated 7 months ago
- A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, Eleβ¦β267Updated 2 weeks ago
- A very fast Key-Value store in pure rustβ213Updated last week
- A high-performance, asynchronous toolkit for building MCP servers and clients in Rust.β124Updated last week
- An unofficial Rust client for the Anthropic/Claude API.β40Updated 9 months ago
- A type-safe implementation of the official Model Context Protocol (MCP) schema in Rust.β71Updated this week
- Rust SDK for the Model Context Protocol (MCP)β132Updated 4 months ago
- OpenAI SDKβ75Updated 2 years ago
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!β110Updated 2 years ago
- Anthropic Rust SDK: Supports streaming and asyncβ34Updated last year
- A concurrent, append-only vector.β206Updated 3 months ago
- An easy local data persistence layer for Rust, backed by SQLite.β239Updated 3 months ago
- Framework to fuzz Rust/Tauri applications based on behavior policiesβ55Updated 10 months ago
- pgvector support for Rustβ186Updated last month
- Server-sent events (SSE) client implementation for Rustβ100Updated last month
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.β64Updated last year
- Rust application development framework for native and web applicationsβ69Updated 5 months ago
- HTML to markdown for Rustβ49Updated 2 weeks ago
- A lightweight, high-performance text embedding model implemented in Rust.β72Updated 6 months ago
- A Voice Activity Detector rust library using the Silero VAD model.β57Updated 3 months ago
- Reports when tokio runtime threads are blockingβ66Updated last year
- Support library for building Agentic MCP and Agent2Agent-based services.β28Updated 5 months ago