neferdata / allmsLinks
allms: One Rust Library to rule them aLLMs
β97Updated 3 weeks ago
Alternatives and similar repositories for allms
Users that are interested in allms are comparing it to the libraries listed below
Sorting:
- A set of Rust macros for working with OpenAI function/tool calls.β53Updated last year
- Anthropic Rust SDK π¦ with async support.β66Updated 6 months ago
- Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.β135Updated 3 months ago
- Model Context Protocol (MCP) CLI server template for Rustβ80Updated 4 months ago
- An adapter to easily run an Axum server in a Cloudflare worker.β80Updated 2 weeks ago
- β39Updated 4 months ago
- A type-safe implementation of the official Model Context Protocol (MCP) schema in Rust.β68Updated 2 weeks ago
- OpenAI Dive is an unofficial async Rust library that allows you to interact with the OpenAI API.β69Updated last month
- Minimalistic Rust Implementation Of Model Context Protocol from Anthropicβ56Updated last month
- A very fast Key-Value store in pure rustβ211Updated 2 months ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.β47Updated 6 months ago
- Support library for building Agentic MCP and Agent2Agent-based services.β29Updated 3 months ago
- Rust SDK for the Model Context Protocol (MCP)β133Updated last month
- Anthropic Rust SDK: Supports streaming and asyncβ33Updated last year
- A concurrent, append-only vector.β195Updated last month
- A lightweight, high-performance text embedding model implemented in Rust.β67Updated 4 months ago
- A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, Eleβ¦β207Updated this week
- An unofficial Rust client for the Anthropic/Claude API.β40Updated 6 months ago
- Low rank adaptation (LoRA) for Candle.β158Updated 4 months ago
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.β62Updated last year
- Server-sent events (SSE) client implementation for Rustβ96Updated 2 months ago
- Community Rust SDK for Deepgram.β58Updated last month
- Library for doing RAGβ75Updated last month
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!β109Updated 2 years ago
- OpenAI SDKβ71Updated last year
- A Voice Activity Detector rust library using the Silero VAD model.β51Updated last month
- An MCP server for rust crate docsβ52Updated 2 weeks ago
- A very fast HTTP Server based on Hyper and Rustβ87Updated last year
- Framework to fuzz Rust/Tauri applications based on behavior policiesβ54Updated 7 months ago
- Rust application development framework for native and web applicationsβ67Updated 2 months ago