neferdata / allmsLinks
allms: One Rust Library to rule them aLLMs
β107Updated this week
Alternatives and similar repositories for allms
Users that are interested in allms are comparing it to the libraries listed below
Sorting:
- A set of Rust macros for working with OpenAI function/tool calls.β55Updated last year
- Anthropic Rust SDK π¦ with async support.β67Updated 3 weeks ago
- Model Context Protocol (MCP) CLI server template for Rustβ81Updated 9 months ago
- β41Updated 9 months ago
- Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.β140Updated 8 months ago
- An adapter to easily run an Axum server in a Cloudflare worker.β85Updated this week
- OpenAI Dive is an unofficial async Rust library that allows you to interact with the OpenAI API.β78Updated last week
- A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, Eleβ¦β292Updated 3 weeks ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.β48Updated 11 months ago
- Structured outputs for LLMsβ53Updated last year
- An unofficial Rust client for the Anthropic/Claude API.β40Updated 11 months ago
- Build tools for LLMs in Rust using Model Context Protocolβ37Updated 11 months ago
- A type-safe implementation of the official Model Context Protocol (MCP) schema in Rust.β72Updated 2 weeks ago
- Support library for building Agentic MCP and Agent2Agent-based services.β28Updated 7 months ago
- Run Generative AI models directly on your hardwareβ42Updated last year
- A lightweight, high-performance text embedding model implemented in Rust.β73Updated 9 months ago
- OpenAI SDKβ75Updated 2 years ago
- pgvector support for Rustβ193Updated 3 weeks ago
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.β65Updated last year
- A very fast Key-Value store in pure rustβ219Updated 2 weeks ago
- A high-performance, asynchronous toolkit for building MCP servers and clients in Rust.β144Updated this week
- Rust application development framework for native and web applicationsβ72Updated 7 months ago
- A concurrent, append-only vector.β208Updated 5 months ago
- Rust SDK for the Model Context Protocol (MCP)β132Updated 6 months ago
- Reports when tokio runtime threads are blockingβ66Updated last year
- Unofficial Rust bindings to Apple's mlx frameworkβ247Updated last week
- A Voice Activity Detector rust library using the Silero VAD model.β62Updated 6 months ago
- π¦ Prevents outdated Rust code suggestions from AI assistants. This MCP server fetches current crate docs, uses embeddings/LLMs, and provβ¦β248Updated 2 months ago
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!β111Updated 2 years ago
- A curated collection of Rust projects related to neural networks, designed to complement "Are We Learning Yet."β66Updated last month