minskylab / auto-rustLinks
auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing procedural macros.
☆41Updated 9 months ago
Alternatives and similar repositories for auto-rust
Users that are interested in auto-rust are comparing it to the libraries listed below
Sorting:
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated last year
- Fast serverless LLM inference, in Rust.☆88Updated 5 months ago
- bott: Your Terminal Copilot☆87Updated last year
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆63Updated last year
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆74Updated last year
- Anthropic Rust SDK 🦀 with async support.☆65Updated 6 months ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆46Updated 6 months ago
- A set of Rust macros for working with OpenAI function/tool calls.☆53Updated last year
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆37Updated last year
- Library for doing RAG☆75Updated last week
- Rust Vector for large amounts of data, that does not copy when growing, by using full `mmap`'d pages.☆22Updated last year
- Low rank adaptation (LoRA) for Candle.☆153Updated 4 months ago
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆62Updated last year
- Implementing the BitNet model in Rust☆39Updated last year
- Your AI Copilot in Rust☆48Updated last year
- 🦀 A Pure Rust Framework For Building AGI (WIP).☆95Updated last week
- 8-bit floating point types for Rust☆56Updated last week
- OpenAI compatible API for serving LLAMA-2 model☆218Updated last year
- Friendly interface to chat with an Ollama instance.☆77Updated last week
- allms: One Rust Library to rule them aLLMs☆93Updated this week
- Build tools for LLMs in Rust using Model Context Protocol☆38Updated 6 months ago
- Bleeding edge low level Rust binding for GGML☆16Updated last year
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆108Updated 2 years ago
- Almost-Pure Rust TTS Engine for my Rustnation talk☆44Updated 7 months ago
- Model Context Protocol (MCP) CLI server template for Rust☆79Updated 4 months ago
- Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.☆134Updated 3 months ago
- Rust library for scheduling, managing resources, and running DAGs 🌙☆33Updated 6 months ago
- CrabGrab+Tauri Example App☆57Updated last year
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆40Updated last year
- A Rust Vector which swaps to disk based on given parameters☆44Updated last year