MistApproach / callm
Run Generative AI models directly on your hardware
☆16Updated last month
Related projects: ⓘ
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆54Updated 5 months ago
- Example of tch-rs on M1☆47Updated 6 months ago
- Fast, streaming indexing and query library for AI (RAG) applications, written in Rust☆129Updated this week
- Low rank adaptation (LoRA) for Candle.☆124Updated 3 weeks ago
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…☆118Updated last month
- Library for doing RAG☆31Updated 2 weeks ago
- Models and examples built with Burn☆162Updated this week
- A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.☆35Updated 10 months ago
- 🦀 A Pure Rust Framework For Building AGI (WIP).☆24Updated 4 months ago
- Your AI Copilot in Rust☆40Updated 9 months ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆33Updated this week
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆24Updated 4 months ago
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆138Updated 3 weeks ago
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆79Updated 8 months ago
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆35Updated 6 months ago
- A set of Rust macros for working with OpenAI function/tool calls.☆37Updated 5 months ago
- A Keras like abstraction layer on top of the Rust ML framework candle☆20Updated 3 months ago
- Unofficial Rust bindings to Apple's mlx framework☆52Updated last week
- pgvector support for Rust☆114Updated last month
- Embed PostgreSQL database☆61Updated 2 weeks ago
- ONNX neural network inference engine☆105Updated this week
- An Interface for Deterministic Signals from Probabilistic LLM Vibes☆60Updated last week
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆100Updated last year
- Anthropic Rust SDK 🦀 with async support.☆22Updated 2 weeks ago
- High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…☆59Updated last month
- Tera is an AI assistant which is tailored just for you and runs fully locally.☆55Updated 6 months ago
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆46Updated 2 months ago
- A collection of optimisers for use with candle☆29Updated last month
- Rust client for txtai☆104Updated 2 weeks ago
- Extract core logic from qdrant and make it available as a library.☆56Updated 5 months ago