shafishlabs / llmchain-rs
🦀Rust + Large Language Models - Make AI Services Freely and Easily.
☆181Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for llmchain-rs
- Extract core logic from qdrant and make it available as a library.☆56Updated 7 months ago
- pgvector support for Rust☆121Updated last week
- Rust client for Qdrant vector search engine☆232Updated last month
- Fast, streaming indexing and query library for AI (RAG) applications, written in Rust☆257Updated this week
- Library for generating vector embeddings, reranking in Rust☆285Updated this week
- Moly: an AI LLM GUI app in pure Rust☆155Updated this week
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆153Updated 2 months ago
- Async middleware abstraction powered by AFIT and RPITIT.☆241Updated last week
- Generate accurate and informative tree dumps of asynchronous tasks.☆161Updated 7 months ago
- Llama2 LLM ported to Rust burn☆274Updated 7 months ago
- LLM Orchestrator built in Rust☆267Updated 8 months ago
- This project is a web-based LLM (Large Language Model) chat tool developed using Rust, the Dioxus framework, and the Candle framework. It…☆79Updated 3 months ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆133Updated 3 weeks ago
- seaweedfs implemented in pure Rust☆152Updated last month
- Hybrid vector database with flexible SQL storage engine & multi-index support.☆359Updated this week
- A thrift and protobuf implementation in pure rust with high performance and extensibility.☆128Updated 2 weeks ago
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated 10 months ago
- Approx nearest neighbor search in Rust☆162Updated last year
- A lightweight Logging and Tracing observability solution for Rust, built with Apache Arrow, Apache Parquet and Apache DataFusion.☆73Updated 2 months ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆61Updated 7 months ago
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…☆122Updated last month
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆46Updated 4 months ago
- Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.☆265Updated last month
- A versatile and extensible logging implementation.☆42Updated this week
- Library for doing RAG☆42Updated this week
- A tracing library 10~100x faster than others☆221Updated this week
- 🦀 A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AI☆286Updated 8 months ago
- Performant time measuring in Rust☆171Updated 8 months ago
- Inference Llama 2 in one file of pure Rust 🦀☆229Updated last year