ShelbyJenkins / candle_embed
A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
☆24Updated 4 months ago
Related projects: ⓘ
- An Interface for Deterministic Signals from Probabilistic LLM Vibes☆60Updated last week
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆79Updated 8 months ago
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆36Updated last year
- High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…☆59Updated last month
- A collection of optimisers for use with candle☆29Updated last month
- Run Generative AI models directly on your hardware☆16Updated last month
- Extract core logic from qdrant and make it available as a library.☆56Updated 5 months ago
- Minimal Gemma inference code in Rust☆24Updated 2 weeks ago
- Unofficial Rust bindings to Apple's mlx framework☆52Updated last week
- Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.☆34Updated last year
- Low rank adaptation (LoRA) for Candle.☆124Updated last month
- Fast, streaming indexing and query library for AI (RAG) applications, written in Rust☆129Updated this week
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆54Updated 5 months ago
- Library for doing RAG☆31Updated 2 weeks ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆33Updated this week
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆46Updated 2 months ago
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆35Updated 6 months ago
- A high-performance constrained decoding engine based on context free grammar in Rust☆30Updated this week
- A Keras like abstraction layer on top of the Rust ML framework candle☆20Updated 3 months ago
- A desktop app for prompting local open source LLMs.☆31Updated 6 months ago
- 🦀 A Pure Rust Framework For Building AGI (WIP).☆24Updated 4 months ago
- ☆57Updated last year
- ☆22Updated 2 months ago
- Generative AI web UI and server☆21Updated last year
- GGML bindings that aim to be idiomatic Rust rather than directly corresponding to the C/C++ interface☆19Updated 11 months ago
- auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing…☆30Updated 3 months ago
- pgvector support for Rust☆114Updated last month
- Rust bindings to https://github.com/k2-fsa/sherpa-onnx☆25Updated last month
- ☆15Updated 3 months ago
- A set of Rust macros for working with OpenAI function/tool calls.☆37Updated 5 months ago