metobom / tchrs-opencv-webcam-inference
☆11Updated last year
Related projects ⓘ
Alternatives and complementary repositories for tchrs-opencv-webcam-inference
- A diffusers API in Burn (Rust)☆15Updated 3 months ago
- ☆13Updated last year
- Run Generative AI models directly on your hardware☆22Updated 3 months ago
- Asynchronous CUDA for Rust.☆27Updated last week
- Rust Vector for large amounts of data, that does not copy when growing, by using full `mmap`'d pages.☆21Updated 7 months ago
- Unofficial Rust bindings to Apple's mlx framework☆66Updated this week
- memchr vs stringzilla - up to 7x throughput difference between two SIMD-accelerated substring search libraries in Rust☆45Updated 6 months ago
- "PyTorch in Rust"☆16Updated 8 months ago
- A distributed execution framework built upon lunatic.☆16Updated 9 months ago
- A complete(grpc service and lib) Rust inference with multilingual embedding support. This version leverages the power of Rust for both GR…☆29Updated 2 months ago
- A collection of optimisers for use with candle☆30Updated last month
- Sample Python extension using Rust/PyO3/tch to interact with PyTorch☆31Updated 9 months ago
- Rustic bindings for IREE☆17Updated last year
- Ruskel generates skeletonized outlines of Rust crates.☆16Updated 2 weeks ago
- LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!☆101Updated last year
- A neural network inference library, written in Rust.☆56Updated 3 months ago
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated 9 months ago
- Example of tch-rs on M1☆51Updated 7 months ago
- Implementing the BitNet model in Rust☆26Updated 6 months ago
- Rust API to run predictions with YoloV5 models.☆28Updated 2 years ago
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆26Updated 6 months ago
- A Reinforcement Learning / Neural Network library, written in Rust.☆19Updated 3 years ago
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆36Updated 7 months ago
- Modular Rust transformer/LLM library using Candle☆36Updated 6 months ago
- Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)☆24Updated 2 years ago
- Rust LLM Stream Analyzer and Content Generator☆16Updated 6 months ago
- ☆19Updated 4 months ago
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆35Updated last month
- Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust☆37Updated last year
- 🦀 Example of serving deep learning models in Rust with batched prediction☆34Updated last year