ShelbyJenkins / llm_utils
llm_utils: Basic LLM tools, best practices, and minimal abstraction.
☆42Updated 3 weeks ago
Alternatives and similar repositories for llm_utils:
Users that are interested in llm_utils are comparing it to the libraries listed below
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆33Updated 10 months ago
- 8-bit floating point types for Rust☆46Updated last month
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆185Updated 3 weeks ago
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆79Updated last year
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆55Updated 8 months ago
- A collection of boosting algorithms written in Rust 🦀☆51Updated last month
- Library for doing RAG☆69Updated 2 months ago
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆38Updated 11 months ago
- Implementation of the Coursera ML course in Rust☆36Updated 3 weeks ago
- A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.☆37Updated last year
- A very fast, accurate and wasm ready port of Diff Match Patch in Rust. The diff implementation is based on Myers' diff algorithm.☆33Updated 2 weeks ago
- Toy NN LIB☆21Updated this week
- Rust implementation of Surya☆57Updated last week
- Example of tch-rs on M1☆53Updated 11 months ago
- Rust LLM Stream Analyzer and Content Generator☆21Updated 3 months ago
- Asynchronous CUDA for Rust.☆30Updated 4 months ago
- A set of Rust macros for working with OpenAI function/tool calls.☆45Updated 11 months ago
- A Rust Vector which swaps to disk based on given parameters☆44Updated last year
- auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing…☆37Updated 4 months ago
- Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.☆111Updated 2 weeks ago
- A Fish Speech implementation in Rust, with Candle.rs☆72Updated 2 weeks ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆71Updated 11 months ago
- DOM Based Content Extraction via Text Density☆20Updated last month
- bott: Your Terminal Copilot☆86Updated last year
- Comparing performance-oriented string-processing libraries for substring search, multi-pattern matching, hashing, and Levenshtein edit-di…☆45Updated this week
- A experimental, very non-conformant, pure rust bluetooth stack☆26Updated 2 months ago
- Unofficial Rust bindings to Apple's mlx framework☆134Updated this week
- Ruskel generates skeletonized outlines of Rust crates.☆19Updated 2 weeks ago