ShelbyJenkins / llm_utils
llm_utils: Basic LLM tools, best practices, and minimal abstraction.
☆42Updated last month
Alternatives and similar repositories for llm_utils:
Users that are interested in llm_utils are comparing it to the libraries listed below
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆33Updated 10 months ago
- 8-bit floating point types for Rust☆46Updated last week
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆79Updated last year
- Library for doing RAG☆70Updated this week
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆186Updated last month
- Comparing performance-oriented string-processing libraries for substring search, multi-pattern matching, hashing, and Levenshtein edit-di…☆45Updated last week
- A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.☆38Updated last year
- A collection of boosting algorithms written in Rust 🦀☆51Updated last month
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆57Updated 8 months ago
- A very fast, accurate and wasm ready port of Diff Match Patch in Rust. The diff implementation is based on Myers' diff algorithm.☆33Updated 3 weeks ago
- auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing…☆37Updated 4 months ago
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆38Updated last year
- Low rank adaptation (LoRA) for Candle.☆144Updated 7 months ago
- allms: One Rust Library to rule them aLLMs☆69Updated last week
- A Rust Vector which swaps to disk based on given parameters☆44Updated last year
- Run Generative AI models directly on your hardware☆33Updated 7 months ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆71Updated 11 months ago
- A set of Rust macros for working with OpenAI function/tool calls.☆46Updated 11 months ago
- Unofficial Rust bindings to Apple's mlx framework☆139Updated this week
- Rust application development framework for native and web applications☆56Updated last month
- Rust LLM Stream Analyzer and Content Generator☆21Updated 3 months ago
- A Rust crate for extracting readable content from web pages.☆131Updated this week
- Toy NN LIB☆21Updated 2 weeks ago
- Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.☆111Updated 3 weeks ago
- Implementation of the Coursera ML course in Rust☆36Updated last month
- bott: Your Terminal Copilot☆87Updated last year
- OpenAI Dive is an unofficial async Rust library that allows you to interact with the OpenAI API.☆55Updated last week