ShelbyJenkins / llm_utilsLinks
llm_utils: Basic LLM tools, best practices, and minimal abstraction.
β46Updated 5 months ago
Alternatives and similar repositories for llm_utils
Users that are interested in llm_utils are comparing it to the libraries listed below
Sorting:
- A collection of boosting algorithms written in Rust π¦β57Updated 2 months ago
- A lightweight, high-performance text embedding model implemented in Rust.β66Updated 2 months ago
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.β63Updated last year
- Library for doing RAGβ74Updated this week
- A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.β38Updated last year
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candleβ73Updated last year
- Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.β132Updated 2 months ago
- Rust interface for the WebRTC Voice-Activity-Moduleβ30Updated 5 years ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibesβ219Updated last week
- Dagcuter is a Rust library for executing Directed Acyclic Graphs (DAGs) of tasks. It manages task dependencies, detects circular dependenβ¦β31Updated last week
- 8-bit floating point types for Rustβ48Updated 2 weeks ago
- Rust client for txtaiβ111Updated last month
- allms: One Rust Library to rule them aLLMsβ89Updated this week
- A Rust Vector which swaps to disk based on given parametersβ44Updated last year
- β34Updated 2 years ago
- Common stop words in a variety of languagesβ22Updated 5 months ago
- A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, Eleβ¦β156Updated last week
- Parallelo Parallel Library (PPL) is a small parallel framework that brings Structured Parallel Programming in Rust.β77Updated last month
- native OCR for MacOS, Windows, Linuxβ183Updated last week
- An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Wasβ¦β134Updated 9 months ago
- A distributed sliding window rate limiter built with Tokio/Towerβ29Updated 7 months ago
- in memory Rust database to query your data like a Venn diagramβ110Updated 8 months ago
- A set of Rust macros for working with OpenAI function/tool calls.β50Updated last year
- Toy NN LIBβ22Updated 4 months ago
- Rust - background jobs.β48Updated 6 months ago
- A highly customable, adaptable, runtime agnostic and WASM/WASI friendly decentralized solution for service discovery and orchestration thβ¦β52Updated last month
- A very fast HTTP Server based on Hyper and Rustβ87Updated last year
- Low rank adaptation (LoRA) for Candle.β152Updated 3 months ago
- Webcam video stream with real-time YOLO object detection, built with Ort, Tonic and Axum.β80Updated 3 months ago
- A experimental, very non-conformant, pure rust bluetooth stackβ25Updated 7 months ago