ShelbyJenkins / llm_utilsLinks
llm_utils: Basic LLM tools, best practices, and minimal abstraction.
☆46Updated 3 months ago
Alternatives and similar repositories for llm_utils
Users that are interested in llm_utils are comparing it to the libraries listed below
Sorting:
- 8-bit floating point types for Rust☆45Updated 2 months ago
- A lightweight, high-performance text embedding model implemented in Rust.☆66Updated 3 weeks ago
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆37Updated last year
- Library for doing RAG☆72Updated 2 weeks ago
- A Rust Vector which swaps to disk based on given parameters☆44Updated last year
- AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.☆61Updated 11 months ago
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated last year
- Comparing performance-oriented string-processing libraries for substring search, multi-pattern matching, hashing, and Levenshtein edit-di…☆46Updated 2 months ago
- A set of Rust macros for working with OpenAI function/tool calls.☆49Updated last year
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆39Updated last year
- Ruskel generates skeletonized outlines of Rust crates.☆19Updated 3 months ago
- allms: One Rust Library to rule them aLLMs☆81Updated this week
- Build tools for LLMs in Rust using Model Context Protocol☆38Updated 3 months ago
- An unofficial Rust client for the Anthropic/Claude API.☆36Updated 3 months ago
- A collection of boosting algorithms written in Rust 🦀☆55Updated 2 weeks ago
- Common stop words in a variety of languages☆21Updated 3 months ago
- Implementing the BitNet model in Rust☆37Updated last year
- A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.☆38Updated last year
- Rust Vector for large amounts of data, that does not copy when growing, by using full `mmap`'d pages.☆22Updated last year
- A type-safe implementation of the official Model Context Protocol (MCP) schema in Rust.☆53Updated this week
- ResNet implementation with Burn☆33Updated 8 months ago
- Rust interface for the WebRTC Voice-Activity-Module☆30Updated 4 years ago
- A highly customable, adaptable, runtime agnostic and WASM/WASI friendly decentralized solution for service discovery and orchestration th…☆49Updated 2 months ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆201Updated 3 months ago
- ☆16Updated 8 months ago
- Tensor library for machine learning☆27Updated last week
- Example of tch-rs on M1☆53Updated last year
- Minimalistic Rust Implementation Of Model Context Protocol from Anthropic☆56Updated 2 months ago
- A curated collection of Rust projects related to neural networks, designed to complement "Are We Learning Yet."☆51Updated last month
- Static Linear Algebra System☆36Updated last year