assaydepot / red-candleLinks

Ruby gem for running state-of-the-art language models locally. Access LLMs, embeddings, rerankers, and NER models directly from Ruby using Rust-powered Candle with Metal/CUDA acceleration.
β˜†105Updated this week

Alternatives and similar repositories for red-candle

Users that are interested in red-candle are comparing it to the libraries listed below

Sorting: