Alternatives and similar repositories for llm

Users that are interested in llm are comparing it to the libraries listed below

• huggingface / candle
  Minimalist ML framework for Rust
  ☆18,341Updated this week
• tracel-ai / burn
  Burn is a next generation Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
  ☆13,140Updated this week
• guillaume-be / rust-bert
  Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
  ☆2,964Updated 4 months ago
• floneum / floneum
  Instant, controllable, local pre-trained AI models in Rust
  ☆2,041Updated this week
• LaurentMazare / tch-rs
  Rust bindings for the C++ api of PyTorch.
  ☆5,073Updated last week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,149Updated this week
• rust-ml / linfa
  A Rust machine learning framework.
  ☆4,360Updated 3 weeks ago
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,052Updated last year
• coreylowman / dfdx
  Deep learning in Rust, with shape checked tensors and neural networks
  ☆1,853Updated last year
• 64bit / async-openai
  Rust library for OpenAI
  ☆1,639Updated this week
• sobelio / llm-chain
  `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tas…
  ☆1,552Updated 11 months ago
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,820Updated last year
• Rust-GPU / rust-cuda
  Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
  ☆4,770Updated last week
• bionic-gpt / bionic-gpt
  Bionic is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality
  ☆2,265Updated this week
• webonnx / wonnx
  A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
  ☆1,736Updated last year
• cberner / redb
  An embedded key-value database in pure Rust
  ☆4,000Updated last week
• shuttle-hq / shuttle
  Build & ship backends without writing any infrastructure files.
  ☆6,703Updated this week
• ggml-org / ggml
  Tensor library for machine learning
  ☆13,302Updated last week
• evcxr / evcxr
  ☆6,211Updated 2 weeks ago
• trunk-rs / trunk
  Build, bundle & ship your Rust WASM application to the web.
  ☆4,019Updated last month
• keyvank / femtoGPT
  Pure Rust implementation of a minimal Generative Pretrained Transformer
  ☆915Updated 3 months ago
• ravenscroftj / turbopilot
  Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU
  ☆3,812Updated 2 years ago
• poem-web / poem
  A full-featured and easy-to-use web framework with the Rust programming language.
  ☆4,224Updated last week
• yuankunzhang / charming
  A visualization library for Rust
  ☆2,409Updated 2 months ago
• vaaaaanquish / Awesome-Rust-MachineLearning
  This repository is a list of machine learning libraries written in Rust. It's a compilation of GitHub repositories, blogs, books, movies,…
  ☆2,195Updated 2 years ago
• pykeio / ort
  Fast ML inference & training for ONNX models in Rust
  ☆1,642Updated last week
• makepad / makepad
  Makepad is a creative software development platform for Rust that compiles to wasm/webGL, osx/metal, windows/dx11 linux/opengl
  ☆5,930Updated this week
• apache / opendal
  Apache OpenDAL: One Layer, All Storage.
  ☆4,502Updated last week
• youki-dev / youki
  A container runtime written in Rust
  ☆7,014Updated this week
• GitoxideLabs / gitoxide
  An idiomatic, lean, fast & safe pure Rust implementation of Git
  ☆10,457Updated this week