Alternatives and similar repositories for llm

Users that are interested in llm are comparing it to the libraries listed below

• guillaume-be / rust-bert
  Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
  ☆2,998Updated 6 months ago
• huggingface / candle
  Minimalist ML framework for Rust
  ☆18,718Updated last week
• tracel-ai / burn
  Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
  ☆13,564Updated last week
• LaurentMazare / tch-rs
  Rust bindings for the C++ api of PyTorch.
  ☆5,160Updated last month
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,056Updated 2 years ago
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,262Updated this week
• sobelio / llm-chain
  `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tas…
  ☆1,569Updated last year
• rust-ml / linfa
  A Rust machine learning framework.
  ☆4,450Updated this week
• webonnx / wonnx
  A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
  ☆1,740Updated last year
• chelsea0x3b / dfdx
  Deep learning in Rust, with shape checked tensors and neural networks
  ☆1,872Updated last year
• floneum / floneum
  Instant, controllable, local pre-trained AI models in Rust
  ☆2,089Updated last week
• ggml-org / ggml
  Tensor library for machine learning
  ☆13,681Updated 2 weeks ago
• Rust-GPU / rust-cuda
  Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
  ☆4,909Updated this week
• 64bit / async-openai
  Rust library for OpenAI
  ☆1,690Updated last week
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,843Updated last year
• openlm-research / open_llama
  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
  ☆7,527Updated 2 years ago
• pykeio / ort
  Fast ML inference & training for ONNX models in Rust
  ☆1,785Updated this week
• vaaaaanquish / Awesome-Rust-MachineLearning
  This repository is a list of machine learning libraries written in Rust. It's a compilation of GitHub repositories, blogs, books, movies,…
  ☆2,214Updated 2 years ago
• mlc-ai / web-stable-diffusion
  Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
  ☆3,700Updated last year
• ravenscroftj / turbopilot
  Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU
  ☆3,810Updated 2 years ago
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,194Updated 2 years ago
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,472Updated 6 months ago
• makepad / makepad
  Makepad is a creative software development platform for Rust that compiles to wasm/webGL, osx/metal, windows/dx11 linux/opengl
  ☆5,965Updated this week
• evcxr / evcxr
  ☆6,273Updated 2 months ago
• nat / openplayground
  An LLM playground you can run on your laptop
  ☆6,365Updated 2 months ago
• trifectatechfoundation / teach-rs
  A modular, reusable university course for Rust
  ☆3,309Updated 2 weeks ago
• keyvank / femtoGPT
  Pure Rust implementation of a minimal Generative Pretrained Transformer
  ☆930Updated last month
• sonos / tract
  Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference
  ☆2,679Updated this week
• luminal-ai / luminal
  Deep learning at the speed of light.
  ☆2,642Updated 3 weeks ago
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,983Updated last year