Alternatives and similar repositories for llm

Users that are interested in llm are comparing it to the libraries listed below

• huggingface / candle
  Minimalist ML framework for Rust
  ☆17,261Updated this week
• guillaume-be / rust-bert
  Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
  ☆2,851Updated 2 months ago
• ggml-org / ggml
  Tensor library for machine learning
  ☆12,591Updated last week
• tracel-ai / burn
  Burn is a next generation Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
  ☆11,203Updated this week
• LaurentMazare / tch-rs
  Rust bindings for the C++ api of PyTorch.
  ☆4,805Updated 2 weeks ago
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,050Updated last year
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,229Updated 2 years ago
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,634Updated 8 months ago
• webonnx / wonnx
  A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
  ☆1,728Updated 10 months ago
• Rust-GPU / Rust-CUDA
  Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
  ☆4,427Updated this week
• rust-ml / linfa
  A Rust machine learning framework.
  ☆4,153Updated this week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆5,644Updated this week
• evcxr / evcxr
  ☆6,044Updated last week
• cberner / redb
  An embedded key-value database in pure Rust
  ☆3,695Updated this week
• coreylowman / dfdx
  Deep learning in Rust, with shape checked tensors and neural networks
  ☆1,815Updated 10 months ago
• AmbientRun / Ambient
  The multiplayer game engine
  ☆3,854Updated 4 months ago
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,904Updated 10 months ago
• Lightning-AI / lit-llama
  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…
  ☆6,060Updated 8 months ago
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,411Updated 9 months ago
• bigcode-project / starcoder
  Home of StarCoder: fine-tuning & inference!
  ☆7,416Updated last year
• rayon-rs / rayon
  Rayon: A data parallelism library for Rust
  ☆11,796Updated last month
• openlm-research / open_llama
  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
  ☆7,493Updated last year
• sobelio / llm-chain
  `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tas…
  ☆1,487Updated 7 months ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,168Updated 3 weeks ago
• ArroyoSystems / arroyo
  Distributed stream processing engine in Rust
  ☆4,349Updated this week
• obi1kenobi / trustfall
  A query engine for any combination of data sources. Query your files and APIs as if they were databases!
  ☆2,709Updated this week
• plotters-rs / plotters
  A rust drawing library for high quality data plotting for both WASM and native, statically and realtimely 🦀 📈🚀
  ☆4,187Updated 2 months ago
• GitoxideLabs / gitoxide
  An idiomatic, lean, fast & safe pure Rust implementation of Git
  ☆9,867Updated this week
• crablang / crab
  A community fork of a language named after a plant fungus. All of the memory-safe features you love, now with 100% less bureaucracy!
  ☆5,133Updated 9 months ago
• tokio-rs / console
  a debugger for async rust!
  ☆3,938Updated 2 weeks ago