Alternatives and similar repositories for llm

Users that are interested in llm are comparing it to the libraries listed below

• huggingface / candle
  Minimalist ML framework for Rust
  ☆17,346Updated last week
• guillaume-be / rust-bert
  Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
  ☆2,861Updated last week
• tracel-ai / burn
  Burn is a next generation Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
  ☆11,307Updated this week
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,054Updated last year
• LaurentMazare / tch-rs
  Rust bindings for the C++ api of PyTorch.
  ☆4,827Updated 3 weeks ago
• ggml-org / ggml
  Tensor library for machine learning
  ☆12,640Updated last week
• webonnx / wonnx
  A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
  ☆1,728Updated 10 months ago
• rust-ml / linfa
  A Rust machine learning framework.
  ☆4,174Updated 2 weeks ago
• coreylowman / dfdx
  Deep learning in Rust, with shape checked tensors and neural networks
  ☆1,821Updated 10 months ago
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,657Updated 9 months ago
• quickwit-oss / tantivy
  Tantivy is a full-text search engine library inspired by Apache Lucene and written in Rust
  ☆13,235Updated 3 weeks ago
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆5,699Updated this week
• sonos / tract
  Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference
  ☆2,461Updated this week
• openlm-research / open_llama
  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
  ☆7,498Updated last year
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,417Updated this week
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,229Updated 2 years ago
• tairov / llama2.mojo
  Inference Llama 2 in one file of pure 🔥
  ☆2,113Updated last year
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,910Updated 10 months ago
• Noeda / rllama
  Rust+OpenCL+AVX2 implementation of LLaMA inference code
  ☆549Updated last year
• Rust-GPU / Rust-CUDA
  Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
  ☆4,451Updated 2 weeks ago
• FMInference / FlexLLMGen
  Running large language models on a single GPU for throughput-oriented scenarios.
  ☆9,328Updated 7 months ago
• evcxr / evcxr
  ☆6,060Updated 3 weeks ago
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,475Updated last year
• vaaaaanquish / Awesome-Rust-MachineLearning
  This repository is a list of machine learning libraries written in Rust. It's a compilation of GitHub repositories, blogs, books, movies,…
  ☆2,132Updated last year
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,190Updated this week
• keyvank / femtoGPT
  Pure Rust implementation of a minimal Generative Pretrained Transformer
  ☆885Updated 9 months ago
• cberner / redb
  An embedded key-value database in pure Rust
  ☆3,723Updated this week
• rayon-rs / rayon
  Rayon: A data parallelism library for Rust
  ☆11,825Updated 2 months ago
• Lightning-AI / lit-llama
  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…
  ☆6,065Updated 9 months ago
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆20,747Updated this week