Alternatives and similar repositories for llm

Users that are interested in llm are comparing it to the libraries listed below

• huggingface / candle
  Minimalist ML framework for Rust
  ☆17,418Updated 2 weeks ago
• tracel-ai / burn
  Burn is a next generation Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
  ☆11,379Updated this week
• guillaume-be / rust-bert
  Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
  ☆2,867Updated last week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆5,742Updated this week
• LaurentMazare / tch-rs
  Rust bindings for the C++ api of PyTorch.
  ☆4,847Updated last month
• webonnx / wonnx
  A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
  ☆1,728Updated 11 months ago
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,051Updated last year
• openlm-research / open_llama
  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
  ☆7,498Updated last year
• ggml-org / ggml
  Tensor library for machine learning
  ☆12,697Updated last week
• rust-ml / linfa
  A Rust machine learning framework.
  ☆4,190Updated 3 weeks ago
• Rust-GPU / Rust-CUDA
  Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
  ☆4,464Updated 3 weeks ago
• coreylowman / dfdx
  Deep learning in Rust, with shape checked tensors and neural networks
  ☆1,823Updated 10 months ago
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,421Updated 2 weeks ago
• sobelio / llm-chain
  `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tas…
  ☆1,501Updated 7 months ago
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,675Updated 9 months ago
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,227Updated 2 years ago
• evcxr / evcxr
  ☆6,072Updated this week
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,917Updated 10 months ago
• turboderp / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆2,882Updated last year
• floneum / floneum
  Instant, controllable, local pre-trained AI models in Rust
  ☆1,911Updated this week
• 64bit / async-openai
  Rust library for OpenAI
  ☆1,477Updated last week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,236Updated this week
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,213Updated 2 weeks ago
• huggingface / safetensors
  Simple, safe way to store and distribute tensors
  ☆3,311Updated this week
• Stability-AI / StableLM
  StableLM: Stability AI Language Models
  ☆15,828Updated last year
• nebuly-ai / optimate
  A collection of libraries to optimise AI model performances
  ☆8,373Updated 10 months ago
• qwopqwop200 / GPTQ-for-LLaMa
  4 bits quantization of LLaMA using GPTQ
  ☆3,057Updated 11 months ago
• FMInference / FlexLLMGen
  Running large language models on a single GPU for throughput-oriented scenarios.
  ☆9,338Updated 7 months ago
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,500Updated last year
• ravenscroftj / turbopilot
  Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU
  ☆3,818Updated last year