Alternatives and similar repositories for llm:

Users that are interested in llm are comparing it to the libraries listed below

• huggingface / candle
  Minimalist ML framework for Rust
  ☆16,839Updated last week
• tracel-ai / burn
  Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability…
  ☆10,032Updated this week
• guillaume-be / rust-bert
  Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
  ☆2,784Updated 2 weeks ago
• ggml-org / ggml
  Tensor library for machine learning
  ☆12,138Updated last week
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,046Updated last year
• LaurentMazare / tch-rs
  Rust bindings for the C++ api of PyTorch.
  ☆4,667Updated last week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆5,240Updated this week
• rust-ml / linfa
  A Rust machine learning framework.
  ☆4,013Updated 2 weeks ago
• coreylowman / dfdx
  Deep learning in Rust, with shape checked tensors and neural networks
  ☆1,793Updated 8 months ago
• webonnx / wonnx
  A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
  ☆1,715Updated 8 months ago
• Rust-GPU / Rust-CUDA
  Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
  ☆3,878Updated this week
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,508Updated 6 months ago
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,322Updated 9 months ago
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,842Updated 7 months ago
• floneum / floneum
  Instant, controllable, local pre-trained AI models in Rust
  ☆1,792Updated this week
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,237Updated last year
• Lightning-AI / lit-llama
  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…
  ☆6,043Updated 6 months ago
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆6,831Updated 8 months ago
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆9,905Updated this week
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,358Updated 7 months ago
• linebender / druid
  A data-first Rust-native UI design toolkit.
  ☆9,648Updated 4 months ago
• rerun-io / rerun
  Visualize streams of multimodal data. Free, fast, easy to use, and simple to integrate. Built in Rust.
  ☆7,985Updated this week
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆18,196Updated 7 months ago
• evcxr / evcxr
  ☆5,817Updated this week
• launchbadge / sqlx
  🧰 The Rust SQL Toolkit. An async, pure Rust SQL crate featuring compile-time checked queries without a DSL. Supports PostgreSQL, MySQL, …
  ☆14,373Updated last week
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆10,993Updated this week
• vaaaaanquish / Awesome-Rust-MachineLearning
  This repository is a list of machine learning libraries written in Rust. It's a compilation of GitHub repositories, blogs, books, movies,…
  ☆2,074Updated last year
• makepad / makepad
  Makepad is a creative software development platform for Rust that compiles to wasm/webGL, osx/metal, windows/dx11 linux/opengl
  ☆5,321Updated this week
• sobelio / llm-chain
  `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tas…
  ☆1,455Updated 4 months ago
• 64bit / async-openai
  Rust library for OpenAI
  ☆1,347Updated last week