Alternatives and similar repositories for llm:

Users that are interested in llm are comparing it to the libraries listed below

• huggingface / candle
  Minimalist ML framework for Rust
  ☆16,309Updated this week
• tracel-ai / burn
  Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability…
  ☆9,436Updated this week
• ggerganov / ggml
  Tensor library for machine learning
  ☆11,541Updated this week
• LaurentMazare / tch-rs
  Rust bindings for the C++ api of PyTorch.
  ☆4,500Updated last week
• guillaume-be / rust-bert
  Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
  ☆2,707Updated 3 weeks ago
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,349Updated 4 months ago
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,240Updated last year
• qdrant / qdrant
  Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cl…
  ☆21,364Updated this week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆9,592Updated this week
• FMInference / FlexLLMGen
  Running large language models on a single GPU for throughput-oriented scenarios.
  ☆9,254Updated 2 months ago
• rust-ml / linfa
  A Rust machine learning framework.
  ☆3,877Updated this week
• coreylowman / dfdx
  Deep learning in Rust, with shape checked tensors and neural networks
  ☆1,766Updated 5 months ago
• webonnx / wonnx
  A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
  ☆1,693Updated 5 months ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆8,420Updated last week
• Rust-GPU / Rust-CUDA
  Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
  ☆3,243Updated last year
• evcxr / evcxr
  ☆5,696Updated 3 months ago
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆4,826Updated this week
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,027Updated last year
• quickwit-oss / tantivy
  Tantivy is a full-text search engine library inspired by Apache Lucene and written in Rust
  ☆12,514Updated this week
• sobelio / llm-chain
  `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tas…
  ☆1,407Updated 2 months ago
• openlm-research / open_llama
  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
  ☆7,417Updated last year
• openai / tiktoken
  tiktoken is a fast BPE tokeniser for use with OpenAI's models.
  ☆13,023Updated 3 months ago
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,168Updated 7 months ago
• vaaaaanquish / Awesome-Rust-MachineLearning
  This repository is a list of machine learning libraries written in Rust. It's a compilation of GitHub repositories, blogs, books, movies,…
  ☆2,018Updated last year
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,758Updated 5 months ago
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆17,858Updated 5 months ago
• rayon-rs / rayon
  Rayon: A data parallelism library for Rust
  ☆11,336Updated last month
• chroma-core / chroma
  the AI-native open-source embedding database
  ☆17,023Updated this week
• mlc-ai / web-stable-diffusion
  Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
  ☆3,625Updated 10 months ago