Alternatives and similar repositories for mistral.rs

Users that are interested in mistral.rs are comparing it to the libraries listed below

• huggingface / candle
  Minimalist ML framework for Rust
  ☆17,510Updated this week
• jafioti / luminal
  Deep learning at the speed of light.
  ☆1,712Updated this week
• rustformers / llm
  [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
  ☆6,119Updated last year
• tracel-ai / burn
  Burn is a next generation Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
  ☆11,447Updated this week
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆5,827Updated 5 months ago
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,218Updated 3 weeks ago
• lancedb / lancedb
  Developer-friendly, embedded retrieval engine for multimodal AI. Search More; Manage Less.
  ☆6,802Updated this week
• menloresearch / cortex.cpp
  Local AI API Platform
  ☆2,761Updated 2 weeks ago
• evilsocket / cake
  Distributed LLM and StableDiffusion inference for mobile, desktop and server.
  ☆2,866Updated 8 months ago
• ridgerchu / matmulfreellm
  Implementation for MatMul-free LM.
  ☆3,012Updated 7 months ago
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆3,731Updated this week
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,594Updated last month
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆9,760Updated this week
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,224Updated 4 months ago
• floneum / floneum
  Instant, controllable, local pre-trained AI models in Rust
  ☆1,920Updated this week
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,051Updated last year
• bionic-gpt / bionic-gpt
  BionicGPT is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentialit…
  ☆2,197Updated this week
• pytorch / torchtune
  PyTorch native post-training library
  ☆5,296Updated this week
• dottxt-ai / outlines
  Structured Outputs
  ☆11,990Updated this week
• Mozilla-Ocho / llamafile
  Distribute and run LLMs with a single file.
  ☆22,681Updated this week
• webonnx / wonnx
  A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web
  ☆1,729Updated 11 months ago
• mistralai / mistral-finetune
  ☆2,973Updated 9 months ago
• zml / zml
  Any model. Any hardware. Zero compromise. Built with @ziglang / @openxla / MLIR / @bazelbuild
  ☆2,353Updated this week
• huggingface / safetensors
  Simple, safe way to store and distribute tensors
  ☆3,334Updated last week
• pykeio / ort
  Fast ML inference & training for ONNX models in Rust
  ☆1,403Updated 2 weeks ago
• ggml-org / ggml
  Tensor library for machine learning
  ☆12,738Updated last week
• tairov / llama2.mojo
  Inference Llama 2 in one file of pure 🔥
  ☆2,114Updated last year
• LaurentMazare / tch-rs
  Rust bindings for the C++ api of PyTorch.
  ☆4,877Updated last month
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆704Updated 7 months ago
• ml-explore / mlx-examples
  Examples in the MLX framework
  ☆7,580Updated 3 weeks ago