Alternatives and similar repositories for mistral.rs

Users that are interested in mistral.rs are comparing it to the libraries listed below

• luminal-ai / luminal
  Deep learning at the speed of light.
  ☆2,596Updated last week
• huggingface / candle
  Minimalist ML framework for Rust
  ☆18,543Updated this week
• evilsocket / cake
  Distributed LLM and StableDiffusion inference for mobile, desktop and server.
  ☆2,888Updated last year
• floneum / floneum
  Instant, controllable, local pre-trained AI models in Rust
  ☆2,065Updated this week
• tracel-ai / burn
  Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
  ☆13,411Updated this week
• janhq / cortex.cpp
  Local AI API Platform
  ☆2,763Updated 4 months ago
• rustformers / llm
  [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
  ☆6,134Updated last year
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆6,395Updated 9 months ago
• LlamaEdge / LlamaEdge
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
  ☆1,537Updated 3 weeks ago
• microsoft / aici
  AICI: Prompts as (Wasm) Programs
  ☆2,052Updated 9 months ago
• lancedb / lancedb
  Developer-friendly, embedded retrieval engine for multimodal AI. Search More; Manage Less.
  ☆7,931Updated this week
• bionic-gpt / bionic-gpt
  Bionic is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality
  ☆2,264Updated this week
• intentee / paddler
  Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙
  ☆1,360Updated 3 weeks ago
• cohere-ai / cohere-toolkit
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆3,143Updated 3 weeks ago
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆4,177Updated last week
• mistralai / mistral-finetune
  ☆3,037Updated last year
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,053Updated last year
• tairov / llama2.mojo
  Inference Llama 2 in one file of pure 🔥
  ☆2,118Updated last month
• pykeio / ort
  Fast ML inference & training for ONNX models in Rust
  ☆1,698Updated this week
• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆1,015Updated last year
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆719Updated 11 months ago
• ml-explore / mlx-examples
  Examples in the MLX framework
  ☆7,978Updated last month
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,361Updated 2 months ago
• 0xPlaygrounds / rig
  ⚙️🦀 Build modular and scalable LLM Applications in Rust
  ☆4,848Updated last week
• dottxt-ai / outlines
  Structured Outputs
  ☆12,810Updated 2 weeks ago
• truefoundry / cognita
  RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
  ☆4,277Updated 2 months ago
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,617Updated 2 months ago
• Abraxas-365 / langchain-rust
  🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust
  ☆1,152Updated this week
• ggml-org / ggml
  Tensor library for machine learning
  ☆13,532Updated this week
• google / gemma.cpp
  lightweight, standalone C++ inference engine for Google's Gemma models.
  ☆6,609Updated last week