Alternatives and similar repositories for mistral.rs

Users that are interested in mistral.rs are comparing it to the libraries listed below

• luminal-ai / luminal
  Deep learning at the speed of light.
  ☆2,652Updated this week
• floneum / floneum
  Instant, controllable, local pre-trained AI models in Rust
  ☆2,103Updated last week
• janhq / cortex.cpp
  Local AI API Platform
  ☆2,764Updated 5 months ago
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆6,557Updated 11 months ago
• evilsocket / cake
  Distributed LLM and StableDiffusion inference for mobile, desktop and server.
  ☆2,900Updated last year
• rustformers / llm
  [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
  ☆6,140Updated last year
• huggingface / candle
  Minimalist ML framework for Rust
  ☆18,892Updated this week
• LlamaEdge / LlamaEdge
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge
  ☆1,557Updated last week
• tracel-ai / burn
  Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
  ☆13,678Updated last week
• lancedb / lancedb
  Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.
  ☆8,264Updated this week
• intentee / paddler
  Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙
  ☆1,402Updated this week
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆4,321Updated last week
• mistralai / mistral-finetune
  ☆3,055Updated last month
• microsoft / aici
  AICI: Prompts as (Wasm) Programs
  ☆2,059Updated 11 months ago
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,623Updated 3 months ago
• SilasMarvin / lsp-ai
  LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software e…
  ☆3,074Updated 11 months ago
• unum-cloud / USearch
  Fast Open-Source Search & Clustering engine × for Vectors & Arbitrary Objects × in C++, C, Python, JavaScript, Rust, Java, Objective-C, S…
  ☆3,491Updated this week
• bionic-gpt / bionic-gpt
  Bionic is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality
  ☆2,278Updated 2 weeks ago
• zml / zml
  Any model. Any hardware. Zero compromise. Built with @ziglang / @openxla / MLIR / @bazelbuild
  ☆3,005Updated this week
• robertknight / ocrs
  Rust library and CLI tool for OCR (extracting text from images)
  ☆1,705Updated 2 weeks ago
• pykeio / ort
  Fast ML inference & training for ONNX models in Rust
  ☆1,831Updated last week
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,056Updated 2 years ago
• pepperoni21 / ollama-rs
  A simple and easy-to-use library for interacting with the Ollama API.
  ☆952Updated this week
• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆1,025Updated last year
• LaurentMazare / tch-rs
  Rust bindings for the C++ api of PyTorch.
  ☆5,191Updated last month
• tensorchord / pgvecto.rs
  Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.
  ☆2,134Updated 9 months ago
• pytorch / executorch
  On-device AI across mobile, embedded and edge for PyTorch
  ☆3,742Updated this week
• b4rtaz / distributed-llama
  Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
  ☆2,773Updated 2 weeks ago
• Abraxas-365 / langchain-rust
  🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust
  ☆1,186Updated 2 weeks ago
• cohere-ai / cohere-toolkit
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆3,155Updated this week