Alternatives and similar repositories for paddler

Users that are interested in paddler are comparing it to the libraries listed below

• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆1,029Updated last year
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆744Updated last year
• moritztng / fltr
  Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
  ☆385Updated last year
• trymirai / uzu
  A high-performance inference engine for AI models
  ☆1,419Updated this week
• EricLBuehler / candle-vllm
  Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
  ☆587Updated last week
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆987Updated last month
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆1,139Updated 2 weeks ago
• SeekStorm / SeekStorm
  SeekStorm - sub-millisecond full-text search library & multi-tenancy server in Rust
  ☆1,823Updated this week
• helixml / helix
  ♾️ Helix is a private GenAI stack for building AI agents with declarative pipelines, knowledge (RAG), API bindings, and first-class testi…
  ☆712Updated this week
• tensorlakeai / indexify
  A realtime serving engine for Data-Intensive Generative AI Applications
  ☆1,094Updated last week
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,641Updated 2 weeks ago
• mostlygeek / llama-swap
  Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
  ☆2,311Updated this week
• guidance-ai / llguidance
  Super-fast Structured Outputs
  ☆670Updated last week
• utilityai / llama-cpp-rs
  ☆453Updated this week
• EricLBuehler / mistral.rs
  Fast, flexible LLM inference
  ☆6,449Updated last week
• Anush008 / fastembed-rs
  Rust library for vector embeddings and reranking.
  ☆748Updated 2 weeks ago
• ShelbyJenkins / llm_client
  The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes
  ☆242Updated 6 months ago
• wilsonzlin / CoreNN
  Embeddable library or single binary for indexing and searching 1B vectors
  ☆366Updated last month
• benbrandt / text-splitter
  Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from R…
  ☆551Updated this week
• felafax / felafax
  Felafax is building AI infra for non-NVIDIA GPUs
  ☆570Updated last year
• lucasjinreal / Crane
  A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler …
  ☆241Updated last week
• b4rtaz / distributed-llama
  Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
  ☆2,815Updated 2 weeks ago
• mirth / chonky
  Fully neural approach for text chunking
  ☆406Updated 3 months ago
• Oxen-AI / Oxen
  Lightning fast data version control system for structured and unstructured machine learning datasets. We aim to make versioning datasets …
  ☆1,084Updated this week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆1,587Updated this week
• tensorchord / VectorChord
  Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.
  ☆1,527Updated last week
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆615Updated 11 months ago
• bosun-ai / swiftide
  Fast, streaming indexing, query, and agentic LLM applications in Rust
  ☆653Updated last week
• HazyResearch / minions
  Big & Small LLMs working together
  ☆1,258Updated this week
• dleemiller / WordLlama
  Things you can do with the token embeddings of an LLM
  ☆1,452Updated 2 months ago