Alternatives and similar repositories for paddler

Users that are interested in paddler are comparing it to the libraries listed below

• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆1,012Updated 10 months ago
• moritztng / fltr
  Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
  ☆384Updated last year
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆712Updated 9 months ago
• trymirai / uzu
  A high-performance inference engine for AI models
  ☆1,264Updated this week
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆917Updated this week
• ShelbyJenkins / llm_client
  The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes
  ☆229Updated 2 weeks ago
• tensorchord / VectorChord
  Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.
  ☆1,031Updated this week
• EricLBuehler / candle-vllm
  Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
  ☆420Updated last week
• guywaldman / orch
  Rust framework for LLM orchestration
  ☆204Updated last year
• tensorlakeai / indexify
  A realtime serving engine for Data-Intensive Generative AI Applications
  ☆1,049Updated this week
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆843Updated 3 weeks ago
• guidance-ai / llguidance
  Super-fast Structured Outputs
  ☆432Updated last week
• SeekStorm / SeekStorm
  SeekStorm - sub-millisecond full-text search library & multi-tenancy server in Rust
  ☆1,721Updated 2 weeks ago
• mostlygeek / llama-swap
  Model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆1,333Updated last week
• StarlightSearch / EmbedAnything
  Production-ready Inference, Ingestion and Indexing built in Rust 🦀
  ☆694Updated this week
• bosun-ai / swiftide
  Fast, streaming indexing, query, and agentic LLM applications in Rust
  ☆540Updated this week
• baehyunsol / ragit
  git-like rag pipeline
  ☆243Updated 3 weeks ago
• felafax / felafax
  Felafax is building AI infra for non-NVIDIA GPUs
  ☆567Updated 7 months ago
• MinishLab / model2vec-rs
  Official Rust Implementation of Model2Vec
  ☆124Updated last month
• Anush008 / fastembed-rs
  Rust library for generating vector embeddings, reranking. Re-write of qdrant/fastembed.
  ☆573Updated last week
• helixml / helix
  ♾️ Helix is a private GenAI stack for building AI agents with declarative pipelines, knowledge (RAG), API bindings, and first-class testi…
  ☆515Updated this week
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆587Updated 6 months ago
• mirth / chonky
  Fully neural approach for text chunking
  ☆368Updated 3 months ago
• srush / llama2.rs
  A fast llama2 decoder in pure Rust.
  ☆1,055Updated last year
• dottxt-ai / outlines-core
  Faster structured generation
  ☆242Updated 3 months ago
• benbrandt / text-splitter
  Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from R…
  ☆465Updated this week
• utilityai / llama-cpp-rs
  ☆342Updated this week
• postgresml / korvus
  Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python…
  ☆1,392Updated 6 months ago
• mdrokz / rust-llama.cpp
  LLama.cpp rust bindings
  ☆398Updated last year
• edgenai / llama_cpp-rs
  High-level, optionally asynchronous Rust bindings to llama.cpp
  ☆228Updated last year