Alternatives and similar repositories for paddler

Users that are interested in paddler are comparing it to the libraries listed below

• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆1,013Updated last year
• moritztng / fltr
  Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
  ☆386Updated last year
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆718Updated 11 months ago
• trymirai / uzu
  A high-performance inference engine for AI models
  ☆1,343Updated this week
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆1,001Updated last week
• tensorchord / VectorChord
  Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.
  ☆1,184Updated last week
• SeekStorm / SeekStorm
  SeekStorm - sub-millisecond full-text search library & multi-tenancy server in Rust
  ☆1,746Updated last week
• EricLBuehler / candle-vllm
  Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
  ☆496Updated this week
• guidance-ai / llguidance
  Super-fast Structured Outputs
  ☆561Updated last week
• mostlygeek / llama-swap
  Reliable model swapping for any local OpenAI compatible server - llama.cpp, vllm, etc
  ☆1,730Updated this week
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆912Updated 2 weeks ago
• mirth / chonky
  Fully neural approach for text chunking
  ☆378Updated this week
• felafax / felafax
  Felafax is building AI infra for non-NVIDIA GPUs
  ☆568Updated 9 months ago
• HazyResearch / minions
  Big & Small LLMs working together
  ☆1,184Updated this week
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,567Updated 2 weeks ago
• Blaizzy / mlx-vlm
  MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
  ☆1,748Updated this week
• ShelbyJenkins / llm_client
  The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes
  ☆236Updated 2 months ago
• tensorlakeai / indexify
  A realtime serving engine for Data-Intensive Generative AI Applications
  ☆1,060Updated last week
• baehyunsol / ragit
  git-like rag pipeline
  ☆246Updated 2 weeks ago
• abgulati / LARS
  An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.
  ☆617Updated 11 months ago
• dezoito / ollama-grid-search
  A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.
  ☆847Updated 6 months ago
• StarlightSearch / EmbedAnything
  Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
  ☆742Updated last week
• postgresml / korvus
  Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python…
  ☆1,452Updated 8 months ago
• benbrandt / text-splitter
  Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from R…
  ☆508Updated this week
• helixml / helix
  ♾️ Helix is a private GenAI stack for building AI agents with declarative pipelines, knowledge (RAG), API bindings, and first-class testi…
  ☆521Updated this week
• Anush008 / fastembed-rs
  Rust library for generating vector embeddings, reranking. Re-write of qdrant/fastembed.
  ☆634Updated last month
• inferx-net / inferx
  InferX: Inference as a Service Platform
  ☆136Updated this week
• madroidmaq / mlx-omni-server
  MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…
  ☆583Updated last week
• M4THYOU / TokenDagger
  High-Performance Implementation of OpenAI's TikToken.
  ☆458Updated 3 months ago
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,149Updated this week