Alternatives and similar repositories for paddler:

Users that are interested in paddler are comparing it to the libraries listed below

• moritztng / fltr
  Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
  ☆376Updated last year
• mirth / chonky
  Fully neural approach for text chunking
  ☆341Updated last week
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆684Updated last week
• pinokiocomputer / llamanet
  Replace OpenAI with Llama.cpp Automagically.
  ☆318Updated 10 months ago
• tensorchord / VectorChord
  Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.
  ☆655Updated last week
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆556Updated 2 months ago
• abgulati / LARS
  An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.
  ☆582Updated 6 months ago
• mostlygeek / llama-swap
  Model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆662Updated this week
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆217Updated 10 months ago
• asg017 / sqlite-lembed
  A SQLite extension for generating text embeddings from GGUF models using llama.cpp
  ☆185Updated 5 months ago
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆269Updated 3 months ago
• Dicklesworthstone / swiss_army_llama
  A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…
  ☆1,014Updated 2 months ago
• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆983Updated 6 months ago
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆692Updated 2 weeks ago
• mezbaul-h / june
  Local voice chatbot for engaging conversations, powered by Ollama, Hugging Face Transformers, and Coqui TTS Toolkit
  ☆763Updated 8 months ago
• felafax / felafax
  Felafax is building AI infra for non-NVIDIA GPUs
  ☆559Updated 3 months ago
• mistralai / mistral-common
  ☆713Updated last month
• 1yefuwang1 / vectorlite
  Fast, SQL powered, in-process vector search for any language with an SQLite driver
  ☆299Updated 6 months ago
• fzliu / radient
  Radient turns many data types (not just text) into vectors for similarity search, RAG, regression analysis, and more.
  ☆275Updated last month
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,405Updated this week
• TheProxyCompany / proxy-structuring-engine
  Guaranteed Structured Output from any Language Model via Hierarchical State Machines
  ☆125Updated this week
• postgresml / korvus
  Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python…
  ☆1,359Updated 3 months ago
• babycommando / neuralgraffiti
  Live-bending a foundation model’s output at neural network level.
  ☆247Updated 3 weeks ago
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆295Updated last month
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆689Updated 5 months ago
• helixml / helix
  ♾️ Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class…
  ☆491Updated this week
• klara-research / klarity
  See Through Your Models
  ☆389Updated last month
• stanford-mast / blast
  Browser-LLM Auto-Scaling Technology
  ☆428Updated this week
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated last year
• jamsocket / forevervm
  Securely run AI-generated code in stateful sandboxes that run forever.
  ☆183Updated 2 weeks ago