Alternatives and similar repositories for paddler:

Users that are interested in paddler are comparing it to the libraries listed below

• moritztng / fltr
  Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
  ☆380Updated last year
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆620Updated last week
• mostlygeek / llama-swap
  transparent proxy server for llama.cpp's server to provide automatic model swapping
  ☆460Updated this week
• abgulati / LARS
  An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.
  ☆566Updated 4 months ago
• felafax / felafax
  Felafax is building AI infra for non-NVIDIA GPUs
  ☆555Updated last month
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆545Updated last month
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆261Updated 2 months ago
• tensorchord / VectorChord
  Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.
  ☆526Updated this week
• pinokiocomputer / llamanet
  Replace OpenAI with Llama.cpp Automagically.
  ☆311Updated 9 months ago
• dleemiller / WordLlama
  Things you can do with the token embeddings of an LLM
  ☆1,432Updated last month
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆215Updated 8 months ago
• Dicklesworthstone / swiss_army_llama
  A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for vario…
  ☆1,009Updated 3 weeks ago
• okuvshynov / slowllama
  Finetune llama2-70b and codellama on MacBook Air without quantization
  ☆448Updated 11 months ago
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆669Updated 3 months ago
• helixml / helix
  🧬 Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class…
  ☆472Updated this week
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated 10 months ago
• tembo-io / pg_vectorize
  The simplest way to build AI workloads on Postgres
  ☆765Updated this week
• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆980Updated 4 months ago
• ggml-org / llama.vscode
  VS Code extension for LLM-assisted code/text completion
  ☆608Updated this week
• labmlai / inspectus
  LLM Analytics
  ☆646Updated 5 months ago
• tensorlakeai / indexify
  A realtime serving engine for Data-Intensive Generative AI Applications
  ☆980Updated this week
• AlexBuz / llama-zip
  LLM-powered lossless compression tool
  ☆274Updated 7 months ago
• carsonpo / haystackdb
  ☆163Updated 9 months ago
• postgresml / korvus
  Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python…
  ☆1,343Updated last month
• PaulPauls / llama3_interpretability_sae
  A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and full…
  ☆601Updated 3 months ago
• ggml-org / p1
  LLM-based code completion engine
  ☆181Updated last month
• TheProxyCompany / proxy-structuring-engine
  Dynamically structure language models to produce outputs that adhere to specific requirements without sacrificing their creative capabili…
  ☆118Updated last week
• 1yefuwang1 / vectorlite
  Fast, SQL powered, in-process vector search for any language with an SQLite driver
  ☆292Updated 4 months ago