Alternatives and similar repositories for paddler

Users that are interested in paddler are comparing it to the libraries listed below

• felafax / felafax
  Felafax is building AI infra for non-NVIDIA GPUs
  ☆560Updated 4 months ago
• moritztng / fltr
  Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
  ☆380Updated last year
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆573Updated 4 months ago
• aphrodite-engine / aphrodite-engine
  Large-scale LLM inference engine
  ☆1,453Updated this week
• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆994Updated 7 months ago
• abgulati / LARS
  An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.
  ☆597Updated 7 months ago
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆750Updated 2 weeks ago
• arcee-ai / fastmlx
  FastMLX is a high performance production ready API to host MLX models.
  ☆308Updated 3 months ago
• postgresml / korvus
  Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python…
  ☆1,372Updated 4 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆584Updated this week
• mistralai / mistral-common
  Official inference library for pre-processing of Mistral models
  ☆742Updated this week
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆183Updated last year
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆272Updated 5 months ago
• mostlygeek / llama-swap
  Model swapping for llama.cpp (or any local OpenAPI compatible server)
  ☆961Updated this week
• Blaizzy / mlx-vlm
  MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
  ☆1,347Updated 2 weeks ago
• okuvshynov / slowllama
  Finetune llama2-70b and codellama on MacBook Air without quantization
  ☆447Updated last year
• tensorchord / VectorChord
  Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.
  ☆848Updated 2 weeks ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆217Updated 11 months ago
• mirth / chonky
  Fully neural approach for text chunking
  ☆357Updated last month
• mezbaul-h / june
  Local voice chatbot for engaging conversations, powered by Ollama, Hugging Face Transformers, and Coqui TTS Toolkit
  ☆773Updated 10 months ago
• riccardomusmeci / mlx-llm
  Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.
  ☆446Updated 4 months ago
• NeumTry / NeumAI
  Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
  ☆857Updated last year
• theroyallab / tabbyAPI
  The official API server for Exllama. OAI compatible, lightweight, and fast.
  ☆987Updated this week
• helixml / helix
  ♾️ Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class…
  ☆505Updated this week
• mustafaaljadery / lightning-whisper-mlx
  An extremely fast implementation of whisper optimized for Apple Silicon using MLX.
  ☆724Updated last year
• bananaml / fructose
  ☆745Updated last year
• ChuckHend / pg_vectorize
  The simplest way to build AI workloads on Postgres
  ☆794Updated this week
• huggingface / ratchet
  A cross-platform browser ML framework.
  ☆702Updated 6 months ago
• dipampaul17 / KVSplit
  Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …
  ☆351Updated last month
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆192Updated 11 months ago