Alternatives and similar repositories for fltr:

Users that are interested in fltr are comparing it to the libraries listed below

• jasonjmcghee / plock
  From anywhere you can type, query and stream the output of an LLM or any other script
  ☆494Updated last year
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆753Updated last week
• AndrewVeee / nucleo-ai
  An AI assistant beyond the chat box.
  ☆328Updated last year
• pinokiocomputer / llamanet
  Replace OpenAI with Llama.cpp Automagically.
  ☆318Updated 11 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated last year
• EGjoni / DRUGS
  Stop messing around with finicky sampling parameters and just use DRµGS!
  ☆349Updated 11 months ago
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆214Updated 7 months ago
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆131Updated 9 months ago
• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆983Updated 6 months ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆493Updated 3 months ago
• okuvshynov / slowllama
  Finetune llama2-70b and codellama on MacBook Air without quantization
  ☆448Updated last year
• cztomsik / ava
  All-in-one desktop app for running LLMs locally.
  ☆445Updated last week
• aseichter2007 / ClipboardConqueror
  Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.
  ☆400Updated 4 months ago
• valine / NeuralFlow
  Visualize the intermediate output of Mistral 7B
  ☆360Updated 3 months ago
• sam-paech / antislop-sampler
  ☆288Updated last month
• ShelbyJenkins / llm_client
  The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes
  ☆196Updated 2 months ago
• ggml-org / p1
  LLM-based code completion engine
  ☆185Updated 3 months ago
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆116Updated 4 months ago
• AlexBuz / llama-zip
  LLM-powered lossless compression tool
  ☆280Updated 8 months ago
• carsonpo / haystackdb
  ☆163Updated 11 months ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆454Updated last year
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆558Updated 2 months ago
• armbues / SiLLM
  SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  ☆264Updated this week
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆217Updated 10 months ago
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆180Updated last year
• edgenai / llama_cpp-rs
  High-level, optionally asynchronous Rust bindings to llama.cpp
  ☆220Updated 11 months ago
• VivekPanyam / carton
  Run any ML model from any programming language.
  ☆423Updated last year
• AmineDiro / cria
  OpenAI compatible API for serving LLAMA-2 model
  ☆218Updated last year
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆270Updated 4 months ago
• zenoverflow / omnichain
  Efficient visual programming for AI language models
  ☆359Updated 8 months ago