Alternatives and similar repositories for fltr

Users that are interested in fltr are comparing it to the libraries listed below

• EGjoni / DRUGS
  Stop messing around with finicky sampling parameters and just use DRµGS!
  ☆358Updated last year
• intentee / paddler
  Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙
  ☆1,345Updated last week
• jasonjmcghee / plock
  From anywhere you can type, query and stream the output of any script (e.g. an LLM)
  ☆501Updated last year
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆138Updated last year
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆511Updated 8 months ago
• pinokiocomputer / llamanet
  Replace OpenAI with Llama.cpp Automagically.
  ☆324Updated last year
• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆1,014Updated last year
• AlexBuz / llama-zip
  LLM-powered lossless compression tool
  ☆289Updated last year
• valine / NeuralFlow
  Visualize the intermediate output of Mistral 7B
  ☆375Updated 9 months ago
• AndrewVeee / nucleo-ai
  An AI assistant beyond the chat box.
  ☆327Updated last year
• cztomsik / ava
  All-in-one desktop app for running LLMs locally.
  ☆464Updated 2 months ago
• TheProxyCompany / proxy-structuring-engine
  Guaranteed Structured Output from any Language Model via Hierarchical State Machines
  ☆145Updated 3 weeks ago
• ShelbyJenkins / llm_client
  The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes
  ☆238Updated 2 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆223Updated last year
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆216Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆188Updated last year
• sam-paech / antislop-sampler
  ☆319Updated 3 months ago
• spyglass-search / memex
  Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.
  ☆62Updated 2 years ago
• okuvshynov / slowllama
  Finetune llama2-70b and codellama on MacBook Air without quantization
  ☆450Updated last year
• VivekPanyam / carton
  Run any ML model from any programming language.
  ☆425Updated last year
• shadowfax92 / Fyin
  Open source alternative to Perplexity AI with ability to run locally
  ☆219Updated last year
• galatolofederico / microchain
  function calling-based LLM agents
  ☆289Updated last year
• aseichter2007 / ClipboardConqueror
  Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.
  ☆426Updated 9 months ago
• bwasti / btb
  Blue-text Bot AI. Uses Ollama + AppleScript
  ☆50Updated last year
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆150Updated 2 years ago
• babycommando / neuralgraffiti
  Live-bending a foundation model’s output at neural network level.
  ☆269Updated 6 months ago
• carsonpo / haystackdb
  ☆163Updated last year
• Noeda / rllama
  Rust+OpenCL+AVX2 implementation of LLaMA inference code
  ☆548Updated last year
• Mozilla-Ocho / Memory-Cache
  MemoryCache is an experimental development project to turn a local desktop environment into an on-device AI agent
  ☆563Updated last year
• belladoreai / llama-tokenizer-js
  JS tokenizer for LLaMA 1 and 2
  ☆360Updated last year