Alternatives and similar repositories for fltr:

Users that are interested in fltr are comparing it to the libraries listed below

• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆737Updated last week
• EGjoni / DRUGS
  Stop messing around with finicky sampling parameters and just use DRµGS!
  ☆348Updated 10 months ago
• valine / NeuralFlow
  Visualize the intermediate output of Mistral 7B
  ☆354Updated 2 months ago
• jasonjmcghee / plock
  From anywhere you can type, query and stream the output of an LLM or any other script
  ☆493Updated last year
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆214Updated 6 months ago
• turboderp-org / exui
  Web UI for ExLlamaV2
  ☆491Updated 2 months ago
• pinokiocomputer / llamanet
  Replace OpenAI with Llama.cpp Automagically.
  ☆313Updated 10 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated 11 months ago
• AlexBuz / llama-zip
  LLM-powered lossless compression tool
  ☆279Updated 7 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆216Updated 9 months ago
• carsonpo / haystackdb
  ☆163Updated 10 months ago
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆264Updated 3 months ago
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆551Updated last month
• samuel-vitorino / lm.rs
  Minimal LLM inference in Rust
  ☆982Updated 5 months ago
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆130Updated 9 months ago
• mirth / chonky
  Fully neural approach for text chunking
  ☆26Updated this week
• galatolofederico / microchain
  function calling-based LLM agents
  ☆286Updated 7 months ago
• taylorai / aiq
  ai for jq
  ☆240Updated 6 months ago
• AndrewVeee / nucleo-ai
  An AI assistant beyond the chat box.
  ☆325Updated last year
• shadowfax92 / Fyin
  Open source alternative to Perplexity AI with ability to run locally
  ☆199Updated 6 months ago
• TheProxyCompany / proxy-structuring-engine
  Guaranteed Structured Output from any Language Model via Hierarchical State Machines
  ☆122Updated last week
• mezbaul-h / june
  Local voice chatbot for engaging conversations, powered by Ollama, Hugging Face Transformers, and Coqui TTS Toolkit
  ☆761Updated 8 months ago
• ShelbyJenkins / llm_client
  The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes
  ☆194Updated last month
• okuvshynov / slowllama
  Finetune llama2-70b and codellama on MacBook Air without quantization
  ☆448Updated last year
• Dicklesworthstone / fast_vector_similarity
  The Fast Vector Similarity Library is designed to provide efficient computation of various similarity measures between vectors.
  ☆385Updated last month
• AmineDiro / cria
  OpenAI compatible API for serving LLAMA-2 model
  ☆218Updated last year
• Noeda / rllama
  Rust+OpenCL+AVX2 implementation of LLaMA inference code
  ☆545Updated last year
• VivekPanyam / carton
  Run any ML model from any programming language.
  ☆422Updated last year
• guywaldman / orch
  Rust framework for LLM orchestration
  ☆202Updated 8 months ago
• edgenai / llama_cpp-rs
  High-level, optionally asynchronous Rust bindings to llama.cpp
  ☆216Updated 10 months ago