Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
☆387Mar 13, 2024Updated last year
Alternatives and similar repositories for fltr
Users that are interested in fltr are comparing it to the libraries listed below
Sorting:
- ☆45May 5, 2024Updated last year
- an auto-sleeping and -waking framework around llama.cpp☆12Feb 8, 2025Updated last year
- ☆12Jan 19, 2024Updated 2 years ago
- Controllable Language Model Interactions in TypeScript☆10May 17, 2024Updated last year
- A web-app to explore topics using LLM (less typing and more clicks)☆68Feb 6, 2026Updated 3 weeks ago
- Draft42 - Streamlit chatbot with function calling☆32Jul 6, 2025Updated 7 months ago
- This project is a reverse-engineered version of Figma's tone changer. It uses Groq's Llama-3-8b for high-speed inference and to adjust th…☆90Jul 26, 2024Updated last year
- spotify/annoy bindings for Rust.☆19May 2, 2023Updated 2 years ago
- A simple experiment on letting two local LLM have a conversation about anything!☆112Jul 3, 2024Updated last year
- An AI assistant beyond the chat box.☆329Mar 11, 2024Updated last year
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆615Feb 17, 2025Updated last year
- A pipeline parallel training script for LLMs.☆167Apr 30, 2025Updated 10 months ago
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆913Updated this week
- Dockerfile for johnsmith0031/alpaca_lora_4bit☆12Apr 10, 2023Updated 2 years ago
- Minimal LLM inference in Rust☆1,032Oct 24, 2024Updated last year
- From anywhere you can type, query and stream the output of any script (e.g. an LLM)☆504Apr 12, 2024Updated last year
- Complex RAG backend☆29Mar 28, 2024Updated last year
- Local Ollama with Qdrant RAG: Embed, index, and enhance models for retrieval-augmented generation. Get started with easy setup for powerf…☆25Mar 27, 2024Updated last year
- Identify and automatically fix issues in shell scripts☆15Nov 24, 2023Updated 2 years ago
- Modified Beam Search with periodical restart☆12Sep 12, 2024Updated last year
- Simple Summarizer Tool using Llama 3 8b.☆10May 14, 2024Updated last year
- ☆12Dec 19, 2023Updated 2 years ago
- Experimental sampler to make LLMs more creative☆31Aug 2, 2023Updated 2 years ago
- Simple LLM inference server☆20Jun 13, 2024Updated last year
- LLM-powered lossless compression tool☆305Jan 2, 2026Updated 2 months ago
- A multimodal, function calling powered LLM webui.☆215Sep 23, 2024Updated last year
- AlwaysReddy is a LLM voice assistant that is always just a hotkey away.☆763Mar 4, 2025Updated last year
- Official implementation of the paper "Linear Transformers with Learnable Kernel Functions are Better In-Context Models"☆169Jan 16, 2025Updated last year
- A fast inference library for running LLMs locally on modern consumer-class GPUs☆4,444Dec 9, 2025Updated 2 months ago
- Bamboo-7B Large Language Model☆93Mar 28, 2024Updated last year
- Fast, flexible LLM inference☆6,623Updated this week
- ☆14Jul 1, 2024Updated last year
- Kubernetes Operator for Azure DevOps Agents☆15Updated this week
- WebAISum is a Python script that allows you to summarize web pages using AI models. It supports both local models like Ollama and remote …☆15Apr 28, 2024Updated last year
- A guidance compatibility layer for llama-cpp-python☆36Sep 11, 2023Updated 2 years ago
- Self-contained, minimalistic implementation of a language model that generates coherent and normal sounding names. It uses an input datas…☆52Feb 27, 2024Updated 2 years ago
- Rust macro to make recursive function run on the heap (i.e. no stack overflow).☆24Jun 4, 2025Updated 9 months ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆82Feb 7, 2026Updated 3 weeks ago
- Recipe Ingredient Parser☆12Nov 16, 2022Updated 3 years ago