moritztng / fltr
Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
☆380Updated last year
Alternatives and similar repositories for fltr:
Users that are interested in fltr are comparing it to the libraries listed below
- From anywhere you can type, query and stream the output of an LLM or any other script☆490Updated 11 months ago
- Stop messing around with finicky sampling parameters and just use DRµGS!☆347Updated 9 months ago
- Dynamically structure language models to produce outputs that adhere to specific requirements without sacrificing their creative capabili…☆119Updated this week
- Stateful load balancer custom-tailored for llama.cpp 🏓🦙☆728Updated this week
- Mistral7B playing DOOM☆130Updated 8 months ago
- Finetune llama2-70b and codellama on MacBook Air without quantization☆448Updated 11 months ago
- Minimal LLM inference in Rust☆980Updated 5 months ago
- A fast batching API to serve LLM models☆182Updated 10 months ago
- Run any ML model from any programming language.☆422Updated last year
- An implementation of bucketMul LLM inference☆215Updated 8 months ago
- A multimodal, function calling powered LLM webui.☆215Updated 6 months ago
- Visualize the intermediate output of Mistral 7B☆344Updated 2 months ago
- Replace OpenAI with Llama.cpp Automagically.☆311Updated 9 months ago
- ☆273Updated last month
- LLM-powered lossless compression tool☆274Updated 7 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆547Updated last month
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆187Updated last month
- The Fast Vector Similarity Library is designed to provide efficient computation of various similarity measures between vectors.☆384Updated 3 weeks ago
- ☆163Updated 10 months ago
- Grep source code and see useful code context about matching lines☆194Updated last week
- function calling-based LLM agents☆284Updated 6 months ago
- Open source alternative to Perplexity AI with ability to run locally☆194Updated 5 months ago
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆396Updated 2 months ago
- A cross-platform browser ML framework.☆669Updated 4 months ago
- git-like rag pipeline☆197Updated last week
- An Autonomous LLM Agent that runs on Wizcoder-15B☆336Updated 5 months ago
- Web UI for ExLlamaV2☆487Updated last month
- All-in-one desktop app for running LLMs locally.☆443Updated last week
- Start a server from the MLX library.☆182Updated 7 months ago
- An AI assistant beyond the chat box.☆322Updated last year