moritztng / fltrLinks
Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
☆385Updated last year
Alternatives and similar repositories for fltr
Users that are interested in fltr are comparing it to the libraries listed below
Sorting:
- Stop messing around with finicky sampling parameters and just use DRµGS!☆357Updated last year
- LLM-powered lossless compression tool☆288Updated last year
- From anywhere you can type, query and stream the output of any script (e.g. an LLM)☆500Updated last year
- Mistral7B playing DOOM☆137Updated last year
- Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙☆1,323Updated this week
- Replace OpenAI with Llama.cpp Automagically.☆324Updated last year
- Web UI for ExLlamaV2☆510Updated 8 months ago
- Visualize the intermediate output of Mistral 7B☆372Updated 8 months ago
- A multimodal, function calling powered LLM webui.☆215Updated last year
- An implementation of bucketMul LLM inference☆223Updated last year
- Blue-text Bot AI. Uses Ollama + AppleScript☆50Updated last year
- An AI assistant beyond the chat box.☆327Updated last year
- All-in-one desktop app for running LLMs locally.☆458Updated last month
- Live-bending a foundation model’s output at neural network level.☆265Updated 6 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆145Updated this week
- function calling-based LLM agents☆288Updated last year
- A fast batching API to serve LLM models☆187Updated last year
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆238Updated 2 months ago
- ☆163Updated last year
- ☆315Updated 2 months ago
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆424Updated 9 months ago
- Open source alternative to Perplexity AI with ability to run locally☆218Updated last year
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆62Updated 2 years ago
- OpenAI compatible API for serving LLAMA-2 model☆218Updated last year
- WebGPU LLM inference tuned by hand☆150Updated 2 years ago
- A multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private co…☆290Updated last month
- Minimal LLM inference in Rust☆1,013Updated 11 months ago
- Finetune llama2-70b and codellama on MacBook Air without quantization☆449Updated last year
- Run any ML model from any programming language.☆424Updated last year
- Experimental LLM Inference UX to aid in creative writing☆122Updated 9 months ago