moritztng / fltrLinks
Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
☆386Updated last year
Alternatives and similar repositories for fltr
Users that are interested in fltr are comparing it to the libraries listed below
Sorting:
- From anywhere you can type, query and stream the output of any script (e.g. an LLM)☆503Updated last year
- Mistral7B playing DOOM☆138Updated last year
- Stop messing around with finicky sampling parameters and just use DRµGS!☆359Updated last year
- Replace OpenAI with Llama.cpp Automagically.☆324Updated last year
- Web UI for ExLlamaV2☆514Updated 9 months ago
- An AI assistant beyond the chat box.☆328Updated last year
- Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙☆1,373Updated last week
- Visualize the intermediate output of Mistral 7B☆381Updated 10 months ago
- A multimodal, function calling powered LLM webui.☆217Updated last year
- All-in-one desktop app for running LLMs locally.☆466Updated 2 months ago
- A fast batching API to serve LLM models☆189Updated last year
- An implementation of bucketMul LLM inference☆223Updated last year
- LLM-powered lossless compression tool☆293Updated last year
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆429Updated 10 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆145Updated last month
- ☆329Updated 4 months ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆239Updated 3 months ago
- WebGPU LLM inference tuned by hand☆151Updated 2 years ago
- ☆165Updated last year
- git-like rag pipeline☆249Updated last week
- Minimal LLM inference in Rust☆1,023Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆248Updated last year
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆62Updated 2 years ago
- Run any ML model from any programming language.☆425Updated last year
- The Fast Vector Similarity Library is designed to provide efficient computation of various similarity measures between vectors.☆409Updated 9 months ago
- OpenAI compatible API for serving LLAMA-2 model☆218Updated 2 years ago
- function calling-based LLM agents☆289Updated last year
- Open source alternative to Perplexity AI with ability to run locally☆221Updated last year
- Blue-text Bot AI. Uses Ollama + AppleScript☆50Updated last year
- Finetune llama2-70b and codellama on MacBook Air without quantization☆450Updated last year