moritztng / fltrLinks
Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
☆386Updated last year
Alternatives and similar repositories for fltr
Users that are interested in fltr are comparing it to the libraries listed below
Sorting:
- From anywhere you can type, query and stream the output of any script (e.g. an LLM)☆503Updated last year
- Stop messing around with finicky sampling parameters and just use DRµGS!☆359Updated last year
- Mistral7B playing DOOM☆138Updated last year
- Replace OpenAI with Llama.cpp Automagically.☆326Updated last year
- Web UI for ExLlamaV2☆514Updated 10 months ago
- Visualize the intermediate output of Mistral 7B☆381Updated 10 months ago
- A fast batching API to serve LLM models☆189Updated last year
- An AI assistant beyond the chat box.☆328Updated last year
- Open-source LLM load balancer and serving platform for self-hosting LLMs at scale 🏓🦙☆1,394Updated 2 weeks ago
- A multimodal, function calling powered LLM webui.☆217Updated last year
- LLM-powered lossless compression tool☆293Updated last year
- Minimal LLM inference in Rust☆1,025Updated last year
- function calling-based LLM agents☆289Updated last year
- An implementation of bucketMul LLM inference☆222Updated last year
- Run any ML model from any programming language.☆425Updated last year
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆64Updated 2 years ago
- Blue-text Bot AI. Uses Ollama + AppleScript☆50Updated last year
- All-in-one desktop app for running LLMs locally.☆464Updated 3 months ago
- ☆165Updated last year
- ☆135Updated last year
- OpenAI compatible API for serving LLAMA-2 model☆218Updated 2 years ago
- Kosmos-2.5 is a cutting-edge Multimodal-LLM (MLLM) specializing in image OCR. However, its stringent software requirements & Python-scrip…☆67Updated last year
- A web-app to explore topics using LLM (less typing and more clicks)☆67Updated last year
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆240Updated 4 months ago
- Experimental LLM Inference UX to aid in creative writing☆127Updated last year
- ☆334Updated 4 months ago
- WebGPU LLM inference tuned by hand☆151Updated 2 years ago
- Rust+OpenCL+AVX2 implementation of LLaMA inference code☆551Updated last year
- (Cross-Platform) An open source approach to locally record and enable searching everything you view on any computer.☆280Updated last year
- The Fast Vector Similarity Library is designed to provide efficient computation of various similarity measures between vectors.☆413Updated 9 months ago