moritztng / fltrLinks
Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
β382Updated last year
Alternatives and similar repositories for fltr
Users that are interested in fltr are comparing it to the libraries listed below
Sorting:
- Open-source LLMOps platform for hosting and scaling AI in your own infrastructure ππ¦β882Updated this week
- From anywhere you can type, query and stream the output of an LLM or any other scriptβ496Updated last year
- Stop messing around with finicky sampling parameters and just use DRΒ΅GS!β352Updated last year
- Guaranteed Structured Output from any Language Model via Hierarchical State Machinesβ142Updated 2 months ago
- Mistral7B playing DOOMβ133Updated last year
- An implementation of bucketMul LLM inferenceβ221Updated last year
- Replace OpenAI with Llama.cpp Automagically.β323Updated last year
- An AI assistant beyond the chat box.β328Updated last year
- Blue-text Bot AI. Uses Ollama + AppleScriptβ50Updated last year
- LLM-powered lossless compression toolβ286Updated 11 months ago
- Visualize the intermediate output of Mistral 7Bβ367Updated 6 months ago
- Web UI for ExLlamaV2β506Updated 6 months ago
- All-in-one desktop app for running LLMs locally.β458Updated 2 weeks ago
- git-like rag pipelineβ236Updated last week
- A multimodal, function calling powered LLM webui.β215Updated 10 months ago
- A fast batching API to serve LLM modelsβ185Updated last year
- Minimal LLM inference in Rustβ1,010Updated 9 months ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibesβ222Updated this week
- Live-bending a foundation modelβs output at neural network level.β268Updated 4 months ago
- β312Updated 2 weeks ago
- Kosmos-2.5 is a cutting-edge Multimodal-LLM (MLLM) specializing in image OCR. However, its stringent software requirements & Python-scripβ¦β62Updated last year
- function calling-based LLM agentsβ287Updated 10 months ago
- OpenAI compatible API for serving LLAMA-2 modelβ219Updated last year
- WebGPU LLM inference tuned by handβ151Updated 2 years ago
- Open source alternative to Perplexity AI with ability to run locallyβ214Updated 10 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.β158Updated last year
- β208Updated 3 weeks ago
- Experimental LLM Inference UX to aid in creative writingβ119Updated 7 months ago
- A simple tool to anonymize LLM prompts.β64Updated 6 months ago
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.β415Updated 7 months ago