moritztng / fltrLinks
Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.
☆384Updated last year
Alternatives and similar repositories for fltr
Users that are interested in fltr are comparing it to the libraries listed below
Sorting:
- Stop messing around with finicky sampling parameters and just use DRµGS!☆356Updated last year
- Open-source LLMOps platform for hosting and scaling AI in your own infrastructure 🏓🦙☆1,232Updated last week
- From anywhere you can type, query and stream the output of any script (e.g. an LLM)☆495Updated last year
- Web UI for ExLlamaV2☆510Updated 6 months ago
- An AI assistant beyond the chat box.☆328Updated last year
- Replace OpenAI with Llama.cpp Automagically.☆324Updated last year
- A fast batching API to serve LLM models☆187Updated last year
- Mistral7B playing DOOM☆135Updated last year
- LLM-powered lossless compression tool☆288Updated last year
- All-in-one desktop app for running LLMs locally.☆457Updated 3 weeks ago
- An implementation of bucketMul LLM inference☆223Updated last year
- A multimodal, function calling powered LLM webui.☆216Updated 11 months ago
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆419Updated 7 months ago
- function calling-based LLM agents☆287Updated 11 months ago
- Visualize the intermediate output of Mistral 7B☆368Updated 7 months ago
- Minimal LLM inference in Rust☆1,013Updated 10 months ago
- OpenAI compatible API for serving LLAMA-2 model☆218Updated last year
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆62Updated last year
- Open source alternative to Perplexity AI with ability to run locally☆214Updated 10 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆145Updated 2 months ago
- WebGPU LLM inference tuned by hand☆151Updated 2 years ago
- Finetune llama2-70b and codellama on MacBook Air without quantization☆448Updated last year
- ☆314Updated last month
- Blue-text Bot AI. Uses Ollama + AppleScript☆50Updated last year
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆230Updated 3 weeks ago
- C++ implementation for 💫StarCoder☆456Updated last year
- Rust+OpenCL+AVX2 implementation of LLaMA inference code☆548Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆247Updated last year
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆586Updated 6 months ago
- An Autonomous LLM Agent that runs on Wizcoder-15B☆334Updated 10 months ago