After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around the ggml library, especially llama.cpp – and primarily its server. The best fruits will hopefully be merged upstream – as long as they are consistent with the philosophy of llama.cpp
☆53Aug 18, 2024Updated last year
Alternatives and similar repositories for plusplus-camall
Users that are interested in plusplus-camall are comparing it to the libraries listed below
Sorting:
- an auto-sleeping and -waking framework around llama.cpp☆12Feb 8, 2025Updated last year
- Experimental LLM Inference UX to aid in creative writing☆128Dec 14, 2024Updated last year
- ☆17Feb 1, 2024Updated 2 years ago
- Reddit media scraper for saved posts and subreddits, with customisable subreddit filters☆11Dec 8, 2022Updated 3 years ago
- An powered LLM Slack bot that uses an OpenAI API backend (LlamaCPP, Ollama, etc)☆12Feb 21, 2026Updated last week
- Draft42 - Streamlit chatbot with function calling☆32Jul 6, 2025Updated 7 months ago
- GPU Power and Performance Manager☆69Oct 13, 2024Updated last year
- A complete package that provides you with all the components needed to get started of dive deeper into Machine Learning Workloads on Cons…☆50Updated this week
- Bookmarklet to pull and run hugging face GGUF models in Ollama☆17Oct 17, 2024Updated last year
- Extract a single expert from a Mixture Of Experts model using slerp interpolation.☆19May 26, 2024Updated last year
- CUDA-enabled ollama nix flake☆14Mar 11, 2024Updated last year
- Friendly Terminal Assistant for Developers☆17Mar 23, 2024Updated last year
- This is an LLM interface that you can use to analyze and get insight into diary entries or other documents completely offline.☆16Dec 31, 2023Updated 2 years ago
- Shell scripts for automated transcription on macOS: Integrates whisper.cpp with QuickTime Player and BlackHole-2ch for streamlined audio …☆23Feb 12, 2025Updated last year
- MLX Transformers is a library that provides model implementation in MLX. It uses a similar model interface as HuggingFace Transformers an…☆74Nov 19, 2024Updated last year
- Fast screen refresh controller for the Nook Simple Touch☆40Jul 27, 2012Updated 13 years ago
- Information on optimizing python libraries specifically for oobabooga to take advantage of Apple Silicon and Accelerate Framework.☆77Feb 12, 2025Updated last year
- Everything you need to setup on your AMD system for Machine Learning Stuff☆19Jul 31, 2025Updated 7 months ago
- Creates an index of images, queries a local LLM and adds tags to the image metadata☆337Feb 5, 2026Updated 3 weeks ago
- Image Generation API Server - Similar to https://text-generator.io but for images☆51Aug 30, 2025Updated 6 months ago
- LLM Fine Tuning Toolbox images for Ryzen AI 395+ Strix Halo☆49Sep 12, 2025Updated 5 months ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆48Sep 26, 2024Updated last year
- LlamaTor: Decentralized AI model sharing via BitTorrent for efficient, user-friendly distribution and collaboration.☆58Jan 5, 2025Updated last year
- ONNX-compatible LightGlue: Local Feature Matching at Light Speed☆28Jul 5, 2023Updated 2 years ago
- A simple Web / UI / App / Frontend to Ollama.☆84Apr 10, 2025Updated 10 months ago
- 5X faster 60% less memory QLoRA finetuning☆21May 28, 2024Updated last year
- Publish local LLMs and LLM apps on the internet.☆27Aug 17, 2025Updated 6 months ago
- A simple RAG chatbot that can retrieve from a mediawiki data dump☆22Dec 9, 2024Updated last year
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …☆103Aug 26, 2025Updated 6 months ago
- run ollama & gguf easily with a single command☆52May 15, 2024Updated last year
- Repository where I will hold the code for my AI tool holding the access to my LLM powered resume.☆24Jul 21, 2025Updated 7 months ago
- llama.cpp with BakLLaVA model describes what does it see☆379Nov 8, 2023Updated 2 years ago
- Train LLMs by just modifying config files!☆24Nov 23, 2023Updated 2 years ago
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆102Sep 30, 2024Updated last year
- A thumbnail gallery / set management tool for Automatic1111 Webui☆25Jul 31, 2024Updated last year
- AlwaysReddy is a LLM voice assistant that is always just a hotkey away.☆763Mar 4, 2025Updated last year
- A simple experiment on letting two local LLM have a conversation about anything!☆112Jul 3, 2024Updated last year
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆439Jan 11, 2025Updated last year
- Code Indexer Loop is a Python library for indexing and retrieving source code files through an integrated vector database that's continuo…☆176Apr 9, 2024Updated last year