Python package wrapping llama.cpp for on-device LLM inference
☆106Apr 2, 2026Updated 3 months ago
Alternatives and similar repositories for easy-llama
Users that are interested in easy-llama are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- entropix style sampling + GUI☆27Oct 30, 2024Updated last year
- An extension to Oobabooga to add a simple memory function for chat☆25Jun 5, 2023Updated 3 years ago
- oobabooga extension - Experimental sampler to make LLMs more creative☆23Aug 2, 2023Updated 2 years ago
- An API for VoiceCraft.☆25Jun 27, 2024Updated 2 years ago
- A simple no-install web UI for Ollama and OAI-Compatible APIs!☆31Jan 30, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆99Mar 28, 2026Updated 3 months ago
- ☆83Feb 28, 2025Updated last year
- ☆35May 9, 2024Updated 2 years ago
- ☆180Jun 16, 2026Updated 2 weeks ago
- Modified Beam Search with periodical restart☆12Sep 12, 2024Updated last year
- A bot that checks your grammar and phrasing using LLM of choice☆34Feb 6, 2025Updated last year
- A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.☆52Jul 30, 2024Updated last year
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆46Mar 21, 2024Updated 2 years ago
- Llama.cui is a small llama.cpp-based chat application for Node.js☆20Jul 10, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Web UI for ExLlamaV2☆513Feb 5, 2025Updated last year
- A simple library for working with Hugging Face models.☆14Dec 30, 2024Updated last year
- Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.☆30Jul 18, 2024Updated last year
- Server plugin to extract text from Office documents using the officeparser library.☆12Mar 14, 2026Updated 3 months ago
- A QT GUI for large language models☆40Dec 27, 2023Updated 2 years ago
- A simple character editor for v2 Tavern Character Cards☆61Jan 18, 2025Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆181May 2, 2024Updated 2 years ago
- run ollama & gguf easily with a single command☆52May 15, 2024Updated 2 years ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆647Mar 9, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Terminal Voice Assistant is a powerful and flexible tool designed to help users interact with their terminal using natural language comma…☆18Jun 9, 2024Updated 2 years ago
- Web page with political compass quiz results for open LLMs☆38Jan 31, 2024Updated 2 years ago
- Writing Extension for Text Generation WebUI☆67Aug 7, 2025Updated 10 months ago
- LLM backed Fantasy Tribe Game☆19Nov 21, 2024Updated last year
- A Qt GUI for large language models☆45Nov 17, 2023Updated 2 years ago
- Kosmos-2.5 is a cutting-edge Multimodal-LLM (MLLM) specializing in image OCR. However, its stringent software requirements & Python-scrip…☆67Jul 22, 2024Updated last year
- A library for working with GBNF files☆30May 27, 2026Updated last month
- ☆16Feb 1, 2025Updated last year
- An F/OSS solution combining AI with Wikipedia knowledge via a RAG pipeline☆104Jan 12, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- AI Based "Happiness Optimizer"☆12Oct 20, 2024Updated last year
- DOD or data oriented design development, what is it and how to do it☆36Jun 27, 2026Updated last week
- ☆43Aug 2, 2025Updated 11 months ago
- A simple frontend page to interact with an OpenAI like API☆17Jan 31, 2025Updated last year
- A multimodal inference pipeline that integrates InstructBLIP with textgen-webui for Vicuna and related models.☆33Jul 14, 2023Updated 2 years ago
- Give your local LLM a real memory with a lightweight, fully local memory system. 100% offline and under your control.☆77Sep 16, 2025Updated 9 months ago
- A portable linker for multiple file formats.☆14Aug 28, 2023Updated 2 years ago