Experimental LLM Inference UX to aid in creative writing
☆128Dec 14, 2024Updated last year
Alternatives and similar repositories for LLooM
Users that are interested in LLooM are comparing it to the libraries listed below
Sorting:
- A frontend for creative writing with LLMs☆151Jul 15, 2024Updated last year
- Small tools to enhance your AI app with little effort.☆12Jan 9, 2024Updated 2 years ago
- Experimental sampler to make LLMs more creative☆31Aug 2, 2023Updated 2 years ago
- AI management tool☆121Nov 9, 2024Updated last year
- Modified Beam Search with periodical restart☆12Sep 12, 2024Updated last year
- Simple LLM inference server☆20Jun 13, 2024Updated last year
- Attend - to what matters.☆17Feb 22, 2025Updated last year
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆53Aug 18, 2024Updated last year
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆439Jan 11, 2025Updated last year
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆86Sep 22, 2024Updated last year
- A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM☆12May 30, 2025Updated 9 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆150Jan 7, 2026Updated last month
- A python package for developing AI applications with local LLMs.☆150Jan 4, 2025Updated last year
- ☆24Apr 9, 2024Updated last year
- Thematic Generalization Benchmark: measures how effectively various LLMs can infer a narrow or specific "theme" (category/rule) from a sm…☆63Sep 22, 2025Updated 5 months ago
- ☆35May 9, 2024Updated last year
- ☆21Oct 1, 2024Updated last year
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆167May 16, 2024Updated last year
- ☆210Jan 5, 2026Updated last month
- AlwaysReddy is a LLM voice assistant that is always just a hotkey away.☆764Mar 4, 2025Updated 11 months ago
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 2 years ago
- Client-side toolkit for using large language models, including where self-hosted☆115Feb 2, 2026Updated last month
- JacQues is a Dash-based interactive web application that facilitates real-time chat and document management.☆22Jan 5, 2026Updated last month
- AutoNL - Natural Language Automation tool☆86Mar 6, 2024Updated last year
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆59Dec 1, 2024Updated last year
- A very simple interactive demo to understand the common LLM samplers.☆41Jul 9, 2024Updated last year
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …☆51Feb 10, 2026Updated 3 weeks ago
- Run Orpheus 3B Locally with Gradio UI, Standalone App☆23Apr 1, 2025Updated 11 months ago
- CHAracter State Management - a generative text adventure (engine)☆70Oct 18, 2024Updated last year
- llama.cpp with BakLLaVA model describes what does it see☆380Nov 8, 2023Updated 2 years ago
- Chat with your current directory's files using a local or API LLM.☆427Oct 2, 2025Updated 5 months ago
- Locally hosted AI Agent Python Tool To Generate Novel Research Hypothesis + Titles + Abstracts☆30Apr 30, 2025Updated 10 months ago
- Too Long, Didn't Watch: End-to-End Rolling Summarizer of Long Videos☆364Sep 5, 2025Updated 5 months ago
- Giving the power of LLM's to a MUD lib.☆184Nov 29, 2025Updated 3 months ago
- ☆16Mar 14, 2025Updated 11 months ago
- Triton ‑style kernel toolkit for MLX plus a small upstream incubator: prototype, benchmark, and upstream fusions for Apple Silicon☆36Updated this week
- Prompt templates for language models☆10Feb 22, 2026Updated last week
- Quick access to any large language model from your browser.☆10Feb 16, 2026Updated 2 weeks ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆11Jul 22, 2023Updated 2 years ago