robbiemu / llama-gguf-optimize
Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.
☆11Updated this week
Alternatives and similar repositories for llama-gguf-optimize:
Users that are interested in llama-gguf-optimize are comparing it to the libraries listed below
- A QT GUI for large language models☆26Updated last year
- Local LLM inference & management server with built-in OpenAI API☆31Updated 8 months ago
- Build HTML artefacts with Ollama☆11Updated 3 weeks ago
- ☆15Updated 3 weeks ago
- Branch Out Your Conversations☆25Updated last week
- AirLLM 70B inference with single 4GB GPU☆12Updated 5 months ago
- ☆25Updated 4 months ago
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆17Updated 2 weeks ago
- Yet Another (LLM) Web UI, made with Gemini☆11Updated 2 weeks ago
- Large-Language-Model to Machine Interface project.☆17Updated last year
- multi agent team with coding and data analysis capability to structure real estate investment plans and help with decision making.☆9Updated 6 months ago
- Create text chunks which end at natural stopping points without using a tokenizer☆27Updated 3 weeks ago
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆28Updated this week
- ☆21Updated 4 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆40Updated last month
- Prompt Development Environment for GPT☆13Updated last year
- ☆16Updated 11 months ago
- ☆15Updated 10 months ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆13Updated last week
- V.I.S.O.R., my in-development AI-powered voice assistant with integrated memory!☆30Updated 3 weeks ago
- Modified Beam Search with periodical restart☆12Updated 3 months ago
- Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Re…☆16Updated 3 months ago
- Text generation in Python, as easy as possible☆46Updated this week
- Web Interface for Vision Language Models Including InternVLM2☆16Updated 5 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆35Updated 7 months ago
- ☆21Updated 5 months ago
- A Python library to orchestrate LLMs in a neural network-inspired structure☆46Updated 3 months ago
- Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io☆31Updated 3 weeks ago