elgatopanzon / gatogpt
Local LLM inference & management server with built-in OpenAI API
☆31Updated 8 months ago
Alternatives and similar repositories for gatogpt:
Users that are interested in gatogpt are comparing it to the libraries listed below
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆42Updated last month
- run ollama & gguf easily with a single command☆49Updated 8 months ago
- Text generation in Python, as easy as possible☆47Updated this week
- ☆30Updated 8 months ago
- A QT GUI for large language models☆26Updated last year
- V.I.S.O.R., my in-development AI-powered voice assistant with integrated memory!☆30Updated last month
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆12Updated 4 months ago
- ☆18Updated 3 weeks ago
- Easily create LLM automation/agent workflows☆58Updated 11 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆68Updated 4 months ago
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆43Updated 11 months ago
- ☆26Updated 3 months ago
- A bot that checks your grammar and phrasing using LLM of choice☆29Updated 7 months ago
- ☆39Updated 11 months ago
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆56Updated 5 months ago
- Large-Language-Model to Machine Interface project.☆17Updated last year
- A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…☆12Updated last year
- This repo provides a simple Gradio UI to run Qwen2 VL 72B AWQ in venv and have both image and video inferencing work.☆26Updated 3 months ago
- Complex RAG backend☆28Updated 9 months ago
- One Line To Build Zero-Data Classifiers in Minutes☆33Updated 3 months ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆37Updated 11 months ago
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated 10 months ago
- Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools.☆14Updated 2 months ago
- Create text chunks which end at natural stopping points without using a tokenizer☆26Updated last month
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆37Updated 7 months ago
- Terminal Voice Assistant is a powerful and flexible tool designed to help users interact with their terminal using natural language comma…☆17Updated 7 months ago
- entropix style sampling + GUI☆25Updated 2 months ago
- Experimental sampler to make LLMs more creative☆30Updated last year