the-crypt-keeper / ggml-downloaderLinks
Simple, Fast, Parallel Huggingface GGML model downloader written in python
☆24Updated 2 years ago
Alternatives and similar repositories for ggml-downloader
Users that are interested in ggml-downloader are comparing it to the libraries listed below
Sorting:
- Local LLM inference & management server with built-in OpenAI API☆31Updated last year
- GPT-2 small trained on phi-like data☆67Updated last year
- Experimental sampler to make LLMs more creative☆31Updated 2 years ago
- Easily create LLM automation/agent workflows☆59Updated last year
- ☆55Updated 2 years ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆55Updated 8 months ago
- A guidance compatibility layer for llama-cpp-python☆35Updated last year
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆45Updated last year
- Yet Another (LLM) Web UI, made with Gemini☆12Updated 7 months ago
- A Qt GUI for large language models☆43Updated last year
- Gradio based tool to run opensource LLM models directly from Huggingface☆94Updated last year
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆102Updated 9 months ago
- Let's create synthetic textbooks together :)☆75Updated last year
- ☆49Updated last year
- run ollama & gguf easily with a single command☆52Updated last year
- This public GitHub repository contains code for a fully self-hosted, on-premise transcription solution.☆53Updated 7 months ago
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆37Updated 2 years ago
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆75Updated last year
- Generate visual podcasts about novels using open source models☆25Updated 2 years ago
- LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.☆104Updated last week
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆91Updated 2 years ago
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- A Python library to orchestrate LLMs in a neural network-inspired structure☆49Updated 10 months ago
- an auto-sleeping and -waking framework around llama.cpp☆12Updated 5 months ago
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…☆30Updated last year
- ☆115Updated 7 months ago
- ☆16Updated last year
- ☆24Updated 6 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆88Updated 3 months ago
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated last year