the-crypt-keeper / ggml-downloader
Simple, Fast, Parallel Huggingface GGML model downloader written in python
☆24Updated last year
Related projects ⓘ
Alternatives and complementary repositories for ggml-downloader
- A QT GUI for large language models☆24Updated 10 months ago
- Experimental sampler to make LLMs more creative☆30Updated last year
- GPT-2 small trained on phi-like data☆65Updated 9 months ago
- A guidance compatibility layer for llama-cpp-python☆34Updated last year
- ☆15Updated 8 months ago
- Local LLM inference & management server with built-in OpenAI API☆31Updated 7 months ago
- ☆31Updated 10 months ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆30Updated 5 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆34Updated last month
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆62Updated 3 weeks ago
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆12Updated 2 months ago
- ☆48Updated 5 months ago
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆22Updated 9 months ago
- run ollama & gguf easily with a single command☆48Updated 6 months ago
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…☆29Updated 6 months ago
- One Line To Build Zero-Data Classifiers in Minutes☆33Updated last month
- A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.☆22Updated last year
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆42Updated 8 months ago
- entropix style sampling + GUI☆25Updated 3 weeks ago
- ☆21Updated 5 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆32Updated 6 months ago
- A repository to store helpful information and emerging insights in regard to LLMs☆20Updated last year
- Simple examples using Argilla tools to build AI☆42Updated this week
- LLM finetuning☆42Updated last year
- A clone of OpenAI's Tokenizer page for HuggingFace Models☆44Updated last year
- 5X faster 60% less memory QLoRA finetuning☆21Updated 5 months ago
- AirLLM 70B inference with single 4GB GPU☆12Updated 3 months ago
- ☆72Updated last year