Thin wrapper around GGML to make life easier
☆44Nov 5, 2025Updated 4 months ago
Alternatives and similar repositories for ggml-easy
Users that are interested in ggml-easy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Find out why your CoreML model isn't running on the Neural Engine!☆30Jun 18, 2024Updated last year
- Metal GPU implementation of the Qwen3 transformer model on macOS with complete Apple Silicon compute shader acceleration.☆43Oct 6, 2025Updated 5 months ago
- FastRTC voice agent☆22Mar 18, 2025Updated last year
- (WIP) A retrain of F5-TTS on permissively-licensed data☆13Apr 6, 2025Updated 11 months ago
- Train Llama Loras Easily☆31Aug 3, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- INTERVAL field for PostgreSQL (and an approximation for other backends)☆21Jul 27, 2023Updated 2 years ago
- Profile your CoreML models directly from Python 🐍☆30Sep 8, 2025Updated 6 months ago
- ☆20Oct 5, 2025Updated 5 months ago
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Mar 12, 2024Updated 2 years ago
- handle gguf files☆13Aug 14, 2025Updated 7 months ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆11Jul 22, 2023Updated 2 years ago
- Talk To AI with FastRTC enables natural, real-time voice conversations with AI using WebRTC, offering customizable voices, interfaces, an…☆45Mar 10, 2025Updated last year
- 面向多平台编译优化的深度学习中间表示☆10Oct 28, 2024Updated last year
- Efficient non-uniform quantization with GPTQ for GGUF☆63Sep 17, 2025Updated 6 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Pragmatic approach to parsing import profiles for CI's☆12Jul 1, 2024Updated last year
- A live multiplayer trivia game where users can bid for the subject of the next question☆29Jan 9, 2026Updated 2 months ago
- Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separat…☆14Dec 12, 2025Updated 3 months ago
- An in-process trace collector using the Rust tracing framework and the Perfetto C++ SDK☆15Mar 2, 2026Updated 3 weeks ago
- A simple POC of FastRTC, a framework to use voice mode in python!☆36Apr 7, 2025Updated 11 months ago
- (elastic) cuckoo hashing☆16Jun 20, 2020Updated 5 years ago
- Fast and memory-efficient exact attention☆21Mar 13, 2026Updated 2 weeks ago
- ☆10Dec 8, 2021Updated 4 years ago
- A Dockerfile and setup to run lollms-webui in a containerized environment☆19Sep 4, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- A bot that provides Youtube vid chapters on Twitter (a.k.a. X )☆12Feb 5, 2025Updated last year
- A lightweight Python library for running TTS models with a unified API.☆21Feb 18, 2025Updated last year
- ☆15Mar 20, 2026Updated last week
- A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.☆52Jul 30, 2024Updated last year
- AI town https://github.com/a16z-infra/ai-town Patches to run on Hugging Face Spaces☆21Jun 6, 2024Updated last year
- A C++ fork/rewrite of the smhasher project to bring Murmurhash v.3 to the Linux shell and to the PHP scripting language.☆21Jul 25, 2011Updated 14 years ago
- ☆40Mar 25, 2023Updated 3 years ago
- This package provides Swift bindings for llama.cpp☆26Apr 4, 2023Updated 2 years ago
- Experiments with BitNet inference on CPU☆55Apr 1, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- A standalone CXL-enabled system simulator.☆20Jan 10, 2026Updated 2 months ago
- In-browser LLM website generator☆51Jan 28, 2025Updated last year
- Boosting GPU utilization for LLM serving via dynamic spatial-temporal prefill & decode orchestration☆39Jan 8, 2026Updated 2 months ago
- Persistent Memory Tool Box☆12Mar 4, 2024Updated 2 years ago
- Repository for the COLM 2025 paper SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths☆17Jul 10, 2025Updated 8 months ago
- This Repositry is an experiment with an agent that searches documents and asks questions repeatedly in response to the main question. It …☆19Jul 17, 2023Updated 2 years ago
- Video+code lecture on building nanoGPT from scratch☆67Jun 14, 2024Updated last year