Python bindings for ggml
☆152Sep 2, 2026Updated 2 months ago
Alternatives and similar repositories for ggml-python
Users that are interested in ggml-python are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Falcon LLM ggml framework with CPU and GPU support☆251Jul 2, 2026Updated 4 months ago
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆323Apr 11, 2024Updated 2 years ago
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,888Jan 28, 2024Updated 2 years ago
- GGUF parser in Python☆28May 1, 2026Updated 6 months ago
- Web browser version of StarCoder.cpp☆46Jul 30, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- CLIP inference in plain C/C++ with no extra dependencies☆573Aug 24, 2026Updated 2 months ago
- Tensor library for machine learning☆16,110Updated this week
- Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)☆572Aug 8, 2023Updated 3 years ago
- Falcon7B + Falcon40B support - in branch falcon40b. Now all good and working. But main action now in https://github.com/cmp-nct/ggllm.cpp☆10Sep 30, 2023Updated 3 years ago
- ☆30Oct 26, 2024Updated 2 years ago
- ☆79Nov 26, 2024Updated last year
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 3 years ago
- Fast, multithreaded, AVX/FMA matrix multiplication kernel in C++ 17☆18Nov 28, 2018Updated 7 years ago
- Inference TinyLlama models on ncnn☆24Aug 15, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Fast neural codec compression and generation for audio waveforms☆233Sep 16, 2026Updated 2 months ago
- Suno AI's Bark model in C/C++ for fast text-to-speech generation☆869Nov 16, 2024Updated 2 years ago
- Decoders from Kaldi using OpenFst☆36Nov 10, 2026Updated last week
- A ggml (C++) re-implementation of tortoise-tts☆191Aug 20, 2024Updated 2 years ago
- A super simple web interface to perform blind tests on LLM outputs.☆30Mar 9, 2024Updated 2 years ago
- Demo python script app to interact with llama.cpp server using whisper API, microphone and webcam devices.☆47Nov 6, 2023Updated 3 years ago
- ggml implementation of BERT☆508Feb 23, 2024Updated 2 years ago
- An N-gram punctuator for Chinese and English.☆20Oct 14, 2025Updated last year
- LLM-based code completion engine☆193Jan 23, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆1,277Oct 24, 2023Updated 3 years ago
- A simple single page user interface for OpenAI compatible web servers.☆13Apr 5, 2026Updated 7 months ago
- WebGPU LLM inference tuned by hand☆153Jun 24, 2023Updated 3 years ago
- build glog for android with ndk☆21Sep 18, 2018Updated 8 years ago
- ☆31Dec 23, 2024Updated last year
- example of using CoreML from c++☆24Jun 14, 2023Updated 3 years ago
- A fork of llama3.c used to do some R&D on inferencing☆24Dec 20, 2024Updated last year
- Transmit ggwave encoded messages with an SDR☆32Jun 11, 2021Updated 5 years ago
- Python client for txtai☆16Oct 6, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- MCP + A2A + OWL Ontology: Reference implementation for coordinating enterprise AI agents through shared semantics☆14Mar 14, 2026Updated 8 months ago
- A small logging proxy server for intercepting and logging code completion requests from copilot.☆12May 5, 2023Updated 3 years ago
- 小程序版的汉兜☆13Jan 29, 2024Updated 2 years ago
- The backend behind the LLM-Perf Leaderboard☆11May 5, 2024Updated 2 years ago
- Rust crate to fix malformed JSON outputs from LLMs☆21Mar 26, 2026Updated 7 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆665Mar 9, 2026Updated 8 months ago
- Sidecar container to deploy IPSec in Kubernetes☆10May 1, 2022Updated 4 years ago
Are these results useful?