Python bindings for ggml
☆152Sep 2, 2026Updated 2 weeks ago
Alternatives and similar repositories for ggml-python
Users that are interested in ggml-python are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Web browser version of StarCoder.cpp☆46Jul 30, 2023Updated 3 years ago
- GGUF parser in Python☆28May 1, 2026Updated 4 months ago
- CLIP inference in plain C/C++ with no extra dependencies☆569Aug 24, 2026Updated 3 weeks ago
- Falcon LLM ggml framework with CPU and GPU support☆250Jul 2, 2026Updated 2 months ago
- Python bindings for the Transformer models implemented in C/C++ using GGML library.☆1,889Jan 28, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Python bindings for llama.cpp☆10,627Updated this week
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆320Apr 11, 2024Updated 2 years ago
- Falcon7B + Falcon40B support - in branch falcon40b. Now all good and working. But main action now in https://github.com/cmp-nct/ggllm.cpp☆10Sep 30, 2023Updated 2 years ago
- Tensor library for machine learning☆15,369Updated this week
- This repo is about implementing pose estimation with HRNet and also, is a sub-task of the smart hospital bed project☆12Jan 21, 2022Updated 4 years ago
- JAX implementation of GPTQ quantization algorithm☆10Jul 19, 2023Updated 3 years ago
- Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)☆572Aug 8, 2023Updated 3 years ago
- TLS & API keys for your LLM APIs☆20Dec 17, 2025Updated 9 months ago
- Suno AI's Bark model in C/C++ for fast text-to-speech generation☆870Nov 16, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Framework for Algorithmic Correctness Testing of Operators☆16Mar 9, 2026Updated 6 months ago
- Fast neural codec compression and generation for audio waveforms☆232Updated this week
- An N-gram punctuator for Chinese and English.☆20Oct 14, 2025Updated 11 months ago
- Demo python script app to interact with llama.cpp server using whisper API, microphone and webcam devices.☆47Nov 6, 2023Updated 2 years ago
- A ggml (C++) re-implementation of tortoise-tts☆192Aug 20, 2024Updated 2 years ago
- zlib with the build system replaced by zig☆15Apr 17, 2024Updated 2 years ago
- A fork of llama3.c used to do some R&D on inferencing☆24Dec 20, 2024Updated last year
- example of using CoreML from c++☆24Jun 14, 2023Updated 3 years ago
- JavaScript bindings for the ggml-js library☆44Nov 10, 2025Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆80Nov 26, 2024Updated last year
- Foundational Models for State-of-the-Art Speech and Text Translation☆32Dec 2, 2023Updated 2 years ago
- ☆31Dec 23, 2024Updated last year
- Work in progress rust bindings to ggml☆11May 1, 2023Updated 3 years ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆659Mar 9, 2026Updated 6 months ago
- Rust crate to fix malformed JSON outputs from LLMs☆19Mar 26, 2026Updated 5 months ago
- ☆1,277Oct 24, 2023Updated 2 years ago
- Simple speculative decoding technique, integrated in vLLM and transformers☆616Aug 23, 2024Updated 2 years ago
- LLM-based code completion engine☆194Jan 23, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆34Jul 23, 2024Updated 2 years ago
- learn mojo☆14Sep 26, 2024Updated last year
- VietTTS: An Open-Source Vietnamese Text to Speech☆86Dec 23, 2025Updated 8 months ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆25Jun 30, 2025Updated last year
- C++ implementation for 💫StarCoder☆459Sep 9, 2023Updated 3 years ago
- WeChat Pay sdk in python☆12Mar 9, 2018Updated 8 years ago
- The backend behind the LLM-Perf Leaderboard☆11May 5, 2024Updated 2 years ago