llama.cpp tuned for 2x Tesla P100 (sm_60). Decode 1.86x, 3-4x with MTP (up to ~70 t/s on code). Prefill 2x, full 262k context with vision. More numerically accurate than upstream.
☆29Nov 1, 2026Updated this week
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; bench…☆108Updated this week
- One RL training loop that runs CartPole on a laptop and disaggregated async RLVR on a GPU cluster. About 1,800 lines across 7 files. No R…☆13Oct 8, 2026Updated 3 weeks ago
- Superseded by github.com/poisonxa16/pxa — PXA, the set-and-forget engine for Pascal and Volta☆24Sep 8, 2026Updated last month
- A CLI tool that can convert LiDAR LAS files to STL files for 3D printing or rendering as terrain☆11Jun 24, 2026Updated 4 months ago
- Is your battery going flat in your battery-powered Arduino ATMega328P project?☆10Aug 31, 2019Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- V0.2-Umbilical-ADXL is a hub board designed for Voron 0.2 with built-in ADXL345 accelerometer. / V0.2-Umbilical-ADXL 是一个为Voron 0.2设计的集线板，…☆13Mar 17, 2024Updated 2 years ago
- A collection of utility scripts for managing Ollama models on Linux systems. These tools help simplify common administration tasks for yo…☆13Aug 27, 2026Updated 2 months ago
- The visual feedback tool for agents.☆15Feb 27, 2026Updated 8 months ago
- ☆15Jun 24, 2023Updated 3 years ago
- ☆18Updated this week
- ☆12Mar 5, 2025Updated last year
- vLLM fork for pascal gpu☆18Mar 13, 2026Updated 7 months ago
- ☆21Updated this week
- LocusTether is a self-hosted replacement for the Omi wearable's normal cloud pipeline. Omi's official app streams your audio to Omi's ser…☆17Sep 1, 2026Updated 2 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Wyoming protocol server for faster whisper speech to text system☆14Jun 12, 2026Updated 4 months ago
- Home Assistant custom integration for local control of Midea (and related brands) air conditioners. Fork with additional sensors, only te…☆14Jul 24, 2026Updated 3 months ago
- Agentic skill to create a hill to climb for every problem☆25Sep 30, 2026Updated last month
- A browser-extension template powered by Svelte☆11Sep 8, 2021Updated 5 years ago
- Group-aware Lovelace light card with mindmap-path topology, in-place mode picker (brightness / temp / color wheel / saved colors), runtim…☆15May 23, 2026Updated 5 months ago
- A lightweight and unbloated Steam headless Docker image☆19Jul 12, 2025Updated last year
- ☆11Jan 16, 2025Updated last year
- OdroidGo Web FileBrowser☆12Jul 31, 2019Updated 7 years ago
- M5STACK Arduino WiFi Photo Backup device☆15Feb 25, 2018Updated 8 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An open source multi-function instrument for everyone☆17Oct 16, 2026Updated 2 weeks ago
- A cheap multipurpose mobile robotic platform for research, development, education and fun. All the code, data, instructions and files yo…☆16Jul 1, 2026Updated 4 months ago
- 🃏 Transform images to SVG using primitive shapes.☆21Jan 25, 2025Updated last year
- chat with a live2d model Immersive☆11Sep 25, 2026Updated last month
- Skill to bring your own OpenAI, Gemini, or local AI models to the Rabbit R1 via LiveKit☆21Mar 11, 2026Updated 7 months ago
- AMD Generic Encapsulated Software Architecture Platform Security Processor Configuration Block manipulation library☆20Dec 18, 2025Updated 10 months ago
- ☆11May 27, 2024Updated 2 years ago
- Experimental Linux DRM/KMS driver for the SM750G10 SE-DP750A-HDMI, with HDMI, custom RGB565 dithering, DMA and software-scaled ultrawide …☆31Updated this week
- Utilities aimed at producing homogeneous color themes☆11Sep 11, 2014Updated 12 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Haskell-flavoured LISPish language thingy☆11May 28, 2015Updated 11 years ago
- Plug-and-play llama.cpp runtime for Intel Arc GPUs. Auto-detects your card, picks safe SYCL defaults, and exposes an OpenAI-compatible AP…☆18Updated this week
- Autonomous agent loops for Hermes Agent: the autoresearch harness and the health/improvement maintenance loops.☆32Oct 26, 2026Updated last week
- A free alternative to the Omi app!☆33Feb 17, 2026Updated 8 months ago
- Client-side portion of the webmap, rewritten with Leaflet and Vue☆13May 9, 2026Updated 5 months ago
- Cleanup and settings for any windows☆11Oct 27, 2026Updated last week
- correlate an SPI capture of an AMD boot procedure to the PSP firmware components☆17Jan 13, 2026Updated 9 months ago