A llama.cpp fork with TurboQuant/TCQ KV cache, fused Qwen MTP speculative decoding, and multi-GPU long-context serving fixes.
☆24Aug 19, 2026Updated 2 months ago
Alternatives and similar repositories for llama.cpp_3090x2_qwen3.8_q8_opt
Users that are interested in llama.cpp_3090x2_qwen3.8_q8_opt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Local LLM speed measurements from a 4x RTX 3090 rig, with exact launch commands and per-run provenance.☆18Aug 15, 2026Updated 2 months ago
- use claude code's agent teams with any agentic coder that speaks MCP☆12Apr 24, 2026Updated 6 months ago
- Google Lens Result Scraper + AI Image Analysis Pipeline + FastAPI end-to-end service☆12May 21, 2025Updated last year
- LLM inference in C/C++☆36Updated this week
- Configure pi so that there are custom thinking levels for llama.cpp + Qwen 3.8 27B☆23Aug 17, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A Model Context Protocol (MCP) server providing powerful academic paper search and analysis functionality through the AMiner API.☆13Sep 19, 2025Updated last year
- ☆33Jul 25, 2026Updated 3 months ago
- Model-neutral remote coding runtime with a Cloudflare MCP control plane and outbound local runners☆17Updated this week
- A Model loader for minecraft☆14Feb 9, 2020Updated 6 years ago
- IEEE ISBI 2022 paper: CEUSegNet: A Cross-Modality Lesion Segmentation Network for Contrast-Enhanced Ultrasound.☆11Mar 2, 2023Updated 3 years ago
- Deep learning techniques for atherosclerotic plaque detection in the carotid artery☆16Jun 16, 2022Updated 4 years ago
- kivy+pyinstaller打包生成exe☆14Apr 13, 2017Updated 9 years ago
- NInfer SM80 port for NVIDIA CMP 170HX☆28Aug 22, 2026Updated 2 months ago
- ☆14Jan 17, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Build a digital portrait of yourself through deep AI conversations☆11Apr 8, 2026Updated 6 months ago
- Utilities for the Analysis of Ethereum Smart Contracts☆14Jul 29, 2026Updated 2 months ago
- Rust crate to operate Windows Packet Filter driver☆16May 31, 2023Updated 3 years ago
- Packed User Exhibition Resources☆11Sep 25, 2026Updated 3 weeks ago
- play video in minecraft☆11Oct 7, 2021Updated 5 years ago
- Linux内核驱动demo仓（lkm、ldd）☆13Apr 24, 2025Updated last year
- 简谱与五线谱的编辑、识谱与排版：图片 / PDF 本地离线识别（OMR）· 谱面可视化编辑 · 试听 · 读写 123 / JP-Word .jpwabc / 文本谱 / ABC / Muse .jcx / MusicXML · 导出 PDF/PNG/MIDI/PPTX ·…☆65Updated this week
- Arterial wall segmentation on ultrasound image sequences using deep learning.☆14Jul 18, 2022Updated 4 years ago
- Code With Antonio: Ultimate Next 15 Course: Build a YouTube Clone (2025)☆13Dec 15, 2025Updated 10 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆17Sep 17, 2026Updated last month
- DeepSeek CLI☆65Updated this week
- 408 考研四科可视化平台 - 数据结构/组成原理/操作系统/计算机网络的算法动画演示☆21Oct 2, 2026Updated 3 weeks ago
- Bedrock Models and Animations, On-Fly Resource generator, Simplified Registers and more!☆12Aug 29, 2026Updated last month
- 电影后台管理系统 ，Spring+SpringMVC+MyBatis（SSM）☆11May 31, 2021Updated 5 years ago
- ☆20Feb 20, 2026Updated 8 months ago
- Basic Boot Image Patcher for Samsung Devices.☆10Feb 13, 2024Updated 2 years ago
- 燕山大学课程三级项目☆12Jul 22, 2026Updated 3 months ago
- Xray panel supporting multi-protocol multi-user expire day & traffic & IP limit (Vmess, Vless, Trojan, ShadowSocks, Wireguard, Hysteria, …☆56Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Crazy Fast Qwen3.8–27b With a 420k Context on an RTX 5090☆40Sep 29, 2026Updated 3 weeks ago
- A minimal handwritten runtime following DSH concepts☆41Aug 27, 2026Updated last month
- Allows you to send class Runnable, Consumer, Function files via the socket, load them into the CloassLoader and have it executed on the s…☆17Dec 30, 2025Updated 9 months ago
- MC集群代理压测+Forge注册☆12Jul 14, 2019Updated 7 years ago
- ☆12Feb 6, 2023Updated 3 years ago
- SqlPulse Pro is an SSMS (SQL Server Management Studio) extension for SQL Server developers and DBAs.☆26Aug 22, 2026Updated 2 months ago
- This repository contains Forge mixin to handle Bukkit call In forge Mods☆11Aug 6, 2020Updated 6 years ago