Experimental implementation of DeepSeek v4 flaash in llama.cpp
☆24Apr 30, 2026Updated 6 months ago
Alternatives and similar repositories for llama.cpp-deepseek-v4-flash-cuda
Users that are interested in llama.cpp-deepseek-v4-flash-cuda are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.8-27B in native NVFP4/FP8 on 2x PCIe Tesla V100-32GB (SM70): the PCIe runbook for v100-skinny + 1Cat-vLLM, with the 3 fixes that ma …☆16Sep 13, 2026Updated last month
- LLM inference in C/C++☆15Oct 30, 2026Updated last week
- High-performance single-GPU inference for RTX 5090 Mobile.☆21Oct 4, 2026Updated last month
- ☆16Oct 20, 2026Updated 2 weeks ago
- ☆14Feb 4, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.☆27Sep 1, 2025Updated last year
- DOS\Watcom C\C++ stuff (demos\utils\etc)☆11Jan 25, 2024Updated 2 years ago
- ☆38Oct 30, 2026Updated last week
- 轻量llama.cpp用户界面外壳/Lightweight llama.cpp user interface shell☆24May 12, 2026Updated 5 months ago
- Minimalistic syslog for Docker containers☆10Sep 23, 2020Updated 6 years ago
- Bots running on OGS based on katrain☆12Jul 8, 2025Updated last year
- Modern chat UI for local LLMs with streaming, user management, and web search. Self-hosted.☆13Feb 19, 2026Updated 8 months ago
- FusionQuant Model Merge & GGUF Conversion Pipeline - Your Free Toolkit for Custom LLMs!☆14Jun 24, 2025Updated last year
- Wrapper for "docker run" to handle systemd quirks☆13Oct 9, 2018Updated 8 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A docling plugin to integrate a remote hosted GLM-OCR OCR model into docling☆15Updated this week
- A simple OpenAI TTS compatible voice server based on Pico2Wave☆13Nov 18, 2024Updated last year
- Implementation of BitNet-1.58 instruct tuning☆33Apr 14, 2024Updated 2 years ago
- Open Source Memory Layer for Your AI☆14Oct 18, 2025Updated last year
- The website for Sabaki SGF editor.☆11Dec 25, 2018Updated 7 years ago
- Enables possibility to build Win32-targeted applications with Bazel (`x86_32_windows` cpu)☆10Feb 14, 2019Updated 7 years ago
- ☆16Sep 1, 2024Updated 2 years ago
- Evolution process to find the best quant tensor weights to build the most optimal GGUF options for an AI model.☆49Sep 8, 2026Updated last month
- Easy jupiter notebook to get Automatic1111 working on the paperspace environment☆12May 1, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆10Jul 17, 2022Updated 4 years ago
- LLM inference in C/C++☆34Jan 27, 2026Updated 9 months ago
- An fully autonomous agent that accesses the browser and performs tasks.☆19Aug 17, 2026Updated 2 months ago
- Personal voice assistant, with voice interruption and Twilio support☆18Feb 24, 2025Updated last year
- Bonsai-27B x NInfer local deployment project (RTX 5080, ternary quantization)☆50Oct 6, 2026Updated last month
- ☆16Feb 24, 2025Updated last year
- Modified for AMD MI50 GPUs | A high-throughput and memory-efficient inference and serving engine for LLMs☆15Mar 2, 2026Updated 8 months ago
- vLLM Qwen 3.6-27B (AWQ-INT4) + DFlash speculative decoding on AMD Strix Halo (gfx1151 iGPU, 128 GB UMA, ROCm 7.13). 24.8 t/s single-strea…☆53May 10, 2026Updated 5 months ago
- A powerful and user-friendly tool that generates detailed captions for your images☆21Nov 11, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- final freeware version of video test bench☆20Oct 6, 2026Updated last month
- ☆21Jul 25, 2023Updated 3 years ago
- Form Builder by Formaloo - Drag & Drop Form Builder for WordPress☆14Jun 10, 2023Updated 3 years ago
- A tool for adding function calling to llm api, available as a service by following the link☆22Aug 11, 2025Updated last year
- The hardware & files behind PILOT Drive☆21Jul 12, 2023Updated 3 years ago
- Vagrant based Choria demo environment☆11Jan 30, 2026Updated 9 months ago
- A professional Next.js blogging platform with advanced AI-driven content generation. Auto-Blog leverages RSS feed analysis and Retrieval-…☆22Oct 8, 2025Updated last year