Experimental implementation of DeepSeek v4 flaash in llama.cpp
☆24Apr 30, 2026Updated 5 months ago
Alternatives and similar repositories for llama.cpp-deepseek-v4-flash-cuda
Users that are interested in llama.cpp-deepseek-v4-flash-cuda are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Thireus's fork of llama.cpp with Cuda 12.8 and 13.3 release builds and Windows patch for loading more .gguf shards + llama-sweep-bench☆30Oct 10, 2026Updated last week
- Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.☆26Sep 1, 2025Updated last year
- Evolution process to find the best quant tensor weights to build the most optimal GGUF options for an AI model.☆49Sep 8, 2026Updated last month
- ☆17Aug 13, 2026Updated 2 months ago
- ☆17Mar 11, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- An fully autonomous agent that accesses the browser and performs tasks.☆19Aug 17, 2026Updated 2 months ago
- A tool for adding function calling to llm api, available as a service by following the link☆22Aug 11, 2025Updated last year
- Personal voice assistant, with voice interruption and Twilio support☆18Feb 24, 2025Updated last year
- ☆16Feb 24, 2025Updated last year
- vLLM Qwen 3.6-27B (AWQ-INT4) + DFlash speculative decoding on AMD Strix Halo (gfx1151 iGPU, 128 GB UMA, ROCm 7.13). 24.8 t/s single-strea…☆53May 10, 2026Updated 5 months ago
- A powerful and user-friendly tool that generates detailed captions for your images☆21Nov 11, 2024Updated last year
- 🔥 Alternative to Ollama — multi-model serving with sub-ms model switching · CPU-only 20B inference for Edge AI · llama.cpp + stablediffu…☆41Sep 27, 2026Updated 2 weeks ago
- A Demo of Running Sleep-time Compute to Reduce LLM Latency☆16May 17, 2025Updated last year
- Create text chunks which end at natural stopping points without using a tokenizer☆26Nov 26, 2025Updated 10 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Visually select, search, and copy your code into your clipboard for LLM context.☆26Sep 15, 2026Updated last month
- ☆11Jul 30, 2026Updated 2 months ago
- A professional Next.js blogging platform with advanced AI-driven content generation. Auto-Blog leverages RSS feed analysis and Retrieval-…☆22Oct 8, 2025Updated last year
- Local-first A-share research workbench for DeepSeek Harness: market dashboards, watchlists, valuation, four investor agents, versioned re…☆117Oct 1, 2026Updated 2 weeks ago
- Director Agent + vision critic + image, video, music & voice models - all on a single AMD Instinct MI300X.☆50May 22, 2026Updated 4 months ago
- 🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GP…☆62Sep 26, 2026Updated 3 weeks ago
- 根据apnic分析国内IP地址线路（联通、电信、移动等）☆10Aug 16, 2017Updated 9 years ago
- Fast reactive bridge between Java applications and Yandex.ClickHouse database☆10Apr 9, 2018Updated 8 years ago
- Automate your AI music video workflow with Synesthesia Engine. This local Gradio app bridges audio analysis, LLM-driven storytelling, and…☆55Aug 16, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆13Aug 12, 2026Updated 2 months ago
- ☆95Jul 17, 2026Updated 3 months ago
- Low-latency IPC library for building persistent agentic tool servers (LLM inference, TTS, vector search, browser automation) over named p…☆15Sep 15, 2026Updated last month
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆32May 1, 2025Updated last year
- Mapping Corelight or Zeek data to Elastic Common Schema logs☆12Oct 1, 2026Updated 2 weeks ago
- A terminal UI for browsing Hacker News - feeds, threaded comments, bookmarks. Built with Rust and Ratatui.☆41Sep 29, 2026Updated 2 weeks ago
- Nagios ClickHouse check☆10Feb 10, 2021Updated 5 years ago
- An OpenFlow sniffer to help network troubleshooting in production networks.☆15Jul 6, 2026Updated 3 months ago
- A Logstash neo4j output☆12Aug 18, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- An assortment of tooling/libraries to make Logstash core and plugin development and releasing a bit easier.☆17Sep 2, 2026Updated last month
- Fast LLM swapping with sleep/wake support, compatible with vllm, llama.cpp, etc. llama-swap fork.☆57Apr 5, 2026Updated 6 months ago
- LLM inference in C/C++☆246Updated this week
- Fast, lightweight Wayland screenshot tool☆145Updated this week
- A powerful AI-integrated Terminal Shell powered by the Ollama LLM interface.☆15Sep 3, 2026Updated last month
- An automatic approval extension for Pi, inspired by Claude Code auto mode and Codex Auto-review style approval workflows.☆44Sep 20, 2026Updated 3 weeks ago
- Mayonnaise: a macOS like UI library for Linux, alternative to Qt and GTK. Written with pure C++ and OpenGL/Vulkan.☆50Updated this week