Experimental implementation of DeepSeek v4 flaash in llama.cpp
☆327Apr 27, 2026Updated 2 months ago
Alternatives and similar repositories for llama.cpp-deepseek-v4-flash
Users that are interested in llama.cpp-deepseek-v4-flash are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆18,904Updated this week
- ♡☆22Jun 25, 2026Updated 3 weeks ago
- Pure PyTorch implementation of HISA (Hierarchical Indexed Sparse Attention) as a drop-in plugin for HuggingFace models☆16Apr 7, 2026Updated 3 months ago
- C inference for Qwen3-ASR 0.6b and 1.7b transcriptions models☆582Feb 17, 2026Updated 5 months ago
- LLM training & inference in python/C++ with web UI☆37Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Pure C inference for the GTE Small embedding model☆115Jan 21, 2026Updated 6 months ago
- FLA but cuTile☆27Apr 17, 2026Updated 3 months ago
- ☆37Aug 7, 2025Updated 11 months ago
- Decentralizing distribution of open-source AI models.☆15Updated this week
- Project code for training LLMs to write better unit tests + code☆22May 19, 2025Updated last year
- Local benchmarking UI for LLMs and AI agents☆19Apr 13, 2026Updated 3 months ago
- Flux 2 image generation model pure C inference☆1,967Feb 13, 2026Updated 5 months ago
- Github repo for ICLR-2025 paper, Fine-tuning Large Language Models with Sparse Matrices☆26Feb 2, 2026Updated 5 months ago
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆30Jan 22, 2026Updated 5 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- LLM inference in C/C++☆56Updated this week
- Qwen3-TTS is an open-source series of TTS models developed by the Qwen team at Alibaba Cloud, supporting stable, expressive, and streamin…☆20Feb 18, 2026Updated 5 months ago
- Train LLMs using a delightful web interface powered by magic ✨☆32Jul 12, 2026Updated last week
- Automated CUDA kernel performance diagnostics from NVIDIA Nsight Compute (NCU) CSV exports.☆34Mar 18, 2026Updated 4 months ago
- Fast LLM speculative inference server for consumer hardware.☆2,668Updated this week
- A Tauri-based cross-platform launcher / updater / model manager for llama.cpp☆92Jul 9, 2026Updated last week
- Local LLM Server Manager + LlaMA.cpp + Chat☆17Updated this week
- FlashMemory DS-V4 Retriever: a lightweight retriever that sparsifies DeepSeek-V4 CSA KV-cache. Weights available on Hugging Face.☆90Updated this week
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Low overhead tracing library and trace visualizer for pipelined CUDA kernels☆137Updated this week
- Home-enthusiast's guide to fine-tuning 27B+ LLMs on AMD Strix Halo (gfx1151, Ryzen AI MAX+ 395) — the patches and tuning to make Linux ma…☆26Jun 9, 2026Updated last month
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆127Updated this week
- Some funny cute/cuteDSL code snippets☆33Mar 2, 2026Updated 4 months ago
- 🐼 Born of panda. Awakened as Anda. A copilot for your computer, powered by the Anda Brain.☆21Updated this week
- Easily check licenses against Gumroad's API.☆21Updated this week
- 5X faster 60% less memory QLoRA finetuning☆21May 28, 2024Updated 2 years ago
- A tool for uploading and managing projects in Claude.ai☆40Aug 14, 2025Updated 11 months ago
- PTX-EMU is a simple emulator for CUDA program.☆40Apr 25, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- VibeRL is a Reinforcement Learning framework built essentially through vibe coding with Kimi K2.☆17Jul 13, 2026Updated last week
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆13Nov 23, 2024Updated last year
- Pure C inference of Mistral Voxtral Realtime 4B speech to text model☆1,710Feb 15, 2026Updated 5 months ago
- ☆15Apr 27, 2026Updated 2 months ago
- The best benchmark for LLMs on Apple's MLX framework knowledge and coding tasks.☆37Jun 12, 2026Updated last month
- ☆26Mar 10, 2026Updated 4 months ago
- TradingAgents with a polished local GUI — install once, run multi-agent LLM stock analyses locally.☆19May 25, 2026Updated last month