What actually runs on an RTX 3060 12GB, if you have any card with 12GB vram, this is for you as well. measured, with commands
☆163Aug 22, 2026Updated 2 months ago
Alternatives and similar repositories for runs-on-a-3060
Users that are interested in runs-on-a-3060 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Custom llama.cpp fork for running EschaLabs Escha models.☆13Sep 11, 2026Updated last month
- Run a 177B model (Qwen3.8-Flash-Next) on an 8 GB laptop GPU. Measured: 6.6 GiB VRAM, 47.8 GiB RAM, 34-35 tok/s. The n-gram table stays on…☆27Sep 1, 2026Updated 2 months ago
- Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts speed + memory fit for any …☆93Oct 7, 2026Updated last month
- An intuitive console agent to fine-tune AI models with little to no experience required!☆212Oct 5, 2026Updated last month
- One llama.cpp flag unlocks +33-39% decode speed for Qwen3.8-27B on consumer GPUs. The MTP head already ships inside your GGUF. Recipe, pa…☆367Sep 26, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Qwen3.8-27B on 16-32 GB Nvidia GPUs one-click install for Windows / Linux☆600Oct 9, 2026Updated 3 weeks ago
- The agent that grows with you☆14Oct 14, 2026Updated 3 weeks ago
- Mirai S (Qwen3.8-27B-S trellis GGUF) on a 12 GB RTX 4070: 262k q8_0 tiered cache, MTP drafting at every depth, harness-proofing, the laye…☆109Oct 26, 2026Updated last week
- ☆39Jul 27, 2026Updated 3 months ago
- llama.cpp fork with TQ3_1S/4S CUDA kernels — 3.5-bit WHT quantization achieving Q4s quality at 10% smaller size. Based on RaBitQ-inspired…☆237Oct 13, 2026Updated 3 weeks ago
- BDF is a browser document-preview suite: it combines converters for many formats (Go/WASM), a browser renderer of about 23 KB gzipped, an…☆51Oct 30, 2026Updated last week
- Raw speed benchmark traces: Qwen3.8-27B on 4x RTX 3090. llama.cpp GGUF sweeps + 288-point vLLM vs SGLang, NVFP4 vs FP8 matrix.☆14Sep 28, 2026Updated last month
- Easily run LLMs locally using llama.cpp directly, without overhead.☆21Aug 15, 2026Updated 2 months ago
- Unofficial NVIDIA RE-USE speech enhancement for Apple Silicon, with a Swift SDK and iPhone/Mac samples☆16Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Template Matching PyTorch implementation☆13Jan 21, 2019Updated 7 years ago
- A front door to community tools that extend the DeepSeek Harness (dsh): web access, vision, and more. Unofficial community project.☆43Sep 28, 2026Updated last month
- ☆16Oct 20, 2026Updated 2 weeks ago
- Real browser automation with local GLiNER2 inference and open weights. Work in progress. Contributions welcome.☆81Oct 22, 2026Updated 2 weeks ago
- みんなのローカルLLMベンチマーク結果をあつめるレポジトリ☆35Oct 21, 2026Updated 2 weeks ago
- ☆22Oct 18, 2026Updated 2 weeks ago
- Benchmark your local LLMs with real evaluation suites. Not vibes - actual scores.☆38Updated this week
- Linux port of Rufus — bootable USB creator with GTK4☆12Jul 5, 2026Updated 4 months ago
- Improving Source Extraction with Diffusion and Consistency Models☆12Jul 18, 2026Updated 3 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Fastest validated sglang recipe for Qwen3.8-27B (AWQ-INT4 + DSpark) on RTX 3090s — 1×/2×/4× GPU presets, image+video, full benchmarks☆64Oct 17, 2026Updated 3 weeks ago
- Turn saved links into reusable skills for builders.☆18Jul 8, 2026Updated 3 months ago
- chissu-pam is face-recognition PAM Module written in Rust, powered by Dlib☆12May 18, 2026Updated 5 months ago
- IsaacLab extension for the MicroDuck bipedal robot: USD assets, BAM actuator and gearbox-backlash models, and 21 RL task families — walki…☆18Oct 26, 2026Updated last week
- llama.cpp with Mirai S (2.4-bit Qwen3.8-27B) support: 128K context on a 12 GB GPU☆11Oct 7, 2026Updated 3 weeks ago
- Native desktop client for slack.com☆10May 23, 2018Updated 8 years ago
- ☆11Jan 13, 2026Updated 9 months ago
- Paramo1d is mobile Parano1d☆30Oct 24, 2026Updated last week
- SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7 tok/s on two consumer 16GB G…☆234Sep 1, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- search papers of cvpr 2023 by chat gpt☆14Jun 15, 2023Updated 3 years ago
- Universal frequency-band splitter for music source separation: one interface for BSRoformer, MelBandRoformer, or any Band Split. RoPE, Po…☆13Updated this week
- Sniff out the right record: Jev-powered search for Rails with index-time labels, query understanding, and streamed reranking on top of yo…☆52Oct 2, 2026Updated last month
- Local AI registry: one validated recipe per machine, with the evidence attached☆290Updated this week
- Dataset abierto de modelos de HuggingFace: metadatos curados y normalizados, licencias clasificadas, parámetros reales, tumbas de modelos…☆21Updated this week
- Plain-language web remote control for a fleet of ComfyUI instances (Qwen-Image-2.1 stills, MiniMax-H3 video). Stdlib Python, no dependenc…☆47Oct 9, 2026Updated 3 weeks ago
- Capacitive touch keyboard running QMK firmware☆13Aug 3, 2024Updated 2 years ago