☆32Oct 7, 2026Updated last month
Alternatives and similar repositories for castagna-veloce
Users that are interested in castagna-veloce are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM inference in C/C++☆77Nov 6, 2026Updated last week
- 🚿 Llaminar: an LLM inferencing engine in C++.☆48Updated this week
- INT8-native vLLM fork☆29Updated this week
- Custom HIP inference engine for AMD MI50/MI60 (gfx906)☆20Updated this week
- llama.cpp with Mirai S (2.4-bit Qwen3.8-27B) support: 128K context on a 12 GB GPU☆11Oct 7, 2026Updated last month
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆52Nov 8, 2026Updated last week
- DeepSeek-V4.1-Flash on 4x DGX Spark (GB10): exact 4-node TensorFold (Zig) recipe, vision, 1M context☆14Nov 4, 2026Updated last week
- Chrome extension Vite Starter with Shadcn, Framer motion and Tailwind CSS☆12Updated this week
- vllm for pascal☆12Nov 22, 2025Updated 11 months ago
- Random AI notes for working with local models or playing around with random machine learning bits.☆64Jun 7, 2026Updated 5 months ago
- llama.cpp-gfx906☆150Aug 23, 2026Updated 2 months ago
- Profile-guided GPU kernel optimizer for AMD/RDNA3. Auto-tunes llama.cpp MMVQ kernels per model shape. 2x decode speedup on 7900 XTX.☆71Sep 5, 2026Updated 2 months ago
- vLLM fork for pascal gpu☆18Mar 13, 2026Updated 8 months ago
- Proxy for OpenAI☆16Sep 2, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Decentralizing distribution of open-source AI models.☆24Updated this week
- A simple no-install web UI for Ollama and OAI-Compatible APIs!☆31Jan 30, 2025Updated last year
- AI Dev Ops Agent with local llm☆13Dec 15, 2025Updated 11 months ago
- Smart OpenAI‑compatible proxy for llama.cpp: manages slots, saves/restores KV cache to disk, routes requests by prefix similarity, and pr…☆57Sep 16, 2026Updated 2 months ago
- A PowerShell script to fully automate the setup of `llama.cpp` on Windows. It installs all prerequisites, including the correct CUDA Tool…☆25Oct 30, 2026Updated 2 weeks ago
- LLM-agnostic memory layer for AI agents. No embeddings, no vector DB — just fast, structured, temporal memory that any LLM can consume as…☆12Apr 27, 2026Updated 6 months ago
- Raytracer demo written in Dart☆14Apr 20, 2015Updated 11 years ago
- A lightweight web browser chatbot interface for Ollama models☆25Apr 6, 2025Updated last year
- CherryPick is a modular, open-source dependency injection ecosystem for Dart and Flutter☆12Nov 4, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A local, multimodal embedding server and vector database using NVIDIA's Omni-Embed-Nemotron-3B. This project allows you to generate embed…☆11Nov 27, 2025Updated 11 months ago
- Speech-to-text and Text-to-speech Flutter plugin.☆13Sep 29, 2026Updated last month
- Test your local LLMs on the AIME problems☆39Jun 7, 2025Updated last year
- ☆13Mar 12, 2026Updated 8 months ago
- A secure, local-first Python framework for orchestrating complex multi-agent think tanks with dynamic expertise-weighted routing.☆20Sep 4, 2026Updated 2 months ago
- ☆11Nov 3, 2026Updated last week
- Automated CrowdSec intrusion detection and security monitoring for Kamal-deployed production VPS, with Telegram alerts.☆13Aug 1, 2026Updated 3 months ago
- A comprehensive Python toolkit for local deployment of Microsoft's Florence-2 vision model. Process images with state-of-the-art computer…☆12Nov 27, 2025Updated 11 months ago
- Recover usable memory on DGX Spark with a 64 KiB kernel: an opt-in NVIDIA UVM page-table packing patch, build tools, and measured validat…☆39Oct 16, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆17Jul 30, 2026Updated 3 months ago
- Give any LLM its own display. Send JSON, get beautiful interactive UI.☆14Mar 1, 2026Updated 8 months ago
- Serve Ornith-1.5-35B-A3B (NVFP4 + in-checkpoint MTP, 256k ctx) on one DGX Spark — vLLM b12x recipe plus CUDA-graph fixes.☆33Aug 19, 2026Updated 2 months ago
- A command line tool for translation of Flutter ARB files☆17Updated this week
- Unstable, Experimental LTX 2.3 GGUF inference in C++ (DO NOT USE IT YET)☆17Mar 20, 2026Updated 7 months ago
- ☆12Jun 28, 2025Updated last year
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆436Feb 20, 2026Updated 8 months ago
Are these results useful?