LLM inference in C/C++
☆36Apr 12, 2026Updated 3 months ago
Alternatives and similar repositories for turbo3-cuda
Users that are interested in turbo3-cuda are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLAMA Turboquant implementation with CUDA support☆687Updated this week
- Core Kit for adding NPCs and a solution for NPC+Player combat.☆11Jan 2, 2023Updated 3 years ago
- Create powerful personal software on your intelligent cloud computer.☆49Updated this week
- Fused TBQ4 Flash Attention + MTP + Shared Tensors for llama.cpp — 82+ tok/s with lossless 4.25 bpv KV cache at 200K context on RTX 4090☆88May 17, 2026Updated last month
- OpenManus-node is a Node.js and TypeScript recreation of the mannaandpoem/OpenManus project☆21Mar 15, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆16Jun 15, 2026Updated 3 weeks ago
- Karras et al. (2022) diffusion models for PyTorch☆18Oct 5, 2023Updated 2 years ago
- Parrot Flower Power sensor web API wrapper for iOS☆11Dec 27, 2014Updated 11 years ago
- GitHub Action to invoke the PI coding agent on issues and PRs via comment triggers☆29May 4, 2026Updated 2 months ago
- Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more☆14Oct 12, 2022Updated 3 years ago
- TurboQuant KV Cache Compression for llama.cpp — 5.2x memory reduction with near-lossless quality | Implementation of Google DeepMind's …☆88Updated this week
- Example of using an AI NPC in Godot VR, using Godot OpenXR (Godot 3.5.1), Wit.ai, GPT-3.5-turbo, convAI, ElevenLabs, and Godot-tts addon☆23Apr 26, 2023Updated 3 years ago
- An automated tool to generate short vertical videos from YouTube content, focusing on the most replayed sections and using AI-powered aut…☆13Sep 9, 2024Updated last year
- A docker image which includs Bind and Stubby for DNS over TLS☆13Oct 25, 2018Updated 7 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- PersoSim - the open source eID simulator☆16May 21, 2026Updated last month
- A text-to-audio model for generating text-conditioned drum beats☆21Apr 25, 2023Updated 3 years ago
- ☆17Mar 19, 2026Updated 3 months ago
- A real-time Grafana dashboard using MISP ZeroMQ message queue and InfluxDB☆19Mar 15, 2024Updated 2 years ago
- Meet IFR: a bio-inspired engine solving RAG’s biggest flaws. It achieves true O(1) scaling latency stays <5ms even as data grows 1000x. W…☆16Apr 3, 2026Updated 3 months ago
- Reproducible set of dotfiles and packages for my daily computing☆15Jul 7, 2026Updated last week
- ☆20Feb 27, 2026Updated 4 months ago
- TurboQuant+ KV cache compression for vLLM. 3.8x smaller KV cache, same conversation quality. Fused CUDA kernels with automatic PyTorch fa…☆74Updated this week
- Extract "most replayed" moments from youtube videos in Python☆27Sep 25, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Various stuff and tweaks I have around Obsidian☆13Jun 20, 2025Updated last year
- Requires Unreal Engine 4.20☆11Mar 11, 2020Updated 6 years ago
- Code for the culip ("CUda for Linear and Integer Programming") project, containing GPU primitives for linear algebra, linear optimization…☆19Oct 12, 2018Updated 7 years ago
- Team project using natural language to query blockchain data☆14Apr 17, 2023Updated 3 years ago
- Secure (ST31) SDK for Ledger Blue☆14Jul 27, 2018Updated 7 years ago
- My code for a serialization performance test☆14Sep 23, 2025Updated 9 months ago
- A game for GameOff 2018☆15Dec 1, 2018Updated 7 years ago
- ☆14Sep 20, 2024Updated last year
- ☆20Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Kubernetes simplified, containerized, and democratized for rootless environments.☆41Dec 10, 2025Updated 7 months ago
- mcp server for just☆53Jun 15, 2026Updated 3 weeks ago
- Scratch card is based on HTML5, it generates canvas on the fly and is optimized for all modern browsers and has touch support for mobile…☆13Aug 3, 2017Updated 8 years ago
- Music -- separate into stems, modify, convert to midi, add synth sounds, remix.☆17May 25, 2026Updated last month
- 🧜♀️ Pi extension that renders Mermaid diagrams as ASCII in the TUI, with width-aware output and safe handling for larger diagrams.☆68Feb 23, 2026Updated 4 months ago
- ☆11Mar 25, 2019Updated 7 years ago
- Graph tool for sysadmins, with anomaly detection and redis backend.☆13May 5, 2017Updated 9 years ago