From-scratch, heavily-annotated CUDA inference runtime for Qwen2.5-Coder-7B on H100 (sm_90). Custom INT4 packer, fused GEMV, paged KV, split-KV attention, CUDA graph decode — every hot path commented for the why. Educational, not a llama.cpp replacement.
☆21Aug 11, 2026Updated 2 months ago
Alternatives and similar repositories for Annotated-LLM-Runtime
Users that are interested in Annotated-LLM-Runtime are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A pure-Python reachability and skeletonization layer that decides what a coding agent actually sees before a request reaches the API.☆63Aug 29, 2026Updated last month
- A persistent knowledge layer for AI systems. RAG evidence + a structured knowledge store that tracks concepts, decisions, and contradicti…☆18Jul 15, 2026Updated 3 months ago
- Example projects and templates built using Eve☆34Sep 14, 2026Updated last month
- SmartThings Hello Home automation for Z-Wave Locks☆16Dec 24, 2014Updated 11 years ago
- Deploy AI models at scale. High-throughput serving engine for AI/ML models that uses the latest state-of-the-art model deployment techniq…☆10May 21, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- SmartThings Honeywell TotalConnect Device☆12Dec 8, 2016Updated 9 years ago
- ☆13Feb 18, 2025Updated last year
- STT-4230 / STT-6230 R pour scientifique - Notes de cours☆12Dec 16, 2022Updated 3 years ago
- Agent Droid Bridge gives AI agents programmatic control over Android devices and emulators via ADB, exposed as an MCP server.☆22Jun 30, 2026Updated 3 months ago
- A Blender extension for code-less generation of synthetic image datasets for computer vision☆24Sep 22, 2026Updated 3 weeks ago
- PowerShell module for PDQ Deploy/Inventory administration.☆12Sep 25, 2019Updated 7 years ago
- LatentSkill: From In-Context Textual Skills to In-Weight Latent Skills for LLM Agents☆38Aug 30, 2026Updated last month
- A demo Project on Populating the mindfulness section in the iOS Health Section☆12Feb 5, 2017Updated 9 years ago
- Official repository for “From Trainee to Trainer: LLM-Designed Training Environment for RL with Multi-Agent Reasoning”“☆25Jun 15, 2026Updated 4 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Oracle Berkeley DB sourcecode☆12May 5, 2014Updated 12 years ago
- MCPHub - A cross-platform GUI application to discover, install, and manage Model Context Protocol (MCP) servers. Think of it as apt/pip b…☆12May 3, 2026Updated 5 months ago
- [ECCV 2026] Parallelized Autoregressive Decoding for Omni-Modal Dense Video Captioning☆34Aug 13, 2026Updated 2 months ago
- Matrix Algebra with computational Application. Open Educational Resources Textbook written in Jupyter Notebooks☆11Sep 14, 2021Updated 5 years ago
- Official Repostitory of "FreeStyle: Free Control of Style Content Generation from Community LoRA Mining "☆33Jun 24, 2026Updated 3 months ago
- A shared, git-backed wiki your team's AI agents maintain but can't break — Claude Code, Codex, OpenCode and any MCP client.☆41Updated this week
- 010Editor-Crack version:13.0.1☆10Mar 18, 2024Updated 2 years ago
- This repository demonstrates the use of a prompt jailbreak to expose information within a system prompt. Specifically, we target any LLM …☆15Mar 18, 2024Updated 2 years ago
- Jev Explained☆35Sep 20, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Learning from Graphs: From Mathematical Principles to Practical Tools☆11Apr 16, 2021Updated 5 years ago
- LazyLibrarian is an automated book downloader for SABnzbd.☆18Dec 19, 2012Updated 13 years ago
- DGX Spark (GB10) random hard power-off: how to diagnose the log-less crash signature and stop it with a GPU clock cap. Field-tested fix +…☆25Aug 16, 2026Updated 2 months ago
- lshash for python3☆10Mar 21, 2018Updated 8 years ago
- R Studio Addins for common data frame operations☆13Aug 5, 2016Updated 10 years ago
- Automating the Implementation of a Cybersecurity Governance, Risk and Compliance Programme using Distributed Ledger Technologies☆12Aug 28, 2022Updated 4 years ago
- Code and experiments using the optimal solution to the flow-matching training objective.☆13Jun 14, 2025Updated last year
- A Python module to visualise quantum circuit☆10Nov 14, 2018Updated 7 years ago
- Reverse Engineered OLD reCAPTCHA Botguard + Token Generator☆48Jun 4, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- End-to-end project training and building AI models / LLMs to detect AI-written text☆49Sep 1, 2026Updated last month
- ☆16Jan 28, 2015Updated 11 years ago
- ☆14Oct 5, 2024Updated 2 years ago
- Device Type & SmartApp for ZWN-SC7 Enerwave 7 Button Scene Controller☆23May 11, 2017Updated 9 years ago
- An attempt at replicating Deepmind's Neural Turing Machines in Theano☆11Nov 27, 2016Updated 9 years ago
- A booklet on the Smacc compiler compiler framework☆15Sep 27, 2026Updated 3 weeks ago
- List of public DoH providers☆20Updated this week