From-scratch, heavily-annotated CUDA inference runtime for Qwen2.5-Coder-7B on H100 (sm_90). Custom INT4 packer, fused GEMV, paged KV, split-KV attention, CUDA graph decode — every hot path commented for the why. Educational, not a llama.cpp replacement.
☆21Aug 11, 2026Updated 2 months ago
Alternatives and similar repositories for Annotated-LLM-Runtime
Users that are interested in Annotated-LLM-Runtime are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Mental Overload Detection with Respiration Variability Spectrogram☆12Oct 29, 2018Updated 8 years ago
- With an ever-rising number of news articles and opinions, an investment startup aims to leverage artificial intelligence to address the c…☆11Dec 2, 2024Updated last year
- This repo contains all the code for the streamlit app and the notes covered in the n8n masterclass☆18Jan 25, 2026Updated 9 months ago
- An in-app browser pane for DeepSeek Harness — real Chrome over CDP, plus rendered previews of local files, markdown and PDFs.☆15Sep 28, 2026Updated last month
- High-performance tokenization for inference☆15Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Tiny HTTP proxy that lets OpenClaw (and other third-party agents) route Anthropic /v1/messages through your claude login OAuth session. A…☆15Apr 5, 2026Updated 7 months ago
- A clone of the popular online movie ticket booking platform, BookMyShow, built using Java and Spring Boot.☆16Feb 27, 2024Updated 2 years ago
- A pure-Python reachability and skeletonization layer that decides what a coding agent actually sees before a request reaches the API.☆65Aug 29, 2026Updated 2 months ago
- Retired LangGraph source archive under tiangong-ai. Shared runtime retirement is managed separately.☆13Sep 14, 2026Updated last month
- Terraform provider for SAP Cloud Infrastructure extended OpenStack Services☆11Oct 29, 2026Updated last week
- ☆20Apr 25, 2026Updated 6 months ago
- Real-time DBN market-data pipeline with a nanosecond-level limit order book, lock-free SPSC queues, and high-speed ClickHouse ingestion. …☆18Dec 1, 2025Updated 11 months ago
- Evaluate LLM safety and performance across non-English languages.☆14Sep 25, 2026Updated last month
- ☆14Apr 5, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Claude Microsoft plugins☆18Sep 23, 2026Updated last month
- ☆17Mar 6, 2025Updated last year
- ☆18Oct 29, 2026Updated last week
- ☆16Jan 28, 2015Updated 11 years ago
- ☆16Sep 18, 2023Updated 3 years ago
- lshash for python3☆10Mar 21, 2018Updated 8 years ago
- GitHub repository for the Microsoft Defender for Identity in Depth book☆11Dec 5, 2024Updated last year
- A packer/unpacker of Content.pak from Survivalcraft 2(2.1).☆12Feb 13, 2020Updated 6 years ago
- My interactive CV, Inspired by Robby Leonardi's interactive Resume (http://www.rleonardi.com/interactive-resume/)☆23Mar 6, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆12Jan 20, 2024Updated 2 years ago
- A simple Docker sandbox example and a ready-to-use autograder API. Based on asynchronous FastAPI and disposable Docker containers. Three …☆15Jan 10, 2022Updated 4 years ago
- ☆14Oct 22, 2023Updated 3 years ago
- [MOVED → github.com/stellar/smart-account-kit] TypeScript SDK for OpenZeppelin Stellar smart accounts with passkeys, multi-signers, autho…☆14Jul 31, 2026Updated 3 months ago
- A production-grade control layer that sits between your application logic and any LLM — input validation, schema enforcement, circuit bre…☆62May 25, 2026Updated 5 months ago
- ☆17Apr 15, 2025Updated last year
- ☆14Aug 25, 2024Updated 2 years ago
- Launch your meme tokens here, powered by Uniswap v4 hooks☆15Jul 14, 2024Updated 2 years ago
- Efficient (Jet) 0-shot tuning-free context extension with strong performance (Long).☆13Sep 28, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- List of all faucetpay faucets. Sort by different criteria and find the most paying ones.☆12Apr 21, 2026Updated 6 months ago
- python jupyter notebook tutorials☆14Apr 14, 2026Updated 6 months ago
- MOVED: now at https://opendev.org/x/picasso☆27Sep 26, 2019Updated 7 years ago
- A PyTorch port of DeepMind's Disco103 — the meta-learned reinforcement learning update rule from Discovering State-of-the-art Reinforceme…☆15Sep 3, 2026Updated 2 months ago
- Example of bidirectional communication between Lightning Components and Visualforce pages☆16Jan 4, 2017Updated 9 years ago
- Nsight Compute In Docker☆13Dec 21, 2023Updated 2 years ago
- Book My Show Demo App☆20Dec 15, 2024Updated last year
Are these results useful?