100 days of LLM inference engineering — daily posts, experiments, and visualizations
☆1,860Apr 30, 2026Updated 5 months ago
Alternatives and similar repositories for 100-days-of-inference
Users that are interested in 100-days-of-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- OMP-native pstack and orchestration skills for multi-agent coding workflows☆66Aug 18, 2026Updated 2 months ago
- ☆120Oct 7, 2026Updated last week
- Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.☆347Oct 5, 2026Updated last week
- Learn harness engineering by building Claude Code from scratch. Free, open-source course: 8 articles, 6 videos, 1 codebase.☆667Oct 10, 2026Updated last week
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆4,197Sep 12, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Self-hostable kody.codes☆60Updated this week
- ☆92Aug 13, 2026Updated 2 months ago
- Curated collection of AI inference engineering resources — LLM serving, GPU kernels, quantization, distributed inference, and production …☆349Feb 4, 2026Updated 8 months ago
- ☆90Sep 9, 2026Updated last month
- A framework for building robust RL environments to train aligned AI.☆143Updated this week
- Skills that drive best-in-class engineering☆199Oct 5, 2026Updated last week
- Sniff out the right record: Jev-powered search for Rails with index-time labels, query understanding, and streamed reranking on top of yo…☆52Oct 2, 2026Updated 2 weeks ago
- One catalog for every CLI tool on your Mac: native app plus a JSON-friendly CLI for AI agents☆45Oct 8, 2026Updated last week
- All my walkthroughs for HTB Academy labs in the Active Directory Module ( CPTS path ). Includes folder of canvas files for Obsidian.☆67Apr 27, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchma…☆981Aug 14, 2026Updated 2 months ago
- An infinite physically rolling paper strip that prints an endless portfolio built in Three.js with Fable 5☆74Jul 22, 2026Updated 2 months ago
- Open-source-ready Storm Tracker hardware design, documentation, BOM, and manufacturing package☆58Aug 13, 2026Updated 2 months ago
- Language model tokenization at GB/s☆4,128Sep 2, 2026Updated last month
- Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generati…☆572Updated this week
- VectraDB is an in-memory, high performance vector database written in Go.☆33Jun 21, 2026Updated 3 months ago
- A skill for writing and improving programs that call Jev, TypeSafe's System One model☆155Sep 17, 2026Updated last month
- Learn LLM internals step by step - from tokenization to attention to inference optimization.☆1,756Updated this week
- ☆43Sep 14, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- GPU Engineering for AI Systems☆603May 17, 2026Updated 5 months ago
- A simple mono-repo build tool.☆66Updated this week
- PorTAL generates portable task specific LoRA adapters that can efficiently transfer across language models.☆126Jul 27, 2026Updated 2 months ago
- GLM-5.3-Flash × J-Space capability realization — benchmark presentation of the J-Space Cognition Suite☆1,020Sep 5, 2026Updated last month
- Become GPU kernel engineer step by step.☆74May 7, 2026Updated 5 months ago
- Official PyTorch implementation for "TensorLens: End-to-End Transformer Analysis via High-Order Attention Tensors" [ACL 2026]☆49Apr 14, 2026Updated 6 months ago
- A GPT-2 inference engine written from scratch in CUDA and C++. Implements custom CUDA kernels for tiled matrix multiplication, LayerNorm,…☆44May 17, 2026Updated 5 months ago
- ☆18,542Oct 10, 2026Updated last week
- ☆2,637Sep 13, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- AgentENV (AENV) is a distributed platform for running agent environments at scale.☆3,643Updated this week
- One command to run the AI coding CLI you already pay for (Claude Code, Codex, Cursor, Gemini, Grok, aider) on a Tailscale-only Hetzner bo…☆109Jun 30, 2026Updated 3 months ago
- An open-source execution engine for AI-SQL and LLM-powered dataflow☆168Updated this week
- NVIDIA Object Oriented Agents: the Pythonic way to build AI Agents.☆2,282Updated this week
- A reading path for CPU performance engineering, from one instruction to production inference. Primary sources only, with a runnable bench…☆1,160Oct 8, 2026Updated last week
- Free, open-source AI Office suite (Word, Excel, PowerPoint, PDF, Markdown) — macOS build, one-click install☆613Sep 28, 2026Updated 2 weeks ago
- ScienceIDE: Turning World’s Scientific Codebase into Agent Learnable Environments☆94Sep 19, 2026Updated 3 weeks ago