documenting my work in inference engineering
☆25Apr 19, 2026Updated 3 months ago
Alternatives and similar repositories for inference-engineering
Users that are interested in inference-engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An educational distributed training and inference library for neural nets using local computing☆72Jun 10, 2026Updated last month
- A fast vector database written in C.☆42Jul 6, 2026Updated 2 weeks ago
- A collection of all the algorithms, analysis and working codes for the CYL47 course programs!☆13Aug 15, 2023Updated 2 years ago
- Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.☆19Feb 9, 2026Updated 5 months ago
- Lightweight Vector Search Library focused on Memory Efficiency☆186Mar 16, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Deep learning paper implementations☆19May 15, 2025Updated last year
- A Devvit app which sends incoming and outgoing modmails from your subreddit's modmail to a Discord or Slack webhook instantly. Sends the…☆16May 9, 2026Updated 2 months ago
- Library for arbitrary precision arithmetic and computation☆52Updated this week
- My submission for the GPUMODE/AMD fp8 mm challenge☆29Jun 4, 2025Updated last year
- ☆107Jun 18, 2026Updated last month
- Implementation for IceCache: Memory-Efficient KV-cache Management for Long-Sequence LLMs (ICLR 2026).☆19Jun 9, 2026Updated last month
- RISC-V 64 hypervisor written in Rust☆22May 29, 2026Updated last month
- Carla worldsim envrionment for decision-making evaluation and RL☆19Apr 22, 2026Updated 2 months ago
- Video tutorial below☆15Dec 1, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Small footprint and configurable NVMe core.☆16Jul 14, 2026Updated last week
- 🐱Cat theme for spotify using spicetify🎶☆20Jul 10, 2026Updated last week
- A device tree (DT) for xiaomi sdm660 phones, requires device specific DT☆14May 4, 2024Updated 2 years ago
- An Emacs-inspired C++20 terminal editor. No Lisp. No bloat.☆21Jun 4, 2026Updated last month
- planet gen☆23Oct 24, 2025Updated 8 months ago
- Esoteric language 🩷☆21Updated this week
- Bottom bar helps create an optimized bottom navigation bar with beautiful animations☆15May 26, 2025Updated last year
- A small, statically-typed programming language and its compiler, written in Rust☆26Jun 21, 2026Updated 3 weeks ago
- sigil is a low level tool that runs a linux process in a private and restricted environment similar to docker☆37Apr 16, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆10Jul 28, 2021Updated 4 years ago
- ☆12Apr 8, 2024Updated 2 years ago
- ☆16Sep 3, 2022Updated 3 years ago
- RL models to play Sokoban. The fastest recipe wins.☆30Updated this week
- Leanstral's fork of SafeVerify, which we use for code agent training and as part of our evaluation stack.☆29Jul 3, 2026Updated 2 weeks ago
- PDF Readr + AI Chat - Turn docs into conversations☆17Sep 26, 2025Updated 9 months ago
- Improve your realmeUI experience!☆15Apr 10, 2024Updated 2 years ago
- ☆10Sep 13, 2021Updated 4 years ago
- ☆10Nov 25, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12Aug 18, 2023Updated 2 years ago
- Crossplane Open Service Broker API☆21Updated this week
- ☆13Jun 17, 2025Updated last year
- ☆32Mar 29, 2026Updated 3 months ago
- This repository presents an efficient acceleration pipeline for Diffusion Transformer (DiT) based video generation models, optimized for …☆17Jul 13, 2026Updated last week
- Repo containing artifacts for Neurips 2025 tutorial- How to Build Agents to Generate Kernels for Faster LLMs (and Other Models!)☆15May 11, 2026Updated 2 months ago
- Arctic Training and Inference Platform☆56Updated this week