a LLM inference engine to run on consumer hardware
☆48Apr 15, 2026Updated 6 months ago
Alternatives and similar repositories for tachyon
Users that are interested in tachyon are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- writing really fast kernels☆21Oct 11, 2026Updated last week
- a personal collection of my notes for ml sys☆126Updated this week
- a minimal paged attention implementation☆20Jan 30, 2026Updated 8 months ago
- a simple c++ inference engine for gpt based architecture☆41Dec 10, 2025Updated 10 months ago
- Plug-and-play PyTorch transformer research framework. Swap attention, FFN, norm, positional, connection, projection, optimizer, scheduler…☆18Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Implemented and benchmarked KV cache compression methods for LLM inference in Triton. Optimized kernels for KIVI and TurboQuant with Flas…☆18Jun 19, 2026Updated 4 months ago
- everything you need to know about inference engineering☆43Sep 29, 2026Updated 3 weeks ago
- A Desktop Markdown based notetaking app☆12Mar 21, 2024Updated 2 years ago
- ☆28Aug 25, 2026Updated last month
- ☆17Aug 16, 2026Updated 2 months ago
- Tile primitives for speedy kernels☆21Sep 13, 2026Updated last month
- serving a torch model using Celery, Redis and RabbitMQ to serve users asynchronously☆25Jan 21, 2024Updated 2 years ago
- A simple 2.5D raycasting engine inspired by Wolfenstein 3D☆13Jan 25, 2026Updated 8 months ago
- NCCL communication API layer, and transport layer created from first principles.☆16Aug 20, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Awesome Aviation resources☆14Jun 21, 2026Updated 4 months ago
- ☆134Dec 9, 2025Updated 10 months ago
- Alcove-style dynamic notch for T3 Code: live agent progress, task lists, and approvals answered under the Mac notch☆37Aug 12, 2026Updated 2 months ago
- An expense tracking application that embodiesminimalist design philosophy with clean typography, subtle shadows, and elegant micro-intera…☆15Aug 31, 2025Updated last year
- fastcv is a CUDA rewrite of the opencv filters with python bindings☆75Oct 10, 2025Updated last year
- ☆16Jul 21, 2026Updated 3 months ago
- a programming language written from scratch in python☆15Oct 22, 2025Updated last year
- ☆121Oct 7, 2026Updated 2 weeks ago
- ☆20Apr 26, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆25Apr 4, 2026Updated 6 months ago
- A blank-slate, memory-safe, ultra-high-performance property-graph database in Rust — unified MVCC/time-travel/branches/replication over a…☆29Updated this week
- Anor Londo Lighting Fix v1.1 – Enhances Anor Londo’s lighting by restoring missing light sources, improving shadows, and balancing bright…☆14Aug 11, 2025Updated last year
- An Emacs-inspired C++20 terminal editor. No Lisp. No bloat☆21Aug 19, 2026Updated 2 months ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆20Oct 13, 2026Updated last week
- A high-performance, multithreaded subdomain enumerator written in Julia, leveraging crt.sh for rapid reconnaissance with built-in Docker …☆10Sep 8, 2025Updated last year
- ☆11Oct 15, 2025Updated last year
- A fast image processing TUI written in Rust☆22Aug 18, 2025Updated last year
- Cuda implemenation of flash-kmeans, 2x faster☆23May 8, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Repository for the CUDA H100 Course☆79Apr 12, 2026Updated 6 months ago
- Adaptive batch inference pipeline with semantic complexity routing, circuit breaker fault tolerance, and SSE-streamed progress, built for…☆25May 19, 2026Updated 5 months ago
- Code for MatGPTQ: Accurate and Efficient Post-Training Matryoshka Quantization☆31Oct 6, 2026Updated 2 weeks ago
- ☆13Nov 9, 2018Updated 7 years ago
- Fused MoE kernel☆23Aug 10, 2026Updated 2 months ago
- A pure-Python implementation of the Nvidia CuTe layout algebra intended to be approachable and easy to learn.☆253Jun 29, 2026Updated 3 months ago
- Examples in the MLX framework☆11Sep 23, 2024Updated 2 years ago