a simple c++ inference engine for gpt based architecture
☆41Dec 10, 2025Updated 10 months ago
Alternatives and similar repositories for inferGPT
Users that are interested in inferGPT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- a minimal paged attention implementation☆20Jan 30, 2026Updated 8 months ago
- ☆15Jul 25, 2025Updated last year
- ☆134Dec 9, 2025Updated 10 months ago
- Multithreaded chat app server built on top of my own websocket echo server from scratch. Load-tested for 1,000 clients with highest throu…☆17Dec 16, 2025Updated 9 months ago
- tinyRPC -> A minimal Typescript RPC framework .☆26Jan 24, 2026Updated 8 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- An Emacs-inspired C++20 terminal editor. No Lisp. No bloat.☆21Aug 19, 2026Updated last month
- virtual machine in C☆31Apr 19, 2026Updated 5 months ago
- Typescript UI library ^^☆35Oct 29, 2025Updated 11 months ago
- a programming language written from scratch in python☆15Oct 22, 2025Updated 11 months ago
- a LLM inference engine to run on consumer hardware☆48Apr 15, 2026Updated 5 months ago
- ☆18Jun 26, 2024Updated 2 years ago
- writing really fast kernels☆20Sep 12, 2026Updated 3 weeks ago
- write ahead log implementation☆20Jan 8, 2026Updated 9 months ago
- Open-source web analytics built for modern websites — simple, fast, and easy to use.☆14Jul 26, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- An expense tracking application that embodiesminimalist design philosophy with clean typography, subtle shadows, and elegant micro-intera…☆15Aug 31, 2025Updated last year
- a retro terminal-themed typing platform with real-time multiplayer races, leaderboards, and classic literature practice.☆22Mar 31, 2026Updated 6 months ago
- minimal implementation of kafka paper☆28Apr 7, 2026Updated 6 months ago
- ☆25Dec 1, 2025Updated 10 months ago
- conflux is a realtime collaboration engine with automatic lifecycle management while using YRS crate and purely written in rust.☆51Apr 18, 2026Updated 5 months ago
- ☆12Jun 14, 2024Updated 2 years ago
- SculptX is an experimental synesthetic composer☆22Aug 31, 2025Updated last year
- raft based distributed kv store☆29Jan 6, 2026Updated 9 months ago
- A cache-aware, tensor-optimized memory allocator in C++☆29Apr 27, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆20Apr 26, 2026Updated 5 months ago
- ☆45Mar 31, 2025Updated last year
- A fast image processing TUI written in Rust☆22Aug 18, 2025Updated last year
- REST API for snarkjs prover☆21Mar 14, 2023Updated 3 years ago
- Container runtime Implementation from scratch in c++☆29Apr 16, 2026Updated 5 months ago
- A simple but instructive implementation of DP, TP, FSDP, FSDP+TP using pytorch distributed primitives☆24Apr 12, 2026Updated 5 months ago
- R package for tracking Covid19 cases in San Francisco☆12Apr 2, 2023Updated 3 years ago
- Official codebase for the MLSys 2026 paper "IntAttention: A Fully Integer Attention Pipeline for Efficient Edge Inference". It enables hi…☆22May 29, 2026Updated 4 months ago
- Code for the paper "Multi-Field Adaptive Retrieval," a research project on a semi-structured document retrieval☆19Feb 13, 2026Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A simple library to color texts in terminal☆11Oct 11, 2020Updated 5 years ago
- From-scratch PyTorch replications of classic and SOTA AI/ML papers: transformers, attention, GANs, diffusion, CLIP, LoRA, MoE and more, w…☆428Updated this week
- Chrome extension that redacts potentially sensitive information before querying ChatGPT☆13Aug 10, 2023Updated 3 years ago
- Make your own typeface from your handwriting!☆16Sep 20, 2021Updated 5 years ago
- An example of load-balancing a gRPC service through Docker☆10Jun 11, 2026Updated 3 months ago
- ☆22May 28, 2024Updated 2 years ago
- a threadpool written in c prog.☆18Apr 29, 2026Updated 5 months ago