From-scratch multi-GPU LLM inference engine: paged KV cache, continuous batching, prefix caching, tensor parallelism, OpenAI-compatible server. Custom Triton kernels, vLLM-class throughput.
☆27Sep 25, 2026Updated 3 weeks ago
Alternatives and similar repositories for CoreLLM
Users that are interested in CoreLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆31Sep 16, 2023Updated 3 years ago
- FP8 quantization + vLLM serving of pipecat-ai/phonellm-alpha-1 on Modal☆17Aug 28, 2026Updated last month
- Ground Truth - A working developer's path into AI and machine learning.☆38Oct 10, 2026Updated last week
- thread-per-core layer cache implementation☆17Updated this week
- A from-scratch Rust inference stack for AMD GPUs that talks straight to the Linux kernel driver. No ROCm, HIP, or HSA runtime. Serves OLM…☆24Aug 15, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A custom-designed distributed blockchain for sharing service☆21Feb 11, 2026Updated 8 months ago
- This contains notes on various topics on software development☆13Oct 15, 2026Updated last week
- C++ CPP project templates with CMake + Conan☆16May 24, 2020Updated 6 years ago
- InfinyOn Labs projects☆14Dec 9, 2024Updated last year
- The Kimi K3 and DeepSeek-V4-Flash-0731 architectures, reimplemented from scratch in pure Rust (zero dependencies) and verified 1:1 agains…☆24Aug 19, 2026Updated 2 months ago
- Low latency lock free SPSC, SPMC, MPMC Queue and Stack. Fast SpinLock, SeqLock☆10Feb 5, 2024Updated 2 years ago
- Standalone GN with builtin configs.☆18Jan 22, 2025Updated last year
- ☆64Updated this week
- Documentation: https://rancher.github.io/cluster-api-addon-provider-fleet/ Cluster API Add-on Provider for Fleet will auto register child…☆13Oct 5, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A very simple key/value database engine written in Java☆10Jun 24, 2014Updated 12 years ago
- Property list parser in Rust☆17Aug 22, 2026Updated last month
- Extra event types built on top of rsevents☆17May 19, 2023Updated 3 years ago
- Small examples to explain Futures, Waker, Tasks in Rust☆64Dec 5, 2020Updated 5 years ago
- 15-721 Spring 2024 - Cache #1☆12May 2, 2024Updated 2 years ago
- Operational patterns for AI agents and infrastructure from solo to enterprise scale. Applies DevOps + SRE principles to the intersection:…☆35Jun 16, 2026Updated 4 months ago
- Rust implementation of Amino☆27Jun 23, 2020Updated 6 years ago
- Rust inference engine for a 28.9M-parameter PLE TinyLM on the ESP32-S3 — 9.4 tok/s, faster than the C implementation it was ported from☆47Aug 20, 2026Updated 2 months ago
- A daemon that synchronizes IRIS hub data into relational database for the Explorer backend☆15Aug 29, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆13Updated this week
- False LLM endpoints for testing☆14May 21, 2025Updated last year
- This is a collection of link prediction tutorials that I wrote. Some notebooks are accompanied by medium blogposts that you can find here…☆11Jan 16, 2021Updated 5 years ago
- Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞☆13Aug 28, 2026Updated last month
- ☆10Feb 27, 2024Updated 2 years ago
- A poptrie implementation☆23Apr 14, 2026Updated 6 months ago
- ☆26Dec 20, 2021Updated 4 years ago
- Andromeda is a 3D terrain and landscape editor and rendering engine☆18Apr 28, 2024Updated 2 years ago
- Your CNCF DevStats Card☆13Jun 11, 2026Updated 4 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A simple and powerful Rust remote method invocation library based on trait objects☆13Jan 6, 2021Updated 5 years ago
- Articles About Java☆15May 6, 2024Updated 2 years ago
- Client library for Cosmos-SDK/Tendermint☆17Nov 1, 2019Updated 6 years ago
- Distributed-AI-Systems☆68Oct 10, 2026Updated last week
- Fast bounded MPSC and MPMC channels built from one SPSC ring per producer☆35Oct 14, 2026Updated last week
- Ideas for P4 Projects.☆15Sep 18, 2024Updated 2 years ago
- Distributed key-value store.☆28May 24, 2021Updated 5 years ago