An educational distributed training and inference library for neural nets using local computing
☆84Jun 10, 2026Updated 3 months ago
Alternatives and similar repositories for smolcluster
Users that are interested in smolcluster are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- documenting my work in inference engineering☆25Apr 19, 2026Updated 5 months ago
- ☆13Jun 29, 2024Updated 2 years ago
- a minimal paged attention implementation☆21Jan 30, 2026Updated 7 months ago
- A GPT-2 inference engine written from scratch in CUDA and C++. Implements custom CUDA kernels for tiled matrix multiplication, LayerNorm,…☆44May 17, 2026Updated 4 months ago
- ☆17May 6, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A visual representation of Dijkstra's Algorithm using Libgdx.☆16Dec 24, 2021Updated 4 years ago
- hardware accelerator for deep convolutional neural networks☆74Feb 25, 2026Updated 6 months ago
- Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.☆19Feb 9, 2026Updated 7 months ago
- JAX implementation of configurable LLM distillation training☆24Nov 15, 2025Updated 10 months ago
- Basically a repo containing architectures/algorithms/papers from scratch in pytorch☆30Feb 11, 2026Updated 7 months ago
- ☆15Feb 5, 2025Updated last year
- Clean, reusable paper implementations for trending papers on alphaXiv☆212Jul 21, 2026Updated 2 months ago
- Compact, local-first neuro-symbolic assistant in Rust with a 200 MiB Bitwork cognitive model, exact reasoning tools, governed memory, and…☆43Aug 21, 2026Updated last month
- Seamless Voice Interactions with LLMs☆12Oct 28, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Implementations of Papers that I read, you can read my breakdown in my blog☆90Oct 23, 2025Updated 11 months ago
- Curated List of NLP tutorials☆30Feb 27, 2025Updated last year
- A simple but instructive implementation of DP, TP, FSDP, FSDP+TP using pytorch distributed primitives☆24Apr 12, 2026Updated 5 months ago
- Flash Attention from scratch, tiled CUDA forward kernel, online softmax with running max and correction factor, recomputation trick in ba…☆19Mar 6, 2026Updated 6 months ago
- a LLM inference engine to run on consumer hardware☆48Apr 15, 2026Updated 5 months ago
- Convenient access to `pynvml` (the library behind `nvidia-smi`)☆23Oct 18, 2024Updated last year
- Lab Cookbook☆42Aug 5, 2026Updated last month
- Production-ready ternary quantized (1.58-bit) Rust code generation model with mHC-lite, MaxRL training, and comprehensive benchmarking☆22Aug 2, 2026Updated last month
- Cuda implemenation of flash-kmeans, 2x faster☆23May 8, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- a personal collection of my notes for ml sys☆124Sep 1, 2026Updated 3 weeks ago
- An agent harness that compiles a model into one provably-correct, self-retargeting CUDA megakernel and self-tunes it past cuBLAS at batch…☆142Sep 18, 2026Updated last week
- My submission for the GPUMODE/AMD fp8 mm challenge☆29Jun 4, 2025Updated last year
- High-performance GPU kernels for LLM inference in OpenAI Triton. Fused RMSNorm, SwiGLU, INT8 GEMM with benchmarks and roofline analysis.☆43Jul 22, 2026Updated 2 months ago
- Chatbot for The Algorithm ML repo by Twitter.☆13Apr 3, 2023Updated 3 years ago
- False LLM endpoints for testing☆14May 21, 2025Updated last year
- Hacks for working with drake in ROS 2, inspired by https://github.com/EricCousineau-TRI/repro/tree/master/ros/drake_ros1_hacks - Most of …☆15Sep 8, 2021Updated 5 years ago
- Embedding and readout for simple multi-categorical and gaussian continuous☆20Jul 5, 2026Updated 2 months ago
- The best ChatGPT that $100 can buy.☆58Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Notes and code for Programming Massively Parallel Processors☆13Mar 29, 2025Updated last year
- Source code for XTRIDE: "Practical Type Inference: High-Throughput Recovery of Real-World Structures and Function Signatures"☆26Jun 24, 2026Updated 3 months ago
- 🌱 A little course on Reinforcement Learning Environments for evaluating and training Language Models☆226May 27, 2026Updated 3 months ago
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆53Aug 18, 2024Updated 2 years ago
- ☆14Jan 22, 2026Updated 8 months ago
- A simple library for generating instruction tuning datasets locally☆112Updated this week
- A PyTorch implementation of the GPT-OSS-20B architecture. All components are coded from scratch: RoPE with YaRN, RMSNorm, SwiGLU with cla…☆237Dec 2, 2025Updated 9 months ago