Educational distributed training and inference library for heterogeneous local hardware: Mac minis, Raspberry Pis and GPUs over plain Python sockets. FSDP, GRPO, parameter-server, expert and data parallelism.
☆90Oct 7, 2026Updated 3 weeks ago
Alternatives and similar repositories for smolcluster
Users that are interested in smolcluster are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- documenting my work in inference engineering☆25Apr 19, 2026Updated 6 months ago
- A collection of my from-scratch implementation of various models deployed on HF Spaces☆14Oct 14, 2025Updated last year
- Claude Code ZeroClaw Pro 2026: AI Multitool & CLI Router for Claude SDK Subagents☆52Oct 21, 2026Updated 2 weeks ago
- From-scratch PyTorch replications of classic and SOTA AI/ML papers: transformers, attention, GANs, diffusion, CLIP, LoRA, MoE and more, w…☆429Oct 7, 2026Updated 3 weeks ago
- a minimal paged attention implementation☆20Jan 30, 2026Updated 9 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Basically a repo containing architectures/algorithms/papers from scratch in pytorch☆30Feb 11, 2026Updated 8 months ago
- Plug-and-play PyTorch transformer research framework. Swap attention, FFN, norm, positional, connection, projection, optimizer, scheduler…☆18Oct 25, 2026Updated last week
- a LLM inference engine to run on consumer hardware☆49Apr 15, 2026Updated 6 months ago
- Deployment & experimentation of LLM inference at production scale (P/D disaggregation, KV offloading, parallelism, and autoscaling).☆64Sep 26, 2026Updated last month
- LLM inference in C, compiled per model and per chip. Up to 14x faster.☆28Sep 7, 2026Updated last month
- Research MIL-to-HWX compiler for the M4 Apple Neural Engine☆17Sep 3, 2026Updated 2 months ago
- Hugging Face's take home challenge for post-training internships, now open for you to try!☆53Apr 23, 2026Updated 6 months ago
- So, I trained a Llama a 130M architecture I coded from ground up to build a small instruct model from scratch. Trained on FineWeb dataset…☆17Mar 26, 2025Updated last year
- ☆17May 6, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Optimizing diffusion for production-ready speeds☆41Jan 10, 2026Updated 9 months ago
- ☆45May 4, 2025Updated last year
- Readable single-file PyTorch implementations of deep RL algorithms☆235Updated this week
- A Pure JAX AsyncRL stack☆23Sep 7, 2026Updated last month
- NVFP4 KV cache for vLLM on SM120 (RTX PRO 6000) via FlashInfer FA2 explicit-SF-stride patch — ~1.5x fp8 pool at ~95-104% speed☆20Jun 5, 2026Updated 4 months ago
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆11Oct 13, 2026Updated 3 weeks ago
- a personal collection of my notes for ml sys☆127Oct 26, 2026Updated last week
- Serving DeepSeek-V4-Flash-0731-NVFP4 on 2x RTX PRO 6000 Blackwell (sm_120): vLLM patches, tuned configs, serve scripts, benchmarks☆15Aug 25, 2026Updated 2 months ago
- Row-wise block scaling for fp8 quantization matrix multiplication. Solution to GPU mode AMD challenge.☆19Feb 9, 2026Updated 8 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- cpu inference for ternary neural nets. no deps. just c++ and simd.☆23Oct 18, 2026Updated 2 weeks ago
- ☆15Mar 11, 2026Updated 7 months ago
- serving a torch model using Celery, Redis and RabbitMQ to serve users asynchronously☆25Jan 21, 2024Updated 2 years ago
- Seamless Voice Interactions with LLMs☆12Oct 28, 2023Updated 3 years ago
- B200 Attention from Scratch: understand one of the hardest GPU kernels on the latest hardware☆100Oct 9, 2026Updated 3 weeks ago
- LM/VLM implementations☆12Oct 13, 2026Updated 3 weeks ago
- JAX implementation of configurable LLM distillation training☆24Nov 15, 2025Updated 11 months ago
- Train an LLM to play Mafia via GRPO☆28Apr 18, 2026Updated 6 months ago
- Implementations of Papers that I read, you can read my breakdown in my blog☆90Oct 23, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A minimal, hackable coding agent harness in Rust☆14Apr 24, 2026Updated 6 months ago
- Curated List of NLP tutorials☆30Feb 27, 2025Updated last year
- Clean, reusable paper implementations for trending papers on alphaXiv☆212Jul 21, 2026Updated 3 months ago
- ☆14Jan 13, 2026Updated 9 months ago
- ☆16Jun 28, 2026Updated 4 months ago
- ☆24Apr 21, 2026Updated 6 months ago