A hands-on Swift and Metal course for building LLM inference from first principles on Apple silicon, with 48 guided lessons, runnable exercises, a native macOS Studio, and a complete companion book.
☆194Jul 17, 2026Updated 3 months ago
Alternatives and similar repositories for inference-school
Users that are interested in inference-school are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Production LLM inference on the Apple Neural Engine — a practitioner's guide, complete with converters, Swift runtimes, and validated mod…☆47Jun 7, 2026Updated 4 months ago
- Transformer inference via unconventional compute: a single algebraic primitive, a tag-system scheduler, and Apple's Neural Engine through…☆24Apr 26, 2026Updated 6 months ago
- Train Large Language Models on MLX.☆468Updated this week
- ☆15Jun 13, 2025Updated last year
- A repo of useful MLX skills.☆90Jan 25, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Native SwiftUI trading charts for iOS: candles, indicators, crosshair, drawing tools and paged history, on Swift Charts.☆14Oct 7, 2026Updated last month
- ☆29Oct 31, 2026Updated last week
- This is a background service that automatically and transparently performs Wake-on-LAN and enhances the built-in sleep management system …☆66Updated this week
- The best benchmark for LLMs on Apple's MLX framework knowledge and coding tasks.☆38Jun 12, 2026Updated 4 months ago
- DS4F HTML Collection — a curated gallery of standalone HTML/CSS/JS experiments☆12Jul 29, 2026Updated 3 months ago
- Native Mac OS GUI for Using mlx-lm-lora.☆67Dec 19, 2025Updated 10 months ago
- Apple Silicon gputrace analysis tool☆25Sep 2, 2026Updated 2 months ago
- comments for game_server_introduction☆24May 29, 2026Updated 5 months ago
- RL-training an AI agent to RL-train AI agents.☆243Jul 14, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Model export recipes, Python primitives, and Swift runtime utilities for on-device AI☆2,261Updated this week
- reinvented groq LPU, built to run inference on MicroGPT☆51Aug 24, 2026Updated 2 months ago
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆17Oct 22, 2026Updated 2 weeks ago
- Hearth: household working memory on a ZECTRIX NOTE4☆47Sep 18, 2026Updated last month
- ☆39Aug 4, 2025Updated last year
- lithos-metal: high-performance LLM inference kernels and serving for Apple silicon.☆335Oct 21, 2026Updated 2 weeks ago
- Minimal Claude Code alternative powered by MLX☆47Jan 11, 2026Updated 9 months ago
- ☆34Feb 1, 2026Updated 9 months ago
- A GPT-2 inference engine written from scratch in CUDA and C++. Implements custom CUDA kernels for tiled matrix multiplication, LayerNorm,…☆44May 17, 2026Updated 5 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 1.0 Beta · oMLX 0.6.3rc2 Dual-ANE+CPU · Qwen3.8-27B abliterated oQ4e · Mac Studio M3 Ultra☆44Aug 23, 2026Updated 2 months ago
- ☆16Sep 17, 2026Updated last month
- A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.☆285Oct 27, 2026Updated last week
- Halofy is the open access and governance layer for AI agents across your organization. Identity, policy, provenance, audit, and signed er…☆319Updated this week
- Secure encrypted one-time secret sharing for clearnet and Tor onion services☆33Jun 15, 2026Updated 4 months ago
- Conformance and capability test suite for LLM inference engines — surface coverage, spec conformance, model capability, and an MTP/perfor…☆53Oct 18, 2026Updated 2 weeks ago
- See where local inference loses speed on Apple Silicon under Linux☆14Updated this week
- MCP server for treesitter☆20Jan 14, 2026Updated 9 months ago
- Low-level Metal inference engine for Apple M4: universal quant formats at MLX parity, 1M-token out-of-core contexts, and speculative deco…☆26Sep 5, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Self-hosted CI/CD deployment platform with persistent queue (BullMQ + Redis), encrypted env vars, multi-channel notifications (Discord/Sl…☆30Updated this week
- extract all your personal data history from cursor, codex, claude-code, windsurf, and trae☆1,352Oct 7, 2026Updated last month
- Agent Skill to help convert transformer LLMs to mlx-lm☆51Jun 16, 2026Updated 4 months ago
- Turn saved links into reusable skills for builders.☆18Jul 8, 2026Updated 3 months ago
- A Python interface for the Dawn WebGPU engine☆24Jan 10, 2026Updated 9 months ago
- ☆86Mar 3, 2026Updated 8 months ago
- Reverse engineering toolkit for Apple Silicon private APIs. 55+ Apple Intelligence models mapped, Metal 4 ML pipeline, 1009 IOReport chan…☆19Mar 26, 2026Updated 7 months ago