Frontier-class open models on a free Kaggle TPU v5e-8: GLM-5.3-Flash 320B MoE (~165 tok/s, our own JAX engine) and Qwen3.8-27B bf16 (~130 tok/s), 262k context, prefix caching. Works with Claude Code, Codex, opencode and pi.
☆703Oct 6, 2026Updated 2 weeks ago
Alternatives and similar repositories for kaggle-tpu-lab
Users that are interested in kaggle-tpu-lab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tile primitives for speedy kernels☆21Sep 13, 2026Updated last month
- Run MoE models bigger than your RAM, without the speed cliff☆17Oct 16, 2026Updated last week
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆30,418Updated this week
- GVS5H: Five Qwen3.8-27B Models Match Claude Fable 5 on LiveCodeBench Hard | Fable 5 Level Coding for a Fifth the Price - or on a Single…☆753Sep 23, 2026Updated last month
- FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.☆14,678Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Desktop workspace for Pi, OMP, and Prime Agent☆950Updated this week
- Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when …☆2,154Updated this week
- Best-of-N coding agents with LLM-as-a-Verifier selection for Oh My Pi: isolated git worktrees, verifier-ranked trajectories, winner-only …☆74Oct 1, 2026Updated 3 weeks ago
- An experimental and feature-rich inference engine built on top of llama.cpp☆81Updated this week
- Qwen3.8-27B on 16-32 GB Nvidia GPUs one-click install for Windows / Linux☆591Oct 9, 2026Updated 2 weeks ago
- Rust CLI powered by Jev from TypeSafe.ai that ranks agent skills for the next step using live session context. Includes Claude Code hooks…☆136Updated this week
- Real browser automation with local GLiNER2 inference and open weights. Work in progress. Contributions welcome.☆80Sep 18, 2026Updated last month
- Cross-platform local MCP capabilities for ChatGPT with Chrome integration, Goal, Compact & Resume, and durable multi-agent workflows.☆5,056Updated this week
- Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming opti…☆648Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Endless OMP chat with durable history and binary summary-tree memory, inspired by OptChat☆78Updated this week
- The $0 AI Empire Playbook — 180 scheduled jobs, 43 free LLM lanes, and the failure classes that almost killed it. Free tiers only.☆102Sep 22, 2026Updated last month
- The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; bench…☆87Updated this week
- Qwen 3.8 125B-A6B CUDA inference speedup benchmark: ds4 engine, overlay, and submission harness☆15Oct 10, 2026Updated last week
- Giant MoE models on a single consumer GPU by streaming experts from SSD. CUDA fork of antirez/ds4: runs GLM-5.2 (743B), Tencent Hy3 (295B…☆40Jul 12, 2026Updated 3 months ago
- One-menu RTX 5090 setup for non-Swift Huihui Qwen3.8-27B NVFP4 with Cinference, MTP-10 and K8V4.☆34Sep 22, 2026Updated last month
- Fastest and cheapest web agent☆23,205Sep 30, 2026Updated 3 weeks ago
- Semantic ifs from open models, on a 3090 at home. Independent; not affiliated with Jev or TypeSafe.☆4,876Sep 23, 2026Updated last month
- Open-source always on personal agent with its own computer. It remembers your work and keeps going while you're away. Works with any mode…☆19Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A self-improving RLM agent for coding workflows and long-running autonomous tasks.☆22,265Updated this week
- Pi compaction that reuses the server's prefix cache (vLLM / SGLang / llama.cpp Anthropic endpoints): no cold re-prefill, plus a warm-up s…☆20Oct 16, 2026Updated last week
- Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Wo…☆7,128Updated this week
- Local-first search across your workspace, built for humans and AI agents.☆4,144Updated this week
- Cross-platform desktop screen recorder + post-recording editor. Record (with system audio, mic, webcam), then re-frame: backgrounds, layo…☆36Oct 16, 2026Updated last week
- Async-first agent harness☆2,211Updated this week
- macOS coding-agent control center: one objective, routed to direct execution, a bounded loop, a swarm, or a dynamic DAG. Local only, no e…☆38Aug 6, 2026Updated 2 months ago
- Claude Code skill: let your agent drive fleets of local omp (oh-my-pi) model instances toward one goal — provider config, bounded turns, …☆15Aug 28, 2026Updated last month
- Bypass llm guardrails by confusing it with fabricated tool output.☆539Sep 1, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Reverse engineer anything with agents, from app behavior down to native binaries.☆366,239Updated this week
- Generalist Multitask Transformer Encoders☆135Updated this week
- Official implementation of iSDFT: information-proximal on-policy self-distillation for continual learning in LLMs. Training code, checkpo…☆27Sep 22, 2026Updated last month
- Jev-compatible API endpoint based on open models (prefill-only)☆334Oct 1, 2026Updated 3 weeks ago
- The ultimate harness for coding agents and beyond. All your agents. All your machines. One command center. Start with code, then follow y…☆1,340Updated this week
- OpenShell is the safe, private runtime for autonomous AI agents.☆16Apr 20, 2026Updated 6 months ago
- Local typed decisions, contrastive data curation, and model evaluation.☆2,242Oct 14, 2026Updated last week