Optimized local serving engine for Kimi-Linear-48B: INT4 quantizer, fused decode kernels for a measured 3.18x, and an OpenAI-compatible server. Ships with k3, a bridge that detects the client per request so Claude Code, Codex, Cline, Aider and opencode all work unchanged.
☆45Sep 18, 2026Updated last month
Alternatives and similar repositories for local-kimi
Users that are interested in local-kimi are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GPU CI/CD tool that tests CUDA kernels across multiple GPUs in parallel - Part of RightNow☆15Jan 25, 2026Updated 9 months ago
- Claude Code for CUDA. Free AI assistant that actually understands GPU architecture☆110Oct 10, 2025Updated last year
- Open-source transpiler for CUDA Tile (13.1) migration☆19Dec 9, 2025Updated 11 months ago
- Dynamic weight generation for recursive transformers via input-conditioned LoRA modulation☆37Apr 2, 2026Updated 7 months ago
- The simplest way to deploy docker images (that runs web server)☆10Jan 16, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- AI-native markdown previewer with annotations, bookmarks, and live reload. Zero dependencies.☆11Sep 7, 2026Updated 2 months ago
- A Rust-native implementation of the RAG stack☆19Jan 25, 2026Updated 9 months ago
- ☆11Feb 22, 2025Updated last year
- Pure Triton kernels for Qwen3.5-27B inference on NVIDIA B200☆125Feb 28, 2026Updated 8 months ago
- Out-of-tree Linux thunderbolt_net driver (DKMS) tracking upstream, with a receive-side workaround for macOS Thunderbolt Bridge TCP aggreg…☆18Oct 18, 2026Updated 3 weeks ago
- generic async iter tools in python☆13Oct 4, 2025Updated last year
- Compute Where It Counts: Scaling both speed and quality with training compute☆13Sep 18, 2025Updated last year
- Full End-to-End examples showing how to use First-gen Gaudi and Gaudi2 in common use cases☆13Dec 2, 2024Updated last year
- A do-it-yourself low-cost arduino-based TMS (transcranial magnetic stimulation) device☆10Nov 29, 2018Updated 7 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A (nicer) tokenizer you want to use for model inference and training: with all known peventable gotchas normalized or auto-fixed.☆12Oct 16, 2026Updated 3 weeks ago
- UI Display Defects Mocker Tool☆10Jan 29, 2026Updated 9 months ago
- A High-performance Timing Analysis Tool for VLSI Systems☆10Feb 11, 2021Updated 5 years ago
- CLIP is an open source, multimodal computer vision model and it's awesome!☆17Dec 16, 2024Updated last year
- HW-aware training extension to AIHWKIT-Lightning for MoEs☆11Updated this week
- Diglett is a cron management system that manage all your cron jobs without modifying crontab. Handles locking, logging, error emails, and…☆13Jun 9, 2017Updated 9 years ago
- Code for ACL-IJCNLP 2021 paper "N-Best-ASR-Transformer: Enhancing SLU Performance using Multiple ASR Hypotheses."☆17Nov 30, 2021Updated 4 years ago
- Three MiniMax H3 ComfyUI workflows for 8GB laptop GPUs (20 / 8 / 4 steps). Includes the model list, launch flags, prompt-structure pitfal…☆22Oct 24, 2026Updated 2 weeks ago
- local distributed learning and inference☆14May 27, 2026Updated 5 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A simple Streamlit application to visualize document chunks and queries in embedding space 🗺️🔍☆14Apr 15, 2025Updated last year
- Intel's CPU-GPU-NPU monitoring solution including discrete GPU without dependencies on Linux & Windows☆12Aug 27, 2026Updated 2 months ago
- ☆11Jan 31, 2024Updated 2 years ago
- Vectorization of Verilog Designs☆14Jun 18, 2026Updated 4 months ago
- Mobile-MMLU: A Mobile Intelligence Language Understanding Benchmark. Paper at: https://arxiv.org/abs/2503.20786☆11Mar 27, 2025Updated last year
- PantheonSim: GPU simulator for CUDA and ROCm. Run CUDA and HIP programs unmodified on a CPU, no GPU needed: simulated NVIDIA and AMD GPUs…☆26Updated this week
- AnalogStudio is a comprehensive, professional-grade Electronic Design Automation (EDA) software suite developed by Algo Science Lab for d…☆21Jul 22, 2026Updated 3 months ago
- Stop AI Coding from forgetting. A knowledge graph–driven memory layer for LLMs (ChatGPT, Claude, Codex, DeepSeek, Gemini), enabling pers…☆21Jun 12, 2026Updated 4 months ago
- Provides feeds (articles, publications, posts) from various sources eg. RSS, Facebook, other social media☆14May 24, 2019Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- OpenWrt Multi WAN Port Policy Routing Tool（OpenWrt固件多WAN口策略路由分流工具）☆12Jul 26, 2024Updated 2 years ago
- Get started with LLM post-training on Modal.☆70Updated this week
- CrateBytes is an open-source backend solution for games, offering a seamless, self-hosted alternative to AccelByte and other platforms.☆13Jan 22, 2025Updated last year
- Iterate fast on your RAG pipelines☆24Jun 21, 2025Updated last year
- ☆20Sep 19, 2026Updated last month
- Workflow to upload APK and IPA to TestApp.io app distribution☆18Dec 22, 2022Updated 3 years ago
- the agi compiler: records llm agent behavior, proves what repeats, and compiles it into verified, sandboxed wasm binaries that run for mi…☆131Jul 7, 2026Updated 4 months ago
Are these results useful?