本仓库整理了在 HCU 硬件上部署、调优和运行 AI 模型的经验与最佳实践
☆80Oct 23, 2026Updated this week
Alternatives and similar repositories for inference-cookbook-das
Users that are interested in inference-cookbook-das are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 基于 sgl-project/sglang 上游社区版本建设的 das 下游适配仓库，面向 hcu 平台进行功能适配与优化。☆47Updated this week
- 国产加速卡-海光DCU实战（大模型训练、微调、推理 等）☆115Aug 10, 2025Updated last year
- ☆18Jul 18, 2026Updated 3 months ago
- C++ MTCNN inferencing with only OpenCV☆18May 9, 2020Updated 6 years ago
- ☆26Oct 9, 2026Updated 2 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆19May 11, 2024Updated 2 years ago
- DNS-based Load Balancer for applications running on Kubernetes clusters☆14May 31, 2024Updated 2 years ago
- A small repository demonstrating the use of Webdataset and Imagenet☆17Dec 19, 2023Updated 2 years ago
- ☆19May 9, 2025Updated last year
- 27B at 256k context on one RTX 5090 — FP6 + 4-bit KV + MTP spec-decode, hand-written SM120 tensor-core kernels, OpenAI API.☆18Aug 18, 2026Updated 2 months ago
- This repository contains a Python implementation that allows you to use gorilla-llm/gorilla-openfunctions-v2 LLM to perform function call…☆17Apr 7, 2024Updated 2 years ago
- codemod cli for react-router-dom v6 direct upgrade, not progressive ⚒️☆13Aug 10, 2023Updated 3 years ago
- SciLifeLab Serve is a platform offering machine learning model serving, data science app hosting (Shiny, Gradio, Streamlit, Dash, etc.), …☆16Updated this week
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Follow nginx log, and find out bad guys!☆24May 10, 2026Updated 5 months ago
- ☆15Dec 24, 2025Updated 9 months ago
- ROCm CLI is a command-line tool for setting up and running local AI on AMD GPUs, with a full-screen TUI dashboard for GPU telemetry, mode…☆48Updated this week
- ☆46Aug 3, 2026Updated 2 months ago
- ☆21Apr 8, 2024Updated 2 years ago
- ☆97Sep 15, 2025Updated last year
- Port of Andrej Karpathy's minbpe to Rust☆32May 6, 2024Updated 2 years ago
- python-to-triton-llm☆10Aug 25, 2025Updated last year
- A lightweight CuTe-based CUDA kernel for DuoAttention, optimized for large language model inference.☆12Dec 25, 2025Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Ahead of Time (AOT) Triton Math Library☆102Oct 16, 2026Updated last week
- BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions☆26Aug 8, 2024Updated 2 years ago
- [IEEE RA-L'26] LeCropFollow: Latent Space Planning for Navigation in Unstructured Crop Fields☆15Oct 15, 2026Updated last week
- Directed masked autoencoders☆14Mar 25, 2026Updated 6 months ago
- Xkernel: Principled Performance Tunability of Operating System Kernels.☆29Aug 3, 2026Updated 2 months ago
- Cookbook of SGLang - Recipe☆10May 5, 2026Updated 5 months ago
- This repository provides the code for applying Contrastive Learning Penalty Loss (CLPL) and Mixture of Experts (MoE) to the BGE-M3 text e…☆11Dec 27, 2024Updated last year
- 使用 cutlass 实现 flash-attention 精简版，具有教学意义☆59Aug 12, 2024Updated 2 years ago
- ☆15Oct 2, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 这是一个从零学习CUDA课程☆13Nov 3, 2024Updated last year
- Matrix multiplication on GPUs for matrices stored on a CPU. Similar to cublasXt, but ported to both NVIDIA and AMD GPUs.☆33Apr 2, 2025Updated last year
- Collection of scripts used for BlueField SoC system management.☆31Oct 5, 2026Updated 2 weeks ago
- ☆174Mar 5, 2026Updated 7 months ago
- A set of common libraries for writing KubeVela ecosystem controllers.☆12Updated this week
- Docker GPU 算力资源管理平台☆16Sep 28, 2026Updated 3 weeks ago
- Zig library for parsing/editing various config files☆12Oct 15, 2026Updated last week