基于Rust的大模型推理框架
☆14Oct 21, 2026Updated 2 weeks ago
Alternatives and similar repositories for RustInfer
Users that are interested in RustInfer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 目标是在自制虚拟 GPU 上运行 Qwen2-0.5B INT8 推理。核心痛点是从零实现一个类 CUDA 的执行环境——包括 RISC-V SIMT 解释器、PCI 驱动、用户态运行时库和算子库，全部从无到有手写。☆19May 31, 2026Updated 5 months ago
- A minimal, educational implementation of Flash Attention v2 in CUDA☆14Feb 25, 2026Updated 8 months ago
- Description: Experimental nano-vLLM fork for Qwen3.6 support, CUDA Graph, paged KV cache, and inference-engine learning.☆20Oct 15, 2026Updated 3 weeks ago
- A case study of quantitative modeling for beginners.☆26Jan 26, 2026Updated 9 months ago
- Realtime video processing w/ Gaussian + Sobel Filters targeting Artix-7 FPGA☆44Nov 8, 2021Updated 4 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- RedisMQDemo☆10Jun 13, 2019Updated 7 years ago
- ☆10Aug 10, 2015Updated 11 years ago
- 黑客马拉松项目——眼缘☆12Feb 1, 2015Updated 11 years ago
- Samples on how to use filters to authenticate ASP .Net Web Api 2☆10Oct 4, 2016Updated 10 years ago
- OoderAgent 是一个基于 MIT 协议的开源企业级 AI 能力分发与自动化协作框架，采用 P2P 网络架构，支持多 Agent 协作、Skill 模块化能力封装和场景化编排，旨在实现去中心化的分布式 AI 协同与自动化流程管理。其核心优势在于自主协作、动态扩展与精准…☆15Apr 11, 2026Updated 6 months ago
- 开源网址导航☆13Apr 15, 2021Updated 5 years ago
- 基于.net core2.1 搭建的框架的中小型项目框架,sql server数据库,同时支持,mysql数据库,,,需要自己稍微扩展下,,,可以擦模考sql server的实现 迁移文件已经生成,可以直接运行即可跑起来. 结合docker发布可以参考这里: https…☆13Dec 4, 2018Updated 7 years ago
- --开源项目--汽车4S店管理汽车美容快修专业的saas--☆13Apr 19, 2022Updated 4 years ago
- beellama.cpp fork with CMP 90HX (GA102, sm_86) optimizations: DP4A→IMAD, FP32→HFMA2 — +58-87% decode speed☆13Sep 3, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- CSS3与页面布局学习总结（一）——概要、选择器、特殊性与刻度单位☆14Nov 24, 2016Updated 9 years ago
- UU远程硬件解码解锁补丁，在非 NVIDIA / AMD / Intel GPU 的机器上启用硬件解码☆16Updated this week
- AI桌面宠物☆12Aug 1, 2025Updated last year
- ASP.NET Core WebApi EntityFrameworkCore 连接mysql 、sqlserver的样例工程☆10Jan 4, 2017Updated 9 years ago
- .NET 跨平台微服务架构解决方案☆16Oct 23, 2026Updated 2 weeks ago
- ASP.NET Core On K8S系列文章示例代码☆11May 9, 2020Updated 6 years ago
- 每周AI资讯、工具推荐☆12Updated this week
- 本地优先的中文语音 AI 管家——说一句话，它替你操作 Windows（GLM-5.2 Agent + 本地 Whisper + GUI 自动化）☆14Aug 17, 2026Updated 2 months ago
- Back-End desenvolvido com C# utilizando .NET Core + ASP.NET Core WebApi + DDD (Domain Drive Design) + SOLID + CQRS + Design Patterns☆13Sep 6, 2018Updated 8 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 微信收藏链接批量导出工具 - 自动从 Windows 微信收藏夹中逐条导出所有链接☆14Apr 17, 2026Updated 6 months ago
- efcore 代码生成器(含mysql和sql server）☆10Jun 10, 2018Updated 8 years ago
- ☆13Mar 9, 2025Updated last year
- Open-source agent harness for DeepSeek V4☆15Aug 1, 2026Updated 3 months ago
- Windows Codex Desktop zh-CN portable menu patcher☆17May 5, 2026Updated 6 months ago
- AI Coding 中转站 — 支持 Claude、Codex、Gemini 模型在多种平台使用☆13Jun 12, 2026Updated 4 months ago
- 使用Swagger 搭建 WebApi文档项目☆10Aug 19, 2018Updated 8 years ago
- 让零基础小白也能一键安装运行 OpenClaw AI 编程助手，无需配置环境、无需命令行 | Tauri + React + Rust☆19Apr 10, 2026Updated 6 months ago
- LoTCode => LoTBlog + LoTBBS + LoTShop + PawChina ......☆10Jan 25, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- AutoMapper website☆14Aug 19, 2020Updated 6 years ago
- ☆13Mar 16, 2026Updated 7 months ago
- Source to create applications from websites☆12Jun 14, 2023Updated 3 years ago
- 一套让 AI 做的动效视频更好看的规则，加上一套能直接跑的代码引擎。AI 写代码，逐帧画出画面、合成配乐，输出 30–60 秒的动效短片。有口播、无口播都可以。默认竖版 9:16（1080×1920），也可以横版 16:9（1920×1080）。☆18Oct 8, 2026Updated 3 weeks ago
- Anno 分布式 开发框架 Demo RPC Thrift GRPC 插件开发 java Anno☆10Jul 31, 2020Updated 6 years ago
- Demo of enabling SwaggerUI with an ASP.Net Core WebApi connected with Identity Server☆10Oct 19, 2018Updated 8 years ago
- Fuploader - 一键将视频分发到多个主流平台的自动化工具。支持多账号管理、批量上传、定时发布，基于Go+Wails构建的跨平台桌面应用☆17Feb 13, 2026Updated 8 months ago