psmarter / mini-inferLinks
A high-performance LLM inference engine with PagedAttention | 基于PagedAttention的高性能大模型推理引擎
☆34Updated last month
Alternatives and similar repositories for mini-infer
Users that are interested in mini-infer are comparing it to the libraries listed below
Sorting:
- 解构rocketmq☆40Updated last month
- ☆45Updated last month
- 心理健康倾诉管理系统☆51Updated last month
- An efficient and lightweight disk space analysis tool.☆89Updated 3 weeks ago
- devSphere-chat 是一个基于 Spring Boot 构建的高性能实时聊天系统，支持私聊、群聊、消息持久化、离线消息推送等功能。系统采用 Netty 实现 WebSocket 通信，通过 Redis Stream 保证消息可靠传输，并集成完善的用户认证和权限管理…☆114Updated last month
- A versatile WireGuard client for desktop, highly configurable, based on wg-easy.☆142Updated 2 months ago
- This repository contains experimental reports and training results for my research☆103Updated last month
- Ond ESG Intelligence Platform is a cloud-native solution that ingests ESG data, processes it with Azure Data Factory & Databricks, and ap…☆131Updated 2 months ago
- 这是一个后端基于Springboot、前端基于vue的小程序的单体外卖系统，是在黑马程序员的“苍穹外卖”基础上复现和改进☆38Updated last month
- Put some Christmas vibes to GitHub profile.☆61Updated last month
- 简小派求职方法论，正确找工作的方法☆120Updated 2 months ago
- GPU-Health-eXpert☆67Updated 3 months ago
- Desktop Pixel Pet（桌面像素宠物）是一个轻量、可扩展的桌面陪伴应用：在你的电脑桌面上展示可爱的像素宠物，让它在屏幕角落里待机、走动、互动，陪你工作与学习。项目内置宠物商城与解锁机制，支持使用运行时间作为货币购买/激活宠物与粮食，并提供本地数据导入/导出能力，…☆64Updated last month
- BizSpring Java微服务开源商城,电商平台,多用户商城,分布式商城,SpringCloud☆57Updated 2 months ago
- rule☆40Updated 2 months ago
- Marina to OceanBase is Geneva to LanceDB☆59Updated 3 weeks ago
- 🧊 A High-Perf Quantitative Trading Framework for Crypto☆134Updated last month
- A modern and efficient travel planning companion.☆50Updated last month
- cf worker reverse proxy☆39Updated 2 months ago
- 让 AI/团队可落地地开发“优秀前端动效”（UI 微交互、页面转场、滚动叙事、2D/SVG/3D、数据可视化动画）☆39Updated 2 weeks ago
- 🧩 An open-source multi-agent framework for intelligent health management, powered by the Linkage ecosystem.☆88Updated last month
- An Autonomous AI SRE Agent for Kubernetes, built with Java Spring Boot & LangChain4j. Implements OODA loop for self-healing.☆60Updated last month
- github工作流build n1 immortalwrt☆24Updated last week
- A fast, local-first web GUI for exploring large CSV/Parquet/JSONL files. Powered by VisiData’s engine. Opens millions of rows instantly. …☆52Updated 2 months ago
- A highly efficient, safe, and reliable service development platform that is highly scalable and easy to extend, with deep integration of …☆148Updated this week
- My GNU/Linux and MacOS dotfiles.☆30Updated last week
- ☆49Updated last month
- java微信商城小程序源码,BizSpring,微商城，微信小程序，小程序商城，微信小程序，商城小程序源码☆44Updated 2 months ago
- Langgraph V1 入门+进阶教程☆78Updated 3 weeks ago
- ☆58Updated last month