HFAiLab / hai-platform-studioLinks
配合 HAI Platform 使用的集成化用户界面
☆53Updated 2 years ago
Alternatives and similar repositories for hai-platform-studio
Users that are interested in hai-platform-studio are comparing it to the libraries listed below
Sorting:
- 一种任务级GPU算力分时调度的高性能深度学习训练平台☆718Updated 2 years ago
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆89Updated last year
- ☆113Updated last year
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆270Updated 4 months ago
- OpenAIOS is an incubating open-source distributed OS kernel based on Kubernetes for AI workloads. OpenAIOS-Platform is an AI development…☆98Updated 4 years ago
- ☆123Updated 9 months ago
- ☆35Updated 4 years ago
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆132Updated 3 weeks ago
- A CLI for Kubeflow.☆60Updated last year
- ElasticCTR,即飞桨弹性计算推荐系统,是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务,帮助用户在Kubernetes环境中一键完成推荐系统部…☆187Updated 5 years ago
- 纯c++的全平台llm加速库,支持python调用,支持baichuan, glm, llama, moss基座,手机端流畅运行chatglm-6B级模型单卡可达10000+token / s,☆45Updated 2 years ago
- Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).☆250Updated last year
- ☆180Updated last week
- Easy, fast, and cheap pretrain,finetune, serving for everyone☆316Updated 4 months ago
- ☆219Updated 2 years ago
- ☆66Updated last week
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆271Updated 2 years ago
- LLM Inference benchmark☆431Updated last year
- Transformer related optimization, including BERT, GPT☆39Updated 2 years ago
- ☆79Updated last year
- Cloud Native Machine Learning Model Registry☆82Updated 2 years ago
- 让算法工程化更简单☆95Updated 8 months ago
- ☆276Updated 2 years ago
- ☆25Updated 2 years ago
- 官方transformers源码解析。AI大模型时代,pytorch、transformer是新操作系统,其他都是运行 在其上面的软件。☆17Updated 2 years ago
- kubeflow国内一键安装文件☆351Updated 3 years ago
- ☆70Updated 8 months ago
- Transformer related optimization, including BERT, GPT☆17Updated 2 years ago
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆61Updated last year
- LLM 推理服务性能测试☆44Updated last year