HFAiLab / hai-platform-studio
配合 HAI Platform 使用的集成化用户界面
☆35Updated last year
Alternatives and similar repositories for hai-platform-studio:
Users that are interested in hai-platform-studio are comparing it to the libraries listed below
- ☆23Updated last year
- ☆107Updated 10 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Updated 8 months ago
- alibabacloud-aiacc-demo☆42Updated last year
- Transformer related optimization, including BERT, GPT☆39Updated 2 years ago
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆44Updated last year
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆35Updated 3 months ago
- llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…☆79Updated 9 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆231Updated last week
- GPT+神器，简单实用的一站式AGI架构，内置本地化，LLM模型，agent，矢量数据库，智能链chain☆48Updated last year
- Transformer related optimization, including BERT, GPT☆17Updated last year
- run ChatGLM2-6B in BM1684X☆49Updated 11 months ago
- 一种任务级GPU算力分时调度的高性能深度学习训练平台☆491Updated last year
- 纯c++的全平台llm加速库，支持python调用，支持baichuan, glm, llama, moss基座，手机端流畅运行chatglm-6B级模型单卡可达10000+token / s，☆45Updated last year
- 大模型部署实战：TensorRT-LLM, Triton Inference Server, vLLM☆26Updated 11 months ago
- OpenAIOS is an incubating open-source distributed OS kernel based on Kubernetes for AI workloads. OpenAIOS-Platform is an AI development…☆95Updated 3 years ago
- ☆127Updated last month
- A CLI for Kubeflow.☆59Updated last year
- ☆35Updated 3 years ago
- ☆76Updated last year
- Compare different hardware platforms via the Roofline Model for LLM inference tasks.☆93Updated 11 months ago
- A more efficient GLM implementation!☆55Updated 2 years ago
- AGM阿格姆：AI基因图谱模型，从token-weight权重微粒角度，探索AI模型，GPT\LLM大模型的内在运作机制。☆28Updated last year
- AGI模块库架构图☆75Updated last year
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆266Updated last year
- Its an open source LLM based on MOE Structure.☆58Updated 7 months ago
- TianMu: A modern AI tool with multi-platform support, markdown support, multimodal, continuous conversation, and customizable commands. 一…☆83Updated last year
- zero零训练llm调参☆31Updated last year
- ☆18Updated 9 months ago