alibaba / rtp-llmLinks
RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
☆892Updated this week
Alternatives and similar repositories for rtp-llm
Users that are interested in rtp-llm are comparing it to the libraries listed below
Sorting:
- ☆507Updated last month
- FlagScale is a large model toolkit based on open-sourced projects.☆362Updated this week
- GLake: optimizing GPU memory management and IO transmission.☆481Updated 6 months ago
- Disaggregated serving system for Large Language Models (LLMs).☆706Updated 6 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …