zh-nj / lmdeploy-v100View on GitHub
This project is specifically developed for V100, based on lmdeploy 0.12.1, and supports mainstream open-source models from Q4 2025 to Q1 2026. It does not account for compatibility with other architectures and has only been tested on an 8-card V100 32GB setup.
21Mar 18, 2026Updated 3 months ago

Alternatives and similar repositories for lmdeploy-v100

Users that are interested in lmdeploy-v100 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?