alicankiraz1 / Gemma-4-31B-MTP-vLLM-ServerView on GitHub
A production-minded FastAPI sidecar for serving Gemma 4 31B on vLLM with Gemma 4 Multi-Token Prediction (MTP) speculative decoding.
59Jun 25, 2026Updated 2 weeks ago

Alternatives and similar repositories for Gemma-4-31B-MTP-vLLM-Server

Users that are interested in Gemma-4-31B-MTP-vLLM-Server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?