eqimp / hogwild_llmView on GitHub
Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache
138Aug 13, 2025Updated 7 months ago

Alternatives and similar repositories for hogwild_llm

Users that are interested in hogwild_llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?