eqimp / hogwild_llmLinks

Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache
105Updated last month

Alternatives and similar repositories for hogwild_llm

Users that are interested in hogwild_llm are comparing it to the libraries listed below

Sorting: