peterc / infermlx

Dynamically controllable Llama-model LLM inference in macOS with MLX
17Updated 2 months ago

Alternatives and similar repositories for infermlx:

Users that are interested in infermlx are comparing it to the libraries listed below