peterc / infermlx

Dynamically controllable Llama-model LLM inference in macOS with MLX
16Updated last month

Alternatives and similar repositories for infermlx:

Users that are interested in infermlx are comparing it to the libraries listed below