dusty-nv / NanoLLMLinks

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.
327Updated last year

Alternatives and similar repositories for NanoLLM

Users that are interested in NanoLLM are comparing it to the libraries listed below

Sorting: