dusty-nv / NanoLLMLinks

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.
309Updated 10 months ago

Alternatives and similar repositories for NanoLLM

Users that are interested in NanoLLM are comparing it to the libraries listed below

Sorting: