Alternatives and similar repositories for LiteRT-LM

Users that are interested in LiteRT-LM are comparing it to the libraries listed below

• google-ai-edge / ai-edge-apis
  ☆170Updated last week
• huawei-csl / SINQ
  Welcome to the official repository of SINQ! A novel, fast and high-quality quantization method designed to make any Large Language Model …
  ☆587Updated 3 weeks ago
• NVlabs / Jet-Nemotron
  ☆720Updated last month
• ngxson / wllama
  WebAssembly binding for llama.cpp - Enabling on-browser LLM inference
  ☆977Updated last month
• Chen-zexi / vllm-cli
  A command-line interface tool for serving LLM using vLLM.
  ☆461Updated last month
• leoheuler / flashtensors
  ☆431Updated last month
• Liquid4All / cookbook
  Examples, end-2-end tutorials and apps built using Liquid AI Foundational Models (LFM) and the LEAP SDK
  ☆855Updated this week
• intel / auto-round
  🎯An accuracy-first, highly efficient quantization toolkit for LLMs, designed to minimize quality degradation across Weight-Only Quantiza…
  ☆806Updated last week
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆276Updated this week
• huggingface / huggingface-gemma-recipes
  Inference, Fine Tuning and many more recipes with Gemma family of models
  ☆277Updated 6 months ago
• freddyaboulton / orpheus-cpp
  Fast Streaming TTS with Orpheus + WebRTC (with FastRTC)
  ☆347Updated 9 months ago
• Liquid4All / liquid-audio
  Liquid Audio - Speech-to-Speech audio models by Liquid AI
  ☆356Updated last week
• micytao / vllm-playground
  A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes…
  ☆331Updated this week
• facebookresearch / omnilingual-asr
  Omnilingual ASR Open-Source Multilingual SpeechRecognition for 1600+ Languages
  ☆2,572Updated 2 weeks ago
• ibm-granite / granite-4.0-language-models
  ☆159Updated last month
• stevelaskaridis / awesome-mobile-llm
  Awesome Mobile LLMs
  ☆290Updated last month
• pipecat-ai / nemotron-january-2026
  ☆461Updated last week
• vllm-project / vllm-metal
  Community maintained hardware plugin for vLLM on Apple Silicon
  ☆260Updated this week
• WeiboAI / VibeThinker
  Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model Reasoning Ability in VibeThinker-1.5B
  ☆560Updated last month
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆240Updated last week
• Mega4alik / ollm
  ☆2,256Updated last month
• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆224Updated 7 months ago
• mozilla-ai / agent.cpp
  Building blocks for agents in C++
  ☆131Updated this week
• NVlabs / UniversalDeepResearch
  Code to accompany the Universal Deep Research paper (https://arxiv.org/abs/2509.00244)
  ☆459Updated 4 months ago
• MetaStone-AI / XBai-o4
  ☆301Updated 5 months ago
• sofdog-gh / realtime-transcription-fastrtc
  Real Time Speech Transcription with FastRTC ⚡️and Local Whisper 🤗
  ☆694Updated 6 months ago
• NimbleEdge / sparse_transformers
  Sparse Inferencing for transformer based LLMs
  ☆217Updated 5 months ago
• huggingface / screenenv
  A powerful Python library for creating and managing isolated desktop environments using Docker containers.
  ☆443Updated 4 months ago
• lemonade-sdk / lemonade
  Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https…
  ☆2,008Updated this week
• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆414Updated this week