LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
☆5,773Jul 3, 2026Updated this week
Alternatives and similar repositories for LiteRT-LM
Users that are interested in LiteRT-LM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via e…☆2,621Updated this week
- A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.☆23,998Updated this week
- Let's use Qualcomm NPU in Android☆20Feb 18, 2025Updated last year
- Support PyTorch model conversion with LiteRT.☆1,050Jul 2, 2026Updated last week
- Official inference framework for 1-bit LLMs☆39,594Mar 10, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- AI Edge Quantizer: flexible post training quantization for LiteRT models.☆172Jun 27, 2026Updated last week
- On-device AI across mobile, embedded and edge for PyTorch☆4,787Updated this week
- LLM inference in C/C++☆119,421Updated this week
- Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.☆67,875Updated this week
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆50,496Jul 1, 2026Updated last week
- Open-source infrastructure for Computer-Use Agents. Sandboxes, SDKs, and benchmarks to train and evaluate AI agents that can control full…☆19,343Jul 1, 2026Updated last week
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆5,101Jun 30, 2026Updated last week
- Universal LLM Deployment Engine with ML Compilation☆22,901Jun 30, 2026Updated last week
- lightweight, standalone C++ inference engine for Google's Gemma models.☆6,974Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆354Jun 25, 2026Updated 2 weeks ago
- Open-Source Frontier Voice AI☆49,759May 6, 2026Updated 2 months ago
- llama.cpp fork with additional SOTA quants and improved performance☆2,846Updated this week
- Python tool for converting files and office documents to Markdown.☆162,998Jun 24, 2026Updated 2 weeks ago
- PersonaPlex code.☆10,139Mar 2, 2026Updated 4 months ago
- Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆175,352Updated this week
- MCP Toolbox for Databases is an open source MCP server for databases.☆15,845Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆84,877Jun 30, 2026Updated last week
- the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, history of ggml-hexagon…☆45Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, s…☆75,669Jul 1, 2026Updated last week
- Examples and guides for using the Gemini API☆17,496Updated this week
- A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speec…☆7,480Updated this week
- The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU cluste…☆5,113Updated this week
- Network for procedural editing of text with LLMs☆23Apr 28, 2026Updated 2 months ago
- Run frontier AI locally.☆45,964Jun 23, 2026Updated 2 weeks ago
- Lightweight coding agent that runs in your terminal☆94,569Jun 30, 2026Updated last week
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆52,474Updated this week
- Tensor library for machine learning☆14,935Jun 26, 2026Updated last week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Port of OpenAI's Whisper model in C/C++☆51,240Jul 1, 2026Updated last week
- A simple screen parsing tool towards pure vision based GUI agent☆24,981Apr 13, 2026Updated 2 months ago
- LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.☆47,236Jun 30, 2026Updated last week
- 🌐 Make websites accessible for AI agents. Automate tasks online with ease.☆101,585Jun 29, 2026Updated last week
- Cognee is the open-source AI memory platform for agents. Give your AI agents persistent long-term memory across sessions with a self-host…☆27,287Updated this week
- Universal memory layer for AI Agents☆59,728Jun 30, 2026Updated last week
- Run LLMs with MLX☆6,181Jun 24, 2026Updated 2 weeks ago