google-ai-edge / LiteRT
LiteRT is the new name for TensorFlow Lite (TFLite). While the name is new, it's still the same trusted, high-performance runtime for on-device AI, now with an expanded vision.
☆313Updated this week
Alternatives and similar repositories for LiteRT:
Users that are interested in LiteRT are comparing it to the libraries listed below
- Supporting PyTorch models with the Google AI Edge TFLite runtime.☆502Updated this week
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆368Updated this week
- TFLite Support is a toolkit that helps users to develop ML and deploy TFLite models onto mobile / ioT devices.☆393Updated last week
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆262Updated 11 months ago
- The Qualcomm® AI Hub Models are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.)…☆639Updated this week
- Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…☆373Updated last week
- ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.☆325Updated this week
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆164Updated last week
- Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…☆767Updated this week
- Conversion of PyTorch Models into TFLite☆370Updated last year
- Common utilities for ONNX converters☆259Updated 3 months ago
- High-efficiency floating-point neural network inference operators for mobile, server, and Web☆1,985Updated this week
- ☆309Updated 3 months ago
- AI Edge Quantizer: flexible post training quantization for LiteRT models.☆27Updated this week
- ☆128Updated 2 weeks ago
- ONNX Optimizer☆681Updated last week
- Open Neural Network Exchange to C compiler.☆262Updated 2 months ago
- An open source light-weight and high performance inference framework for Hailo devices☆98Updated 2 months ago
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆451Updated this week
- ☆221Updated last year
- High-performance, optimized pre-trained template AI application pipelines for systems using Hailo devices☆122Updated this week
- Efficient Inference of Transformer models☆426Updated 7 months ago
- [NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep L…☆537Updated 11 months ago
- LLM SDK for OnnxRuntime GenAI (OGA)☆112Updated this week
- On-device AI across mobile, embedded and edge for PyTorch☆2,618Updated this week
- A Toolkit to Help Optimize Onnx Model☆125Updated this week
- Awesome Mobile LLMs☆150Updated last month
- A Toolkit to Help Optimize Large Onnx Model☆153Updated 10 months ago
- MLPerf™ Tiny is an ML benchmark suite for extremely low-power systems such as microcontrollers☆390Updated 2 weeks ago
- A unified library of state-of-the-art model optimization techniques such as quantization, pruning, distillation, speculative decoding, et…☆808Updated this week