umitkacar / awesome-tinymlLinks
TinyML & Edge AI: On-device inference, model quantization, embedded ML, ultra-low-power AI for microcontrollers and IoT devices.
☆26Updated 2 months ago
Alternatives and similar repositories for awesome-tinyml
Users that are interested in awesome-tinyml are comparing it to the libraries listed below
Sorting:
- A very simple tool for situations where optimization with onnx-simplifier would exceed the Protocol Buffers upper file size limit of 2GB,…☆17Updated 3 months ago
- Simple tool for partial optimization of ONNX. Further optimize some models that cannot be optimized with onnx-optimizer and onnxsim by se…☆19Updated last year
- Converts CLIP models to ONNX☆11Updated 3 years ago
- The Facial Landmark Detection☆15Updated 5 months ago
- ONNX and TensorRT implementation of Whisper☆66Updated 2 years ago
- Repository for running LLMs efficiently on Mac silicon (M1, M2, M3). Features Jupyter notebook for Meta-Llama-3 setup using MLX framework…☆11Updated last year
- Simple tool to combine(merge) onnx models. Simple Network Combine Tool for ONNX.☆18Updated 3 months ago
- A list of language models with permissive licenses such as MIT or Apache 2.0☆24Updated 10 months ago
- ☆11Updated 3 years ago
- A curated list of research in System for Edge Intelligence and Computing(Edge MLSys), including Frameworks, Tools, Repository, etc. Paper…☆32Updated 4 years ago
- A very simple tool to rewrite parameters such as attributes and constants for OPs in ONNX models. Simple Attribute and Constant Modifier …☆15Updated 3 months ago
- Python wrapper class for OpenVINO Model Server. User can submit inference request to OVMS with just a few lines of code.☆10Updated 4 years ago
- [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models☆68Updated last year
- Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP☆64Updated 8 months ago
- An open source NLP as a service project focused on providing state of the art systems with ease. Training and inference by simple docker …☆20Updated last year
- OpenVINO installer storage location (Full version)☆13Updated 4 years ago
- Python scripts performing optical flow estimation using the NeuFlowV2 model in ONNX.☆52Updated last year
- AI Edge Quantizer: flexible post training quantization for LiteRT models.☆88Updated this week
- This Repository demostrates various examples using YOLO☆13Updated last year
- A very simple tool that compresses the overall size of the ONNX model by aggregating duplicate constant values as much as possible.☆52Updated 3 years ago
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆22Updated last year
- Deep Compression for PyTorch Model Deployment on Microcontrollers☆19Updated 4 years ago
- Integrate an LLM copilot within your Keras model development workflow☆28Updated 2 years ago
- Explainable vision transformer for automatic visual sleep staging on multimodal PSG signals☆16Updated last year
- How to export PyTorch models with unsupported layers to ONNX and then to Intel OpenVINO☆28Updated 10 months ago
- Building LLMs from scratch following the book from S. Raschka☆32Updated 9 months ago
- Segment Anything Model (SAM) interactive demo with OpenVINO☆13Updated last year
- Model compression for ONNX☆99Updated last year
- Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.☆13Updated last year
- LDC: Lightweight Dense CNN for Edge DetectionのPythonでのONNX推論サンプル☆15Updated 2 years ago