huggingface / optimum-executorchLinks
🤗 Optimum ExecuTorch
☆101Updated last week
Alternatives and similar repositories for optimum-executorch
Users that are interested in optimum-executorch are comparing it to the libraries listed below
Sorting:
- AI Edge Quantizer: flexible post training quantization for LiteRT models.☆88Updated last week
- Use safetensors with ONNX 🤗☆81Updated last week
- Supporting PyTorch models with the Google AI Edge TFLite runtime.☆903Updated this week
- Python bindings for ggml☆146Updated last year
- A minimalistic C++ Jinja templating engine for LLM chat templates☆200Updated 3 months ago
- A tool to configure, launch and manage your machine learning experiments.☆214Updated this week
- Google TPU optimizations for transformers models☆132Updated last month
- LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via e…☆1,289Updated this week
- 🤗 Optimum ONNX: Export your model to ONNX and run inference with ONNX Runtime☆112Updated 3 weeks ago
- Visualize ONNX models with model-explorer☆66Updated last week
- Scalable and Performant Data Loading☆362Updated this week
- A safetensors extension to efficiently store sparse quantized tensors on disk☆233Updated last week
- ☆218Updated 11 months ago
- Load compute kernels from the Hub☆376Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆267Updated last month
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆305Updated last year
- ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.☆418Updated this week
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆204Updated last week
- 👷 Build compute kernels☆213Updated this week
- AMD related optimizations for transformer models☆96Updated 3 months ago
- Open-source reproducible benchmarks from Argmax☆77Updated this week
- Easy and Efficient Quantization for Transformers☆202Updated 6 months ago
- Fast low-bit matmul kernels in Triton☆423Updated last month
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆155Updated last year
- Official implementation of Half-Quadratic Quantization (HQQ)☆905Updated last month
- ☆91Updated last year
- Thin wrapper around GGML to make life easier☆42Updated 2 months ago
- 🎯An accuracy-first, highly efficient quantization toolkit for LLMs, designed to minimize quality degradation across Weight-Only Quantiza…☆815Updated this week
- Inference of Mamba models in pure C☆195Updated last year
- MLX support for the Open Neural Network Exchange (ONNX)☆63Updated last year