huggingface / optimum-executorchLinks
🤗 Optimum ExecuTorch
☆64Updated last week
Alternatives and similar repositories for optimum-executorch
Users that are interested in optimum-executorch are comparing it to the libraries listed below
Sorting:
- A high-throughput and memory-efficient inference and serving engine for LLMs☆266Updated 10 months ago
- Load compute kernels from the Hub☆244Updated last week
- A safetensors extension to efficiently store sparse quantized tensors on disk☆153Updated this week
- Python bindings for ggml☆146Updated 11 months ago
- A tool to configure, launch and manage your machine learning experiments.☆183Updated this week
- Fast low-bit matmul kernels in Triton☆353Updated last week
- ☆217Updated 7 months ago
- AI Edge Quantizer: flexible post training quantization for LiteRT models.☆60Updated this week
- Official implementation of Half-Quadratic Quantization (HQQ)☆868Updated last week
- Advanced Quantization Algorithm for LLMs and VLMs, with support for CPU, Intel GPU, CUDA and HPU. Seamlessly integrated with Torchao, Tra…☆596Updated this week
- This repository contains the experimental PyTorch native float8 training UX☆224Updated last year
- Explore training for quantized models☆22Updated last month
- Scalable and Performant Data Loading☆291Updated this week
- On-device intelligence.☆371Updated 5 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆571Updated 2 weeks ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆261Updated last month
- VPTQ, A Flexible and Extreme low-bit quantization algorithm☆652Updated 4 months ago
- A minimalistic C++ Jinja templating engine for LLM chat templates☆170Updated 2 weeks ago
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆292Updated last year
- ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.☆376Updated this week
- Google TPU optimizations for transformers models☆118Updated 7 months ago
- Use safetensors with ONNX 🤗☆69Updated last month
- An innovative library for efficient LLM inference via low-bit quantization☆349Updated 11 months ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆389Updated 2 weeks ago
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆193Updated this week
- ☆325Updated 3 weeks ago
- AMD related optimizations for transformer models☆82Updated this week
- Applied AI experiments and examples for PyTorch☆291Updated this week
- LLM KV cache compression made easy☆586Updated this week
- ☆232Updated last week