huggingface / optimum-executorchLinks
🤗 Optimum ExecuTorch
☆67Updated last week
Alternatives and similar repositories for optimum-executorch
Users that are interested in optimum-executorch are comparing it to the libraries listed below
Sorting:
- A safetensors extension to efficiently store sparse quantized tensors on disk☆167Updated this week
- Load compute kernels from the Hub☆293Updated last week
- Google TPU optimizations for transformers models☆120Updated 8 months ago
- Fast low-bit matmul kernels in Triton☆376Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆265Updated 11 months ago
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆296Updated last year
- Explore training for quantized models☆24Updated 2 months ago
- Use safetensors with ONNX 🤗☆69Updated last week
- ☆218Updated 8 months ago
- Python bindings for ggml☆146Updated last year
- AI Edge Quantizer: flexible post training quantization for LiteRT models.☆69Updated this week
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆414Updated last week
- A tool to configure, launch and manage your machine learning experiments.☆195Updated last week
- A minimalistic C++ Jinja templating engine for LLM chat templates☆187Updated 2 weeks ago
- Advanced Quantization Algorithm for LLMs and VLMs, with support for CPU, Intel GPU, CUDA and HPU.☆651Updated this week
- Official implementation for Training LLMs with MXFP4☆93Updated 5 months ago
- ☆333Updated 3 weeks ago
- This repository contains the experimental PyTorch native float8 training UX☆224Updated last year
- Fast Matrix Multiplications for Lookup Table-Quantized LLMs☆374Updated 5 months ago
- Write a fast kernel and run it on Discord. See how you compare against the best!☆58Updated last week
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆154Updated 11 months ago
- An innovative library for efficient LLM inference via low-bit quantization☆350Updated last year
- ☆89Updated last year
- Open-source reproducible benchmarks from Argmax☆60Updated last week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆269Updated 2 months ago
- 👷 Build compute kernels☆155Updated this week
- Applied AI experiments and examples for PyTorch☆296Updated last month
- Official implementation of Half-Quadratic Quantization (HQQ)☆879Updated last month
- Scalable and Performant Data Loading☆304Updated this week
- ☆21Updated 7 months ago