huggingface / optimum-executorchLinks
🤗 Optimum ExecuTorch
☆58Updated this week
Alternatives and similar repositories for optimum-executorch
Users that are interested in optimum-executorch are comparing it to the libraries listed below
Sorting:
- A safetensors extension to efficiently store sparse quantized tensors on disk☆142Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆266Updated 9 months ago
- ☆215Updated 6 months ago
- Fast low-bit matmul kernels in Triton☆338Updated last week
- Python bindings for ggml☆142Updated 11 months ago
- Load compute kernels from the Hub☆220Updated this week
- AI Edge Quantizer: flexible post training quantization for LiteRT models.☆56Updated last week
- A tool to configure, launch and manage your machine learning experiments.☆174Updated last week
- An innovative library for efficient LLM inference via low-bit quantization☆349Updated 11 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆205Updated 3 months ago
- Fast Matrix Multiplications for Lookup Table-Quantized LLMs☆372Updated 3 months ago
- ☆227Updated last week
- Google TPU optimizations for transformers models☆117Updated 6 months ago
- This repository contains the experimental PyTorch native float8 training UX☆224Updated last year
- ArcticInference: vLLM plugin for high-throughput, low-latency inference☆203Updated this week
- VPTQ, A Flexible and Extreme low-bit quantization algorithm☆649Updated 3 months ago
- Applied AI experiments and examples for PyTorch☆289Updated 2 months ago
- Official implementation of Half-Quadratic Quantization (HQQ)☆855Updated last week
- Explore training for quantized models☆20Updated 3 weeks ago
- LLM training in simple, raw C/CUDA☆102Updated last year
- Advanced Quantization Algorithm for LLMs and VLMs, with support for CPU, Intel GPU, CUDA and HPU. Seamlessly integrated with Torchao, Tra…☆564Updated this week
- ☆162Updated last year
- Use safetensors with ONNX 🤗☆69Updated last month
- Efficient LLM Inference over Long Sequences☆385Updated last month
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆188Updated 2 months ago
- A minimalistic C++ Jinja templating engine for LLM chat templates☆163Updated 3 weeks ago
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆154Updated 9 months ago
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆289Updated last year
- High-Performance SGEMM on CUDA devices☆98Updated 6 months ago
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆206Updated last week