huggingface / optimum-executorchLinks
🤗 Optimum ExecuTorch
☆54Updated last week
Alternatives and similar repositories for optimum-executorch
Users that are interested in optimum-executorch are comparing it to the libraries listed below
Sorting:
- ☆214Updated 5 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆264Updated 9 months ago
- A safetensors extension to efficiently store sparse quantized tensors on disk☆135Updated this week
- Load compute kernels from the Hub☆207Updated this week
- A tool to configure, launch and manage your machine learning experiments.☆171Updated this week
- AI Edge Quantizer: flexible post training quantization for LiteRT models.☆53Updated last week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆188Updated last month
- Google TPU optimizations for transformers models☆116Updated 5 months ago
- Python bindings for ggml☆142Updated 10 months ago
- Supporting PyTorch models with the Google AI Edge TFLite runtime.☆706Updated this week
- Fast low-bit matmul kernels in Triton☆330Updated last week
- LiteRT continues the legacy of TensorFlow Lite as the trusted, high-performance runtime for on-device AI. Now with LiteRT Next, we're exp…☆651Updated this week
- Scalable and Performant Data Loading☆288Updated last week
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆64Updated 3 months ago
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆361Updated this week
- Advanced Quantization Algorithm for LLMs and VLMs, with support for CPU, Intel GPU, CUDA and HPU. Seamlessly integrated with Torchao, Tra…☆528Updated this week
- Model compression for ONNX☆96Updated 7 months ago
- Fast Matrix Multiplications for Lookup Table-Quantized LLMs☆373Updated 3 months ago
- Use safetensors with ONNX 🤗☆67Updated 2 weeks ago
- Where GPUs get cooked 👩🍳🔥☆236Updated 4 months ago
- A minimalistic C++ Jinja templating engine for LLM chat templates☆160Updated this week
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆190Updated this week
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆206Updated this week
- ☆225Updated this week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆255Updated this week
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆196Updated 2 months ago
- High-Performance SGEMM on CUDA devices☆97Updated 5 months ago
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆62Updated 2 weeks ago
- PyTorch Single Controller☆318Updated this week
- Write a fast kernel and run it on Discord. See how you compare against the best!☆46Updated 2 weeks ago