Alternatives and similar repositories for optimum-executorch

Users that are interested in optimum-executorch are comparing it to the libraries listed below

• google-ai-edge / ai-edge-quantizer
  AI Edge Quantizer: flexible post training quantization for LiteRT models.
  ☆96Updated this week
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆84Updated 3 weeks ago
• google-ai-edge / litert-torch
  Support PyTorch model conversion with LiteRT.
  ☆930Updated this week
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆134Updated 2 weeks ago
• vllm-project / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆238Updated this week
• NVIDIA-NeMo / Run
  A tool to configure, launch and manage your machine learning experiments.
  ☆216Updated this week
• huggingface / kernels
  Load compute kernels from the Hub
  ☆397Updated this week
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆267Updated 2 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆147Updated last year
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆203Updated 4 months ago
• justinchuby / model-explorer-onnx
  Visualize ONNX models with model-explorer
  ☆67Updated 3 weeks ago
• apple / ml-recurrent-drafter
  ☆219Updated last year
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆79Updated last month
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆364Updated this week
• dropbox / gemlite
  Fast low-bit matmul kernels in Triton
  ☆427Updated last week
• huggingface / optimum-onnx
  🤗 Optimum ONNX: Export your model to ONNX and run inference with ONNX Runtime
  ☆114Updated last week
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆198Updated 8 months ago
• staghado / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆306Updated last year
• google / jaxonnxruntime
  A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.
  ☆130Updated last week
• argmaxinc / OpenBench
  Open-source reproducible benchmarks from Argmax
  ☆77Updated 2 weeks ago
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆215Updated last week
• microsoft / onnxscript
  ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
  ☆420Updated this week
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆205Updated this week
• lucasnewman / nanospeech
  A simple, hackable text-to-speech system in PyTorch and MLX
  ☆187Updated 6 months ago
• gpu-mode / kernelbot
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆68Updated last week
• ml-explore / mlx-onnx
  MLX support for the Open Neural Network Exchange (ONNX)
  ☆63Updated last year
• huggingface / gpu-fryer
  Where GPUs get cooked 👩‍🍳🔥
  ☆363Updated 2 weeks ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆26Updated 6 months ago
• onnx / steering-committee
  Notes and artifacts from the ONNX steering committee
  ☆28Updated last week
• changjonathanc / flex-nano-vllm
  FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.
  ☆334Updated 3 months ago