Alternatives and similar repositories for optimum-executorch

Users that are interested in optimum-executorch are comparing it to the libraries listed below

• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆263Updated 7 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆112Updated 4 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆311Updated this week
• abetlen / ggml-python
  Python bindings for ggml
  ☆141Updated 9 months ago
• mobiusml / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆47Updated last week
• huggingface / kernels
  Load compute kernels from the Hub
  ☆139Updated last week
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆153Updated 7 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆184Updated last week
• smpanaro / ModernBERT-AppleNeuralEngine
  ModernBERT model optimized for Apple Neural Engine.
  ☆26Updated 4 months ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆18Updated this week
• evintunador / triton_docs_tutorials
  making the official triton tutorials actually comprehensible
  ☆34Updated 2 months ago
• vdesai2014 / inference-optimization-blog-post
  ☆88Updated last year
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆69Updated 2 weeks ago
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆60Updated 2 months ago
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆115Updated 3 weeks ago
• Cornell-RelaxML / qtip
  ☆130Updated 2 months ago
• apple / ml-recurrent-drafter
  ☆210Updated 4 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆199Updated 10 months ago
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆34Updated this week
• argmaxinc / SDBench
  Open-source and reproducible benchmarks for Speaker Diarization
  ☆26Updated last month
• mlc-ai / llm-perf-bench
  ☆119Updated last year
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆117Updated this week
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆136Updated 2 weeks ago
• euclaise / supertrainer2000
  ☆49Updated last year
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆223Updated 10 months ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆271Updated last week
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆55Updated last year
• onnx / neural-compressor
  Model compression for ONNX
  ☆96Updated 6 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆129Updated 4 months ago
• ahmed-moubtahij / TokenHealer
  ☆22Updated last year