Alternatives and similar repositories for cloud-ai-sdk

Users that are interested in cloud-ai-sdk are comparing it to the libraries listed below

• quic / efficient-transformers
  This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…
  ☆85Updated this week
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆114Updated 2 years ago
• SonySemiconductorSolutions / mct-model-optimization
  Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…
  ☆428Updated last week
• triton-inference-server / tutorials
  This repository contains tutorials and examples for Triton Inference Server
  ☆813Updated 3 weeks ago
• google-ai-edge / ai-edge-quantizer
  AI Edge Quantizer: flexible post training quantization for LiteRT models.
  ☆84Updated last week
• triton-inference-server / triton_cli
  Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…
  ☆73Updated 3 weeks ago
• quic / ai-hub-models
  Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) an…
  ☆873Updated 2 weeks ago
• google-ai-edge / ai-edge-torch
  Supporting PyTorch models with the Google AI Edge TFLite runtime.
  ☆880Updated last week
• mlops-discord / gpu-optimization-workshop
  Slides, notes, and materials for the workshop
  ☆337Updated last year
• staghado / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆304Updated last year
• microsoft / onnxscript
  ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
  ☆414Updated this week
• HabanaAI / Gaudi-tutorials
  Tutorials for running models on First-gen Gaudi and Gaudi2 for Training and Inference. The source files for the tutorials on https://dev…
  ☆62Updated 3 months ago
• justinchuby / model-explorer-onnx
  Visualize ONNX models with model-explorer
  ☆66Updated 2 weeks ago
• huggingface / optimum-intel
  🤗 Optimum Intel: Accelerate inference with Intel optimization tools
  ☆522Updated this week
• drkennetz / cuda_examples
  Some CUDA example code with READMEs.
  ☆179Updated last month
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆170Updated 3 weeks ago
• triton-inference-server / perf_analyzer
  ☆128Updated 2 weeks ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆267Updated 3 weeks ago
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆351Updated last year
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆203Updated last week
• dropbox / gemlite
  Fast low-bit matmul kernels in Triton
  ☆413Updated last week
• onnx / neural-compressor
  Model compression for ONNX
  ☆99Updated last year
• intel / auto-round
  Advanced quantization toolkit for LLMs and VLMs. Support for WOQ, MXFP4, NVFP4, GGUF, Adaptive Schemes and seamless integration with Tra…
  ☆785Updated this week
• evintunador / triton_docs_tutorials
  making the official triton tutorials actually comprehensible
  ☆80Updated 4 months ago
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆325Updated 3 months ago
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆289Updated last week
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆168Updated this week
• quic / qidk
  ☆172Updated last week
• cfregly / ai-performance-engineering
  ☆855Updated this week
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆82Updated 3 weeks ago