Alternatives and similar repositories for exploring-AI-optimization:

Users that are interested in exploring-AI-optimization are comparing it to the libraries listed below

• nebuly-ai / learning-hub
  ☆29Updated last year
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆59Updated last year
• hundredblocks / large-model-parallelism
  Functional local implementations of main model parallelism approaches
  ☆95Updated 2 years ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆104Updated 2 months ago
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆51Updated this week
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆84Updated last year
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated last year
• LukasHedegaard / pytorch-benchmark
  Easily benchmark PyTorch model FLOPs, latency, throughput, allocated gpu memory and energy consumption
  ☆98Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 9 months ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆68Updated 9 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆136Updated 7 months ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆81Updated last year
• ShishirPatil / poet
  ML model training for edge devices
  ☆162Updated last year
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• huggingface / optimum-graphcore
  Blazing fast training of 🤗 Transformers on Graphcore IPUs
  ☆84Updated last year
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆104Updated 8 months ago
• IST-DASLab / QUIK
  Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024
  ☆177Updated 11 months ago
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆59Updated 2 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆114Updated last month
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆255Updated last year
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆127Updated last year
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆189Updated this week
• microsoft / varuna
  ☆248Updated 8 months ago
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆54Updated last month
• UmerHA / triton_util
  Make triton easier
  ☆47Updated 9 months ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆108Updated last year
• eduardoleao052 / Autograd-from-scratch
  Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.
  ☆111Updated 11 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆87Updated last year
• EfficientDL / book
  PDFs and Codelabs for the Efficient Deep Learning book.
  ☆191Updated last year