Alternatives and similar repositories for exploring-AI-optimization

Users that are interested in exploring-AI-optimization are comparing it to the libraries listed below

• ShishirPatil / poet
  ML model training for edge devices
  ☆165Updated last year
• hidet-org / hidet
  An open-source efficient deep learning framework/compiler, written in python.
  ☆704Updated last week
• anyscale / e2e-llm-workflows
  Fine-tune an LLM to perform batch inference and online serving.
  ☆112Updated last month
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆83Updated last year
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆137Updated 11 months ago
• microsoft / varuna
  ☆250Updated 11 months ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆264Updated 8 months ago
• jxtngx / lightning-lab
  deep learning with pytorch lightning
  ☆1Updated 8 months ago
• HMUNACHI / nanodl
  A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.
  ☆288Updated 10 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆132Updated 2 months ago
• r-three / git-theta
  git extension for {collaborative, communal, continual} model development
  ☆213Updated 7 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆257Updated last year
• gradsflow / gradsflow-automl
  An open-source AutoML Library based on PyTorch
  ☆307Updated 2 months ago
• Jingjing-NLP / KNAS
  Codes for paper "KNAS: Green Neural Architecture Search"
  ☆92Updated 3 years ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆90Updated 3 months ago
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆158Updated last week
• titanml / takeoff-community
  TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…
  ☆114Updated last year
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆323Updated last week
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆269Updated 3 years ago
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• HuaizhengZhang / Active-Learning-as-a-Service
  A scalable & efficient active learning/data selection system for everyone.
  ☆214Updated 11 months ago
• sayakpaul / keras-xla-benchmarks
  Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.
  ☆37Updated last year
• nebuly-ai / learning-hub
  ☆29Updated 2 years ago
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆304Updated last month
• neuralmagic / sparsify
  ML model optimization product to accelerate inference.
  ☆325Updated 3 weeks ago
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆287Updated 6 months ago
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆61Updated 5 months ago