nebuly-ai / exploring-AI-optimization

Related projects ⓘ

Alternatives and complementary repositories for exploring-AI-optimization

• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆57Updated 11 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆105Updated 5 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆252Updated last year
• ShishirPatil / poet
  ML model training for edge devices
  ☆157Updated last year
• abacusai / gh200-llm
  Packages and instructions for training and inference of LLMs on NVIDIA's new GH200 machines
  ☆19Updated 2 months ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆253Updated last month
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆89Updated this week
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆73Updated 2 months ago
• anyscale / e2e-llm-workflows
  End-to-End LLM Guide
  ☆97Updated 4 months ago
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆83Updated last year
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆138Updated 2 months ago
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆260Updated this week
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆146Updated this week
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆134Updated 3 months ago
• IST-DASLab / QUIK
  Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024
  ☆173Updated 7 months ago
• mlcommons / mlcube
  MLCube® is a project that reduces friction for machine learning by ensuring that models are easily portable and reproducible.
  ☆154Updated 2 months ago
• chainyo / tensorshare
  🤝 Trade any tensors over the network
  ☆30Updated last year
• nebuly-ai / learning-hub
  ☆29Updated last year
• efeslab / fiddler
  Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆173Updated this week
• rasbt / faster-pytorch-blog
  Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy
  ☆124Updated last year
• gpu-mode / ring-attention
  ring-attention experiments
  ☆97Updated last month
• IST-DASLab / qmoe
  Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".
  ☆262Updated last year
• hidet-org / hidet
  An open-source efficient deep learning framework/compiler, written in python.
  ☆652Updated last week
• huggingface / optimum-graphcore
  Blazing fast training of 🤗 Transformers on Graphcore IPUs
  ☆82Updated 8 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆93Updated last month
• gnovack / distributed-training-and-deepspeed
  ☆13Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆238Updated 4 months ago
• dm4ml / gate
  Drift detection module for machine learning pipelines.
  ☆21Updated last year
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆153Updated this week
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆167Updated 2 weeks ago