HabanaAI / Model-References

Related projects ⓘ

Alternatives and complementary repositories for Model-References

• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆57Updated 2 months ago
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆86Updated last week
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆152Updated this week
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆41Updated this week
• aws / aws-ofi-nccl
  This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.
  ☆145Updated this week
• mlcommons / training_policies
  Issues related to MLPerf™ training policies, including rules and suggested changes
  ☆92Updated last month
• NVIDIA / LDDL
  Distributed preprocessing and data loading for language datasets
  ☆39Updated 6 months ago
• anyscale / llm-continuous-batching-benchmarks
  ☆109Updated 7 months ago
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆34Updated 3 weeks ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆159Updated last week
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆96Updated this week
• mlcommons / inference_policies
  Issues related to MLPerf™ Inference policies, including rules and suggested changes
  ☆57Updated this week
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆26Updated this week
• NVIDIA / nvbandwidth
  A tool for bandwidth measurements on NVIDIA GPUs.
  ☆316Updated 3 weeks ago
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆297Updated this week
• mlcommons / training_results_v1.0
  This repository contains the results and code for the MLPerf™ Training v1.0 benchmark.
  ☆37Updated 8 months ago
• cli99 / llm-analysis
  Latency and Memory Analysis of Transformer Models for Training and Inference
  ☆352Updated 5 months ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆116Updated 3 months ago
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆146Updated this week
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆48Updated 2 weeks ago
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆122Updated this week
• ROCm / rccl
  ROCm Communication Collectives Library (RCCL)
  ☆267Updated this week
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆248Updated 2 years ago
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆143Updated this week
• saareliad / FTPipe
  FTPipe and related pipeline model parallelism research.
  ☆41Updated last year
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆123Updated this week
• mlcommons / logging
  MLPerf™ logging library
  ☆30Updated last week
• awslabs / slapo
  A schedule language for large model training
  ☆141Updated 4 months ago
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆113Updated 11 months ago
• facebookresearch / FAMBench
  Benchmarks to capture important workloads.
  ☆28Updated 5 months ago