Alternatives and similar repositories for minGPT-ddp

Users that are interested in minGPT-ddp are comparing it to the libraries listed below

• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆93Updated 6 months ago
• ziplab / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆27Updated last year
• NVlabs / EfficientDL
  ☆32Updated 2 weeks ago
• VITA-Group / AsViT
  [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…
  ☆76Updated 3 years ago
• vedantroy / gpu_kernels
  ☆26Updated last year
• nil0x9 / flash-muon
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆131Updated last week
• Lightning-AI / forked-pdb
  Python pdb for multiple processes
  ☆49Updated last month
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆25Updated last year
• indri-voice / vit.triton
  VIT inference in triton because, why not?
  ☆29Updated last year
• facebookresearch / DeltaCNN
  DeltaCNN End-to-End CNN Inference of Sparse Frame Differences in Videos
  ☆59Updated 2 years ago
• facebookresearch / Ternary_Binary_Transformer
  ACL 2023
  ☆39Updated 2 years ago
• ziplab / EcoFormer
  [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"
  ☆72Updated 2 years ago
• OscarXZQ / weight-selection
  ☆181Updated 9 months ago
• GATECH-EIC / SuperTickets
  [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning
  ☆20Updated 2 years ago
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆83Updated last year
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆45Updated 11 months ago
• TianjinYellow / EdgeDeviceLLMCompetition-Starting-Kit
  ☆43Updated 7 months ago
• Qualcomm-AI-research / gptvq
  ☆31Updated last year
• NVIDIA / Megatron-Energon
  Megatron's multi-modal data loader
  ☆213Updated this week
• ModelTC / Outlier_Suppression_Plus
  Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and opti…
  ☆46Updated last year
• IST-DASLab / QuEST
  Work in progress.
  ☆69Updated 3 weeks ago
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆167Updated this week
• pytorch-labs / superblock
  A block oriented training approach for inference time optimization.
  ☆33Updated 10 months ago
• L1aoXingyu / llm-infer-bench
  ☆11Updated last year
• xvyaward / owq
  Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…
  ☆63Updated last year
• Qualcomm-AI-research / lr-qat
  ☆39Updated 7 months ago
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆88Updated 5 months ago
• NVlabs / COAT
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆210Updated last week
• UmerHA / triton_util
  Make triton easier
  ☆46Updated last year
• SNU-ARC / any-precision-llm
  [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs
  ☆108Updated 2 months ago