Alternatives and similar repositories for minGPT-ddp

Users that are interested in minGPT-ddp are comparing it to the libraries listed below

• NVlabs / EfficientDL
  ☆31Updated 11 months ago
• kirill-vish / Beyond-INet
  Code for experiments for "ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy"
  ☆101Updated 8 months ago
• OscarXZQ / weight-selection
  ☆181Updated 8 months ago
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆93Updated 5 months ago
• NVlabs / Fast-dLLM
  ☆144Updated this week
• yanring / Megatron-MoE-ModelZoo
  Best practices for testing advanced Mixtral, DeepSeek, and Qwen series MoE models using Megatron Core MoE.
  ☆17Updated this week
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆87Updated 4 months ago
• ziplab / EcoFormer
  [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"
  ☆72Updated 2 years ago
• rwightman / imagenet-12k
  ImageNet-12k subset of ImageNet-21k (fall11)
  ☆21Updated last year
• alenic / timm-models-explorer
  Timm model explorer
  ☆39Updated last year
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆111Updated 5 months ago
• nbasyl / DoRA
  Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"
  ☆123Updated last year
• Qualcomm-AI-research / lr-qat
  ☆39Updated 7 months ago
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆39Updated last year
• minyoungg / LTE
  ☆68Updated 10 months ago
• fawazsammani / awesome-mlp-mixer
  Transformers w/o Attention, based fully on MLPs
  ☆93Updated last year
• TianjinYellow / EdgeDeviceLLMCompetition-Starting-Kit
  ☆43Updated 7 months ago
• ziplab / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆27Updated last year
• TomerRonen34 / mixed-resolution-vit
  ☆50Updated last year
• Dao-AILab / grouped-latent-attention
  ☆93Updated last week
• YeonwooSung / Pytorch_mixture-of-experts
  PyTorch implementation of moe, which stands for mixture of experts
  ☆43Updated 4 years ago
• PiotrNawrot / sparse-frontier
  Official implementation of "The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs"
  ☆32Updated last month
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆36Updated last year
• nil0x9 / flash-muon
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆121Updated last week
• VITA-Group / AsViT
  [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…
  ☆76Updated 3 years ago
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆94Updated this week
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆68Updated 5 months ago
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆33Updated last year
• vedantroy / gpu_kernels
  ☆26Updated last year
• LiqunMa / FBI-LLM
  FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation
  ☆48Updated 10 months ago