Alternatives and similar repositories for Knowledge-Distillation

Users that are interested in Knowledge-Distillation are comparing it to the libraries listed below

• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆215Updated last year
• rasbt / cvpr2023
  ☆133Updated 2 years ago
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆252Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆90Updated last year
• jacobmarks / awesome-neurips-2023
  Conference schedule, top papers, and analysis of the data for NeurIPS 2023!
  ☆120Updated 2 years ago
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆119Updated 2 years ago
• Jaykef / ai-algorithms
  First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…
  ☆181Updated 5 months ago
• knotgrass / attention
  several types of attention modules written in PyTorch for learning purposes
  ☆52Updated last week
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆114Updated 2 years ago
• hkproj / mamba-notes
  Notes on the Mamba and the S4 model (Mamba: Linear-Time Sequence Modeling with Selective State Spaces)
  ☆178Updated 2 years ago
• ariG23498 / fine-tune-paligemma
  Notebooks for fine tuning pali gemma
  ☆117Updated 8 months ago
• shreydan / VisionGPT2
  Combining ViT and GPT-2 for image captioning. Trained on MS-COCO. The model was implemented mostly from scratch.
  ☆48Updated 2 years ago
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆227Updated last year
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆126Updated last year
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆49Updated last year
• a-r-r-o-w / kanformer
  Naively combining transformers and Kolmogorov-Arnold Networks to learn and experiment
  ☆37Updated last year
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆203Updated last week
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆97Updated last year
• ThinamXx / cuda-mode
  Making of cuda kernel
  ☆17Updated 7 months ago
• hkproj / pytorch-ddpm
  Implementation of the paper "Denoising Diffusion Probabilistic Models" in PyTorch
  ☆67Updated 2 years ago
• WalBouss / LeGrad
  [ICCV25] Official Implementation of LeGrad
  ☆86Updated last year
• apple / ml-sigmoid-attention
  ☆304Updated 8 months ago
• JayPatwardhan / ResNet-PyTorch
  Basic implementation of ResNet 50, 101, 152 in PyTorch
  ☆124Updated 3 years ago
• lucidrains / contrastive-rl
  Contrastive Reinforcement Learning
  ☆55Updated last week
• hu-po / streamdocs
  Documentation, notes, links, etc for streams.
  ☆84Updated last year
• kyegomez / xLSTM
  Implementation of xLSTM in Pytorch from the paper: "xLSTM: Extended Long Short-Term Memory"
  ☆118Updated 2 months ago
• catid / dora
  Implementation of DoRA
  ☆307Updated last year
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆56Updated 2 months ago
• pengzhangzhi / Awesome-Mamba
  Awesome list of papers that extend Mamba to various applications.
  ☆139Updated 6 months ago
• wjbmattingly / qwen2-vl-finetune-huggingface
  This project is a collection of fine-tuning scripts to help researchers fine-tune Qwen 2 VL on HuggingFace datasets.
  ☆77Updated 5 months ago