A pytorch realization of adafactor (https://arxiv.org/pdf/1804.04235.pdf )
☆26Aug 27, 2019Updated 7 years ago
Alternatives and similar repositories for adafactor-pytorch
Users that are interested in adafactor-pytorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Cost-sensitive multiclass classification with Adaptive Regularization of Weights☆16Sep 12, 2016Updated 10 years ago
- Code implementation for paper "On the Efficacy of Small Self-Supervised Contrastive Models without Distillation Signals".☆17Dec 15, 2021Updated 4 years ago
- Transformers for Cost-Sensitive BERT for Generalisable Sentence Classification on Imbalanced Data☆18May 28, 2020Updated 6 years ago
- PyTorch implementation of the SIESTA algorithm from our TMLR-2023 paper "SIESTA: Efficient Online Continual Learning with Sleep"☆13Oct 25, 2024Updated last year
- Grams: Gradient Descent with Adaptive Momentum Scaling (ICLR 2025 Workshop)☆17Mar 6, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆23Oct 20, 2020Updated 5 years ago
- [ACL 2025] Outlier-Safe Pre-Training for Robust 4-Bit Quantization of Large Language Models☆39Nov 4, 2025Updated 10 months ago
- Variance Covariance Regularization☆14Jun 22, 2023Updated 3 years ago
- pytorch实现bert做seq2seq任务，使用unilm方案。☆10Apr 1, 2020Updated 6 years ago
- The Stream-51 dataset for streaming classification and novelty detection from videos.☆18Feb 22, 2022Updated 4 years ago
- Object tracking based on SiamFC & DaSiamRPN using GOT-10k toolkit. Demo & Visualization.☆10Jun 29, 2020Updated 6 years ago
- (ICML 2023) Feature learning in deep classifiers through Intermediate Neural Collapse: Accompanying code☆16Jul 27, 2023Updated 3 years ago
- Official PyTorch Implementation for Paper "No More Adam: Learning Rate Scaling at Initialization is All You Need"☆55Jan 27, 2025Updated last year
- Code for "Self-Distillation as Instance-Specific Label Smoothing"☆15Oct 22, 2020Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A fast CUDA accelerated implementation for MVS evaluation.☆12Dec 1, 2022Updated 3 years ago
- This allows to create latent spaces filled with perlin-based noise that can actually be used by the samplers.☆34Aug 13, 2024Updated 2 years ago
- Extend the Conditioning of Stable Diffusion to take Audio Embeddings Instead of Text Embeddings using Wav2Vec2-BERT model☆13Sep 25, 2024Updated 2 years ago
- Implementing DropPath/StochasticDepth in PyTorch☆18Feb 5, 2022Updated 4 years ago
- ☆10Oct 8, 2018Updated 7 years ago
- Experimental ADMM approach to neural networks☆12Nov 8, 2016Updated 9 years ago
- [NeurIPS 2020] Official Implementation: "SMYRF: Efficient Attention using Asymmetric Clustering".☆50Sep 6, 2023Updated 3 years ago
- LGEB: Benchmark of Language Generation Evaluation☆16Oct 21, 2022Updated 3 years ago
- Create a Hopfield Network for Image Reconstruction☆18May 9, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- dracut module using vdfuse to loop mount☆11Mar 21, 2021Updated 5 years ago
- Fractional Spike Differential Equations Neural Network with Efficient Adjoint Parameters Training☆16Aug 6, 2025Updated last year
- Driver State Monitoring 驾驶员状态监测，包括：人为遮挡、姿态异常、打哈欠、打电话、抽烟、分神、闭眼检测☆16May 26, 2023Updated 3 years ago
- APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention☆365Nov 29, 2025Updated 9 months ago
- ☆11Nov 27, 2020Updated 5 years ago
- A place to house minutes and other documents related to the core team.☆14Dec 16, 2020Updated 5 years ago
- Python utilities for Machine Learning competitions☆31Oct 23, 2017Updated 8 years ago
- A c++ implementation for calculating the accuracy metrics (Accuracy, Error Rate, Precision(micro/macro), Recall(micro/macro), Fscore(micr…☆12Jul 2, 2019Updated 7 years ago
- This repository contains example code to build models on TPUs☆30Feb 17, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Discriminative Prototypes learned by Dynamic Time Warping (DTW) for Time Series Classification (TSC)☆33Mar 19, 2021Updated 5 years ago
- ☆22Mar 16, 2024Updated 2 years ago
- End-to-end Deep Linear Discriminant Analysis in Pytorch.☆18Mar 22, 2021Updated 5 years ago
- ☆10Sep 16, 2020Updated 6 years ago
- This is a detailed code demo on how to conduct Full-Param Supervised Fine-tuning (SFT) and DPO (Direct Preference Optimization)☆21Jan 9, 2025Updated last year
- ☆12Jul 6, 2026Updated 2 months ago
- ☆14Jul 16, 2021Updated 5 years ago