☆75Nov 19, 2022Updated 3 years ago
Alternatives and similar repositories for ZerO-initialization
Users that are interested in ZerO-initialization are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 광운대학교 컴퓨터 비전 AI 경진대회 1등 솔루션입니다.☆15Oct 5, 2022Updated 3 years ago
- 🎖️ 5th place solution in the Google American Sign Language Fingerspelling Recognition Competition🎖️☆16Sep 19, 2023Updated 2 years ago
- Binary Neural Network-based COVID-19 Face-Mask Wear and Positioning Predictor on Edge Devices☆12Jul 1, 2021Updated 4 years ago
- A Continual Learning Library in PyTorch and JAX☆13Apr 18, 2023Updated 3 years ago
- Scaling Sparse Fine-Tuning to Large Language Models☆19Jan 31, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Successfully training approximations to full-rank matrices for efficiency in deep learning.☆16Jan 5, 2021Updated 5 years ago
- Code for the paper: How Much Context Does My Attention-Based ASR System Need?☆11Updated this week
- Code for the PAPA paper☆27Nov 8, 2022Updated 3 years ago
- ☆42Mar 23, 2023Updated 3 years ago
- Codebase for adaptive continual memory☆14Aug 15, 2023Updated 2 years ago
- Pytorch Implementation of CLIP-Lite | Accepted at AISTATS 2023☆14Mar 17, 2023Updated 3 years ago
- Triton Implementation of HyperAttention Algorithm☆48Dec 11, 2023Updated 2 years ago
- A PyTorch wrapper of parallel exclusive scan in CUDA☆12May 25, 2023Updated 2 years ago
- Pypi installable TDNN and TDNN-F layers for PyTorch based acoustic model training☆41Dec 18, 2020Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 커버리스트 - 북 커버 생성 AI 서비스☆13Sep 11, 2022Updated 3 years ago
- Serving large language model with transformers☆13Oct 18, 2022Updated 3 years ago
- Guiding Attention for Self-Supervised Learning with Transformers☆12Feb 8, 2023Updated 3 years ago
- ☆33Mar 1, 2023Updated 3 years ago
- ☆46Oct 11, 2023Updated 2 years ago
- ACL 2023☆39Jun 6, 2023Updated 2 years ago
- Parallelizing non-linear sequential models over the sequence length☆57Jun 23, 2025Updated 10 months ago
- a Jax/Flax inference code of StarCoder☆12Jun 12, 2023Updated 2 years ago
- [EMNLP 2023]Context Compression for Auto-regressive Transformers with Sentinel Tokens☆25Nov 6, 2023Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- TART: A plug-and-play Transformer module for task-agnostic reasoning☆202Jun 22, 2023Updated 2 years ago
- Sequence modeling with Mega.☆303Jan 28, 2023Updated 3 years ago
- ☆12Jul 16, 2024Updated last year
- code for the paper "A Statistical Framework for Low-bitwidth Training of Deep Neural Networks"☆29Oct 31, 2020Updated 5 years ago
- Code for "Approaching Deep Learning through the Spectral Dynamics of Weights"☆13Oct 30, 2024Updated last year
- Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch☆253Sep 1, 2022Updated 3 years ago
- Building Knowledge Graph-Driven Chatbot with ChatGPT and ArangoDB☆19Jul 19, 2023Updated 2 years ago
- ☆53Oct 29, 2024Updated last year
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆81Aug 30, 2023Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- JAX/Flax implementation of the Hyena Hierarchy☆34Apr 27, 2023Updated 3 years ago
- Submission to the inverse scaling prize☆23Jul 23, 2023Updated 2 years ago
- Code base for SRSGD.☆27Mar 5, 2020Updated 6 years ago
- [COLM 2024] Early Weight Averaging meets High Learning Rates for LLM Pre-training☆20Oct 12, 2024Updated last year
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆88Jul 9, 2023Updated 2 years ago
- Reproduce the results of paper "Compressing Word Embeddings via Deep Compositional Code Learning" accepted ICLR 2018☆24May 16, 2018Updated 7 years ago
- A library for unit scaling in PyTorch☆133Jul 11, 2025Updated 9 months ago