基于PyTorch GPT-2的针对各种数据并行pretrain的研究代码.
☆11Dec 16, 2022Updated 3 years ago
Alternatives and similar repositories for DistributedTrainingGPT2
Users that are interested in DistributedTrainingGPT2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 基于Lean大佬Lede源码编译。使用 Flippy 的 Openwrt 打包源码,主要制作 Phicomm N1、Amlogic S905x3 的 openwrt 固件及CR660X固件。☆11Oct 4, 2025Updated last year
- Optimizing loading training data from cloud bucket storage for cloud-based distributed deep learning. Official repository for Quantifying…☆11Jan 1, 2022Updated 4 years ago
- All reduce implementation and analysis of BDE vs Ring primitives☆11Sep 7, 2022Updated 4 years ago
- d3 plugin for web interfaces☆14Jul 2, 2020Updated 6 years ago
- It was may. A tiny OS.☆10Apr 13, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆10Oct 8, 2021Updated 5 years ago
- ☆19Oct 8, 2024Updated 2 years ago
- ☆14Oct 7, 2023Updated 3 years ago
- ☆12Jun 23, 2023Updated 3 years ago
- ☆28Oct 19, 2026Updated last month
- 深入ElasticSearch☆17Mar 8, 2016Updated 10 years ago
- A very hacky set of functions for getting plotly to do what I want when doing mech interp research, designed to be compatible with PyTorc…☆16Jun 16, 2023Updated 3 years ago
- ☆17Jun 8, 2019Updated 7 years ago
- OpenWrt上Smartdns的自动守护进程,放到/etc/init.d目录用service smartdnsprocd enable开机自启☆19Jun 21, 2021Updated 5 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- TREC QA dataset for question answering cleaned for usage in Question Answering☆14Aug 26, 2019Updated 7 years ago
- A tool for PHP multi process asynchronous tasks manage☆18Aug 14, 2018Updated 8 years ago
- 京东小组件☆24Jan 28, 2022Updated 4 years ago
- Official repository for the paper "Blending Complementary Memory Systems in Hybrid Quadratic-Linear Transformers"☆13Jun 3, 2025Updated last year
- ☆16Aug 26, 2026Updated 2 months ago
- ☆18Feb 4, 2026Updated 9 months ago
- Official Pytorch implementation of "DBS: Dynamic Batch Size for Distributed Deep Neural Network Training"☆23Sep 30, 2021Updated 5 years ago
- ☆11Dec 15, 2025Updated 11 months ago
- My Assignment for CSE 599w http://dlsys.cs.washington.edu/☆15Dec 2, 2019Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 一个高效的前后端集成框架,基于Vite、Vue、Webpack和Node.js。一键启动,开箱即用。 An efficient front-end and back-end integration framework based on Vite, Vue, Webpack…☆18May 8, 2026Updated 6 months ago
- ☆16May 22, 2023Updated 3 years ago
- Code for EMNLP'24 paper - On Diversified Preferences of Large Language Model Alignment☆16Aug 6, 2024Updated 2 years ago
- ☆14May 5, 2025Updated last year
- ☆12Dec 5, 2023Updated 2 years ago
- ☆14Sep 6, 2024Updated 2 years ago
- Code of "Recurrent Transformers Trade-off Parallelism for Length Generalization on Regular Languages"☆10Updated this week
- ☆12Jun 15, 2023Updated 3 years ago
- Examples of using Cilium for chaos testing and fault injection☆27Sep 12, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A python implementation of exposure fusion☆19Jan 29, 2022Updated 4 years ago
- Tracking faces and multiple models detection from faces such as: Gender, Expressions, Illumination, Pose, Occlusion, Age, Makeup.☆11Jan 2, 2020Updated 6 years ago
- Community Implementation of paper "Inference-Time Scaling for Generalist Reward Modeling"☆11Apr 21, 2025Updated last year
- ☆10May 12, 2025Updated last year
- The Go language implementation of gRPC over QUIC.☆30Dec 2, 2021Updated 4 years ago
- [ICLR 2026] Breaking the SFT Plateau: Multimodal Structured Reinforcement Learning for Chart-to-Code Generation☆12Jan 27, 2026Updated 9 months ago
- The implementation of the DAAN method accompanies ECCV 2020 paper at https://link.springer.com/chapter/10.1007/978-3-030-58598-3_2☆10Jan 25, 2021Updated 5 years ago
Are these results useful?