Ongoing research training transformer language models at scale, including: BERT & GPT-2
☆20Oct 23, 2023Updated 2 years ago
Alternatives and similar repositories for Megatron-DeepSpeed
Users that are interested in Megatron-DeepSpeed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository contains the results and code for the MLPerf™ Training v4.0 benchmark.☆12Jun 11, 2024Updated 2 years ago
- Lab exercises for the DL4MT winter school at DCU☆15Oct 21, 2015Updated 10 years ago
- Source-to-Source Debuggable Derivatives in Pure Python☆15Jan 23, 2024Updated 2 years ago
- Dataset used to evaluate Skill Extraction systems based on the ESCO skills taxonomy.☆17Jul 18, 2024Updated last year
- ☆13Oct 28, 2020Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Материалы курса "Компьютерная лингвистика и информационные технологии" для 4-го курса бакалавриата направления "Фундаментальная и приклад…☆10Mar 25, 2021Updated 5 years ago
- ☆17May 25, 2020Updated 6 years ago
- Official Pytorch implementation of (Roles and Utilization of Attention Heads in Transformer-based Neural Language Models), ACL 2020☆16Mar 21, 2025Updated last year
- Ukrainian ELECTRA model☆12Mar 11, 2023Updated 3 years ago
- A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch☆24May 26, 2026Updated 2 weeks ago
- Russian Artificial Text Detection☆20Nov 17, 2025Updated 6 months ago
- A template for starting a new allennlp project using config files and `allennlp train`☆38Mar 20, 2024Updated 2 years ago
- ☆21Mar 3, 2025Updated last year
- First steps in Machine Learning☆12Mar 18, 2015Updated 11 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- This is a repository for the paper on testing inductive bias with scaled-down RoBERTa models.☆21Jan 10, 2022Updated 4 years ago
- Code for our WOAH@ACL 2021 Paper on Data Integration for Toxic Comment Classification: Making More Than 40 Datasets Easily Accessible in …☆30Nov 25, 2021Updated 4 years ago
- ☆14Jul 13, 2025Updated 11 months ago
- [NAACL 2018] Robust Sequence Labeling with Adversarial Training☆10Sep 30, 2019Updated 6 years ago
- Tweets annotated with coarse-grained sense labels (supersenses)☆13Jun 13, 2014Updated 12 years ago
- ☆10Oct 28, 2020Updated 5 years ago
- ☆12Dec 8, 2022Updated 3 years ago
- A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.☆13Jul 31, 2017Updated 8 years ago
- Docker container for UDPipe (https://github.com/ufal/udpipe) REST server.☆12Jun 23, 2020Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Kaggleのshopeeコンペのリポジトリ☆11Jun 7, 2021Updated 5 years ago
- Chu-Lui-Edmonds decoding extracted from TurboParser☆14May 16, 2017Updated 9 years ago
- Multi-Domain Expert Learning☆67Jan 23, 2024Updated 2 years ago
- ☆19Aug 10, 2024Updated last year
- Lightweight method based on shortest path on word graphs and NLP to generate single sentence summaries that highly relevant and grammatic…☆19Jan 29, 2017Updated 9 years ago
- Utilities for Training Very Large Models☆59Sep 25, 2024Updated last year
- Repository collecting resources and best practices to improve experimental rigour in deep learning research.☆27Mar 30, 2023Updated 3 years ago
- Contains code used to conduct experiments on dependency parsing with the Tensor-LSTM model developed for our paper "Cross-Lingual Depende…☆13Jan 5, 2017Updated 9 years ago
- Neural Network Based Dependency Parsers☆11Jan 14, 2016Updated 10 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Codebase implementing LMs for learning the Dyck-(k,m) bounded hierarchical language☆16Oct 11, 2020Updated 5 years ago
- Parsing only with Pretraining Networks☆16Jul 25, 2024Updated last year
- Open broad-coverage corpus for Finnish named entity recognition.☆12Aug 22, 2020Updated 5 years ago
- ☆16Nov 5, 2018Updated 7 years ago
- Part-of-speech tagging using BERT☆10Nov 14, 2019Updated 6 years ago
- ☆15Jul 1, 2020Updated 5 years ago
- Queuing and quota management for AI/ML batch jobs on Kubernetes☆17Jul 16, 2025Updated 10 months ago