Collection of scripts to pretrain T5 in unsupervised text, using PyTorch Lightning. CORD-19 pretraining provided as example.
☆32Apr 26, 2021Updated 5 years ago
Alternatives and similar repositories for Pretraining-T5-PyTorch-Lightning
Users that are interested in Pretraining-T5-PyTorch-Lightning are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DialCoT Meets PPO: Decomposing and Exploring Reasoning Paths in Smaller Language Models☆13Nov 2, 2023Updated 3 years ago
- Pytorch Implementation of EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks☆62Jan 22, 2022Updated 4 years ago
- ☆13Oct 21, 2021Updated 5 years ago
- A simple version of DeepRank & MatchPyramid implemented in PyTorch.☆34Jul 2, 2020Updated 6 years ago
- Mixture of Expert (MoE) techniques for enhancing LLM performance through expert-driven prompt mapping and adapter combinations.☆11Feb 11, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [NAACL 2022] Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learning.☆56Apr 1, 2024Updated 2 years ago
- 简单的挖矿病毒查杀脚本☆19Apr 4, 2022Updated 4 years ago
- Hugging Face RoBERTa with Flash Attention 2☆23Sep 14, 2025Updated last year
- Codes and Datasets for our SIGIR 2021 Paper: "Understanding the Role of Affect Dimensions in Detecting Emotions from Tweets: A Multi-task…☆12Apr 21, 2021Updated 5 years ago
- 诗云APP，一款寓教于乐的古诗词普及APP。☆11Oct 3, 2022Updated 4 years ago
- The data preprocessing code for FIREBALL☆10May 8, 2023Updated 3 years ago
- 基于Bert实现中文文本二分类☆30Mar 2, 2020Updated 6 years ago
- Seq2seq using LSTM with attention from Luong et al☆10Oct 2, 2018Updated 8 years ago
- This project uses YOLOv5, a state-of-the-art object detection model, to detect smoking in real-time video streams. The model is trained o…☆10Jan 29, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆34Oct 30, 2020Updated 6 years ago
- This is the repository for COLING 2022 paper "Context-Tuning: Learning Contextualized Prompts for Natural Language Generation".☆11Oct 16, 2022Updated 4 years ago
- Covid Doctor chatbot using DialoGPT☆13May 25, 2022Updated 4 years ago
- A list of Numerical Multimodal reasoning papers and their implementation☆11May 13, 2024Updated 2 years ago
- Implementation of Self-Governing Neural Networks for speech act classification☆12Jul 14, 2026Updated 3 months ago
- Source code for "Towards Hierarchical Importance Attribution: Explaining Compositional Semantics for Neural Sequence Models", ICLR 2020.☆29Jun 28, 2020Updated 6 years ago
- Python compiler that utilizes PLY and llvmlite☆12Apr 5, 2018Updated 8 years ago
- Source Code for "Teaching Machine Comprehension with Compositional Explanations" (Findings of EMNLP 2020)☆10Dec 12, 2020Updated 5 years ago
- Google DeepMind: Mixture of Depths Unofficial Implementation.☆12May 29, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- python programs and procedures that facilitate local application of the earth2observe global water resources reanalysis☆10Nov 21, 2017Updated 8 years ago
- ☆11Jan 2, 2022Updated 4 years ago
- Lite Self-Training☆30Jul 25, 2023Updated 3 years ago
- Code for paper Target-Guided Dialogue Response Generation Using Commonsense and Data Augmentation☆14Jun 10, 2022Updated 4 years ago
- Introduction page of a challenging text-to-SQL dataset: KaggleDBQA☆44Sep 20, 2023Updated 3 years ago
- ☆11Sep 27, 2021Updated 5 years ago
- ☆10Feb 21, 2024Updated 2 years ago
- 中译名著多译本翻译转述语料。语料仅限于用于科研教学活动。文本著作权归原著者。☆13Jul 26, 2018Updated 8 years ago
- Research on the Construction and Application of Paraphrase Parallel Corpus☆11Oct 26, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Implementation of "RankCSE: Unsupervised Sentence Representation Learning via Learning to Rank" (ACL 2023)☆49Mar 12, 2024Updated 2 years ago
- The dataset and code of XplainLLM paper☆14Sep 24, 2024Updated 2 years ago
- Papers and Related work to help learn ICL conveniently for everyone who interests.☆14Feb 28, 2024Updated 2 years ago
- ☆11Oct 9, 2022Updated 4 years ago
- A Python Package containing wrappers for topic models, including TND, NLDA, GTM, and temporal topic-noise models.☆12Apr 22, 2022Updated 4 years ago
- ☆26Aug 14, 2022Updated 4 years ago
- code for the table-based open domain question answering project, with paper title: "Reasoning over Hybrid Chain for Table-and-Text Open D…☆12Sep 16, 2022Updated 4 years ago