pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch implementation of other Hierarchical Methods (Mean Pooling and Max Pooling) and Truncation Methods (Head Only and Tail Only) presented in this paper https://arxiv.org/abs/1905.05583
☆82Oct 26, 2022Updated 3 years ago
Alternatives and similar repositories for RoBERT_Recurrence_over_BERT
Users that are interested in RoBERT_Recurrence_over_BERT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Finetune multiple pre-trained Transformer-based models to solve Vietnamese Fake News Detection problem (ReINTEL) in VLSP2020 shared task☆18Dec 16, 2020Updated 5 years ago
- Using BERT for long sentence classification (more than 512 word pieces).☆17May 9, 2021Updated 5 years ago
- Hierarchical-Attention-Network☆47Dec 8, 2022Updated 3 years ago
- The source code of NeurIPS 2020 paper "CogLTX: Applying BERT to Long Texts"☆273May 17, 2022Updated 4 years ago
- Document Classification on COVID-19 Literature using the LitCovid collection and the Hedwig library.☆16Oct 26, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Repository for "Condolence and Empathy in Online Communities", EMNLP 2020☆10Nov 9, 2020Updated 5 years ago
- Dynamic ensemble decoding with transformer-based models☆29Jun 12, 2023Updated 3 years ago
- ☆41Sep 2, 2021Updated 4 years ago
- ☆29Apr 15, 2023Updated 3 years ago
- A repository of example implementations for interesting ml concepts☆29Jan 9, 2023Updated 3 years ago
- ☆16Apr 6, 2025Updated last year
- Trials of pre-trained BERT models for the medical domain in Japanese.☆13Nov 21, 2020Updated 5 years ago
- ☆28Dec 11, 2025Updated 6 months ago
- BERT-based Biomedical Text Summarizer☆24Oct 2, 2019Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Word embeddings trained on medical subreddits.☆10Jan 4, 2021Updated 5 years ago
- [EMNLP 2021] PyTorch Implementation of Contrastive Domain Adaptation for Question Answering using Limited Text Corpora☆14Jul 4, 2023Updated 2 years ago
- ☆13Jul 26, 2023Updated 2 years ago
- Testing the consistency of binary classification performance scores reported in papers☆12Aug 21, 2025Updated 9 months ago
- Convert pretrained RoBerta models to various long-document transformer models☆11Apr 5, 2022Updated 4 years ago
- GisPy: A Tool for Measuring Gist Inference Score in Text https://aclanthology.org/2022.wnu-1.5/☆13Jul 1, 2024Updated last year
- Obtain emails using the LinkedIn Graph API☆11Oct 1, 2025Updated 8 months ago
- mul-BERT, the official score on the SemEval 2010 Task 8 dataset is up to 90.72 (Macro-F1).☆16Jan 11, 2021Updated 5 years ago
- A Generative Adversarial Network for Shakuhachi Music☆14Jul 2, 2019Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A fine-tuned BERT using EHR notes.☆14Sep 12, 2019Updated 6 years ago
- 🏆🏅 Repository for the GEB team's winning solutions in the IEEE Hybrid Energy Forecasting and Trading Competition (HEFTCom).☆28Oct 4, 2025Updated 8 months ago
- AvatarShield: Visual Reinforcement Learning for Human-Centric Video Forgery Detection☆23Jun 3, 2025Updated last year
- Patient Code & Text Representation Learning☆19May 22, 2023Updated 3 years ago
- Three-level Hierarchical Transformer Networks for Long-sequence and Multiple Clinical Documents Classification☆11Apr 7, 2022Updated 4 years ago
- ☆10Jun 23, 2018Updated 7 years ago
- We attempt to do few shot learning with BERT and prototypical network for Intent classification☆22Jun 27, 2020Updated 5 years ago
- EMNLP 2021 - Frustratingly Simple Pretraining Alternatives to Masked Language Modeling☆34Nov 21, 2021Updated 4 years ago
- A PyTorch implementation of "Graph Convolutional Networks for Text Classification." (AAAI 2019)☆129Jun 27, 2020Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Collection of Twitter-related helper functions for python.☆14Feb 24, 2026Updated 3 months ago
- Chain-of-thought 방식을 활용하여 llama2를 fine-tuning☆10Nov 18, 2023Updated 2 years ago
- A short tutorial on Keras for the co-utilization of audio and text data (multi-modal analysis)☆16Nov 21, 2022Updated 3 years ago
- Enhanced GPUstat-web☆10Oct 2, 2020Updated 5 years ago
- Parallel support implementation of "aggregated residual transformations for deep neural networks" using keras☆12Mar 3, 2021Updated 5 years ago
- Research project on glyph-based Chinese character embedding. Preparing for EMNLP 2019☆11Mar 18, 2019Updated 7 years ago
- Longformer: The Long-Document Transformer☆2,196Feb 8, 2023Updated 3 years ago