This repository contains the codes for pre-training a BERT-base model on a large, un-annotated corpus of text using dynamic Masked Language Modeling (MLM) and dynamic Next Sentence Prediction (NSP).
☆17Jun 19, 2023Updated 3 years ago
Alternatives and similar repositories for pretraining-bert
Users that are interested in pretraining-bert are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository contains the relevant materials for the tutorial "Legal IR and NLP: the History, Challenges, and State-of-the-Art", held …☆41Apr 6, 2023Updated 3 years ago
- Semantic Segmentation of Legal texts that labels sentences with one of 7 rhetorical roles.☆80Jun 19, 2024Updated 2 years ago
- Dataset and codes for the paper "LeSICiN: A Heterogeneous Graph-based Approach for Automatic Legal Statute Identification from Indian Leg…☆25Apr 20, 2024Updated 2 years ago
- OpenNyAI is a mission aimed at developing open source software and datasets to catalyze the creation of AI-powered solutions to improve a…☆44Apr 17, 2024Updated 2 years ago
- Code for the paper Factorizing Content and Budget Decisions in Abstractive Summarization of Long Documents: https://arxiv.org/abs/2205.12…☆12Feb 10, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Data Mining project☆10Jan 10, 2024Updated 2 years ago
- The first real-world FL benchmark for legal NLP☆14Nov 29, 2023Updated 2 years ago
- This repo is about the classification of rhetorical roles in Legal Documents such as: Citation, Findings of Fact, Evidence, Legal Rule, R…☆18Feb 22, 2022Updated 4 years ago
- ☆14Aug 20, 2024Updated 2 years ago
- A text summarizer using Seq2Seq model☆14Sep 7, 2021Updated 5 years ago
- ☆17Jan 29, 2025Updated last year
- Code for our PLOS ONE paper: "Predicting Human Decision Making in Psychological Tasks with Recurrent Neural Networks"☆12Jun 3, 2022Updated 4 years ago
- Emergency room simulator which is highly configurable and can simulate a broad range of scenarios. It can be used by medical professional…☆12Jan 5, 2021Updated 5 years ago
- ☆11Apr 22, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- How to link the DFPlayer MP3 player to an Arduino☆10May 20, 2018Updated 8 years ago
- Universe simulator reachable on your Windows PC.☆13Updated this week
- Analyse the self-attention patterns in BERT for humor classification and verify the linguistic theory of humor, use GPT-2 to create humor…☆11Apr 30, 2020Updated 6 years ago
- Основы геоинформатики: курс лекций☆10Aug 10, 2026Updated 2 months ago
- Behavior-driven tests for web applications. Use proven patterns for your test project. You can write the executable specifications in Cuc…☆19May 20, 2024Updated 2 years ago
- custom kubernetes scheduler for placing pods based on location data☆11Apr 7, 2023Updated 3 years ago
- React Component for china-location☆14Dec 6, 2022Updated 3 years ago
- Data and additional information regarding the paper: Contract Discovery. Dataset and a Few-Shot Semantic Retrieval Challenge with Competi…☆32Nov 12, 2020Updated 5 years ago
- ☆25May 5, 2022Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- In this repository, I will keep my all Deep Learning project implementations.☆12Nov 22, 2020Updated 5 years ago
- 中国行政区，省市区信息（含边界GPS坐标点）☆10Jun 25, 2019Updated 7 years ago
- Основы геоинформатики: практикум в ArcGIS☆10Mar 17, 2025Updated last year
- Walking Streets project☆15Sep 10, 2016Updated 10 years ago
- This repository provides a comprehensive guide to natural language processing. Whether you're a beginner looking to gain a solid understa…☆10Apr 29, 2024Updated 2 years ago
- GOST's combined tools for urban analysis☆14Oct 26, 2026Updated last week
- Source code of ME2Vec.☆14Jun 26, 2023Updated 3 years ago
- ☆18Dec 2, 2025Updated 11 months ago
- Website for the JuliaHealth organization (powered by Franklin.jl).☆14May 16, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- This is the repository for my 20 credit project during my final year at cardiff university. The project involves researching the best res…☆12Jun 15, 2018Updated 8 years ago
- AI@School - Wissen zu künstlicher Intelligenz spielerisch in die Schulen bringen☆15Jun 4, 2025Updated last year
- The repository encompasses a collection of my Artificial Intelligence project Notebook files, ranging from Machine Learning to Deep Lear…☆14Apr 14, 2024Updated 2 years ago
- This repository showcases my AI projects spanning Agentic AI, Generative AI, Deep Learning, Machine Learning, and Fintech - from autonomo…☆11Aug 12, 2025Updated last year
- Seminar Research Class at UTD for PhD students in Criminology☆14Feb 23, 2020Updated 6 years ago
- Geospatial Enabling Environments for Employment (GeoE3)☆12Updated this week
- Generate more expungements. Deliver more justice.☆15Aug 28, 2026Updated 2 months ago