This repository contains the codes for pre-training a BERT-base model on a large, un-annotated corpus of text using dynamic Masked Language Modeling (MLM) and dynamic Next Sentence Prediction (NSP).
☆17Jun 19, 2023Updated 3 years ago
Alternatives and similar repositories for pretraining-bert
Users that are interested in pretraining-bert are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Semantic Segmentation of Legal texts that labels sentences with one of 7 rhetorical roles.☆80Jun 19, 2024Updated 2 years ago
- Dataset and codes for the paper "LeSICiN: A Heterogeneous Graph-based Approach for Automatic Legal Statute Identification from Indian Leg…☆25Apr 20, 2024Updated 2 years ago
- This repository contains the relevant materials for the tutorial "Legal IR and NLP: the History, Challenges, and State-of-the-Art", held …☆41Apr 6, 2023Updated 3 years ago
- Data Mining project☆10Jan 10, 2024Updated 2 years ago
- Code for DELSumm, an unsupervised summarization algorithm for legal case judgements.☆32Oct 18, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- OpenNyAI is a mission aimed at developing open source software and datasets to catalyze the creation of AI-powered solutions to improve a…☆44Apr 17, 2024Updated 2 years ago
- Code for the paper Factorizing Content and Budget Decisions in Abstractive Summarization of Long Documents: https://arxiv.org/abs/2205.12…☆12Feb 10, 2024Updated 2 years ago
- The first real-world FL benchmark for legal NLP☆14Nov 29, 2023Updated 2 years ago
- Thesis template for IIT Hyderabad.☆14May 9, 2023Updated 3 years ago
- Matrix digital rain in P5.JS & Canvas☆11Sep 22, 2019Updated 7 years ago
- Analyse the self-attention patterns in BERT for humor classification and verify the linguistic theory of humor, use GPT-2 to create humor…☆11Apr 30, 2020Updated 6 years ago
- ☆17Jan 29, 2025Updated last year
- Code for our PLOS ONE paper: "Predicting Human Decision Making in Psychological Tasks with Recurrent Neural Networks"☆13Jun 3, 2022Updated 4 years ago
- Behavior-driven tests for web applications. Use proven patterns for your test project. You can write the executable specifications in Cuc…☆19May 20, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- How to link the DFPlayer MP3 player to an Arduino☆10May 20, 2018Updated 8 years ago
- Atomic State is a state management library for React☆21Jan 29, 2026Updated 8 months ago
- ☆25May 5, 2022Updated 4 years ago
- New York City street maps from the New York Public Library — grouped by decade☆16Jul 25, 2026Updated 2 months ago
- ☆11Apr 22, 2024Updated 2 years ago
- Data and additional information regarding the paper: Contract Discovery. Dataset and a Few-Shot Semantic Retrieval Challenge with Competi…☆32Nov 12, 2020Updated 5 years ago
- Walking Streets project☆15Sep 10, 2016Updated 10 years ago
- Website for the JuliaHealth organization (powered by Franklin.jl).☆14May 16, 2025Updated last year
- Machine Learning Toolbox 2☆13Nov 22, 2025Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An online adaptation of The Republic of Rome, a strategy board game☆14Oct 7, 2026Updated last week
- This is the repository for my 20 credit project during my final year at cardiff university. The project involves researching the best res…☆12Jun 15, 2018Updated 8 years ago
- With the phonenumber-normalizer library, you can normalize phone numbers to the E164 format and national format, even if national destina…☆24Jul 11, 2026Updated 3 months ago
- Black for Python docstrings and reStructuredText (rst).☆18Apr 7, 2023Updated 3 years ago
- Generate more expungements. Deliver more justice.☆15Aug 28, 2026Updated last month
- Network Management Protocols for Mountebank☆13Oct 13, 2025Updated last year
- COBS: COmprehensive Building Simulator☆16Jun 23, 2022Updated 4 years ago
- Iron Seed is a science-fiction DOS game from 1994, which was both developed and published by Channel 7. Gameplay is real-time, featuring…☆14Mar 15, 2025Updated last year
- Android App to display the geological time scale of the Earth's history.☆20Feb 18, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Text summation using python, deep learning, machine learning, transformer, huggingface, openai and langchain☆13Nov 26, 2024Updated last year
- R package for delineating temporal dataset shifts in Eletronic Health Records☆17Apr 28, 2026Updated 5 months ago
- A large scale simulation which pits millions of space ships against each other in a virtual universe all running directly in SingleStore.☆22Mar 12, 2024Updated 2 years ago
- Charlson Comorbidity Index Regression using Clinical Notes☆10Jul 26, 2018Updated 8 years ago
- An R package to run Spatial Point Pattern Tests☆15Oct 11, 2020Updated 6 years ago
- Implementation of Fast Reactive Control for Illumination Through Rain and Snow (de Charette et al., 2012)☆12Oct 29, 2024Updated last year
- This repository contains links to different Law-AI resources such as datasets and tools.☆19Jan 12, 2023Updated 3 years ago