This repository contains the codes for pre-training a BERT-base model on a large, un-annotated corpus of text using dynamic Masked Language Modeling (MLM) and dynamic Next Sentence Prediction (NSP).
☆17Jun 19, 2023Updated 3 years ago
Alternatives and similar repositories for pretraining-bert
Users that are interested in pretraining-bert are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Identifying charges from the Indian Penal Code given the textual description of the charges and facts of a criminal case☆28Feb 1, 2023Updated 3 years ago
- Dataset and codes for the paper "LeSICiN: A Heterogeneous Graph-based Approach for Automatic Legal Statute Identification from Indian Leg…☆25Apr 20, 2024Updated 2 years ago
- This repository contains the relevant materials for the tutorial "Legal IR and NLP: the History, Challenges, and State-of-the-Art", held …☆41Apr 6, 2023Updated 3 years ago
- Data Mining project☆10Jan 10, 2024Updated 2 years ago
- OpenNyAI is a mission aimed at developing open source software and datasets to catalyze the creation of AI-powered solutions to improve a…☆44Apr 17, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code for the paper Factorizing Content and Budget Decisions in Abstractive Summarization of Long Documents: https://arxiv.org/abs/2205.12…☆12Feb 10, 2024Updated 2 years ago
- The first real-world FL benchmark for legal NLP☆14Nov 29, 2023Updated 2 years ago
- Thesis template for IIT Hyderabad.☆14May 9, 2023Updated 3 years ago
- Analyse the self-attention patterns in BERT for humor classification and verify the linguistic theory of humor, use GPT-2 to create humor…☆11Apr 30, 2020Updated 6 years ago
- ☆17Jan 29, 2025Updated last year
- DeepDip, a DRL Gym agent that plays no-press Diplomacy in BANDANA☆13Jul 22, 2019Updated 7 years ago
- Code for our PLOS ONE paper: "Predicting Human Decision Making in Psychological Tasks with Recurrent Neural Networks"☆13Jun 3, 2022Updated 4 years ago
- How to link the DFPlayer MP3 player to an Arduino☆10May 20, 2018Updated 8 years ago
- GOST's combined tools for urban analysis☆13Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- React Component for china-location☆14Dec 6, 2022Updated 3 years ago
- ☆24May 5, 2022Updated 4 years ago
- In this repository, I will keep my all Deep Learning project implementations.☆11Nov 22, 2020Updated 5 years ago
- Pipeline for building Machine Learning Classifiers for the diagnosis of EHR text-data. We used this pipeline for our study, published her…☆12Jul 6, 2023Updated 3 years ago
- Data and additional information regarding the paper: Contract Discovery. Dataset and a Few-Shot Semantic Retrieval Challenge with Competi…☆32Nov 12, 2020Updated 5 years ago
- Website for the JuliaHealth organization (powered by Franklin.jl).☆14May 16, 2025Updated last year
- Walking Streets project☆15Sep 10, 2016Updated 9 years ago
- Generation of a planet through plate tectonics and simulation of weather, climate, and ocean currents.☆14Feb 16, 2023Updated 3 years ago
- Machine Learning Toolbox 2☆13Nov 22, 2025Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An online adaptation of The Republic of Rome, a strategy board game☆14Jul 21, 2026Updated 3 weeks ago
- Source code of ME2Vec.☆14Jun 26, 2023Updated 3 years ago
- This is the repository for my 20 credit project during my final year at cardiff university. The project involves researching the best res…☆12Jun 15, 2018Updated 8 years ago
- AI@School - Wissen zu künstlicher Intelligenz spielerisch in die Schulen bringen☆15Jun 4, 2025Updated last year
- A spaceflight simulator☆18Sep 12, 2017Updated 8 years ago
- Seminar Research Class at UTD for PhD students in Criminology☆14Feb 23, 2020Updated 6 years ago
- Generate more expungements. Deliver more justice.☆15Jul 28, 2026Updated 2 weeks ago
- Scanner event monitor for web-based scanning of PDF417 barcodes in healthcare setting☆18Apr 11, 2023Updated 3 years ago
- Network Management Protocols for Mountebank☆13Oct 13, 2025Updated 10 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- COBS: COmprehensive Building Simulator☆16Jun 23, 2022Updated 4 years ago
- Iron Seed is a science-fiction DOS game from 1994, which was both developed and published by Channel 7. Gameplay is real-time, featuring…☆14Mar 15, 2025Updated last year
- Android App to display the geological time scale of the Earth's history.☆20Feb 18, 2025Updated last year
- Notes for learning and applying R to questions about crime and the justice system☆22Aug 5, 2026Updated last week
- Reinforcement learning approach to the prisoner's dilemma, based on Q learning☆13Dec 1, 2017Updated 8 years ago
- A large scale simulation which pits millions of space ships against each other in a virtual universe all running directly in SingleStore.☆22Mar 12, 2024Updated 2 years ago
- Charlson Comorbidity Index Regression using Clinical Notes☆10Jul 26, 2018Updated 8 years ago