This repository contains the codes for pre-training a BERT-base model on a large, un-annotated corpus of text using dynamic Masked Language Modeling (MLM) and dynamic Next Sentence Prediction (NSP).
☆17Jun 19, 2023Updated 3 years ago
Alternatives and similar repositories for pretraining-bert
Users that are interested in pretraining-bert are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Dataset and codes for the paper "LeSICiN: A Heterogeneous Graph-based Approach for Automatic Legal Statute Identification from Indian Leg…☆25Apr 20, 2024Updated 2 years ago
- This repository contains the relevant materials for the tutorial "Legal IR and NLP: the History, Challenges, and State-of-the-Art", held …☆41Apr 6, 2023Updated 3 years ago
- OpenNyAI is a mission aimed at developing open source software and datasets to catalyze the creation of AI-powered solutions to improve a…☆44Apr 17, 2024Updated 2 years ago
- LAReQA is a challenging benchmark for evaluating language agnostic answer retrieval from a multilingual candidate pool. This repository c…☆14May 19, 2020Updated 6 years ago
- The first real-world FL benchmark for legal NLP☆14Nov 29, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆16Mar 2, 2024Updated 2 years ago
- This repo is about the classification of rhetorical roles in Legal Documents such as: Citation, Findings of Fact, Evidence, Legal Rule, R…☆18Feb 22, 2022Updated 4 years ago
- An SDK and Library that is used in several Deutsche Telekom mobile apps☆12Sep 23, 2024Updated 2 years ago
- A text summarizer using Seq2Seq model☆14Sep 7, 2021Updated 5 years ago
- English-French MT dialogue dataset☆17Apr 29, 2022Updated 4 years ago
- Matrix digital rain in P5.JS & Canvas☆11Sep 22, 2019Updated 7 years ago
- Analyse the self-attention patterns in BERT for humor classification and verify the linguistic theory of humor, use GPT-2 to create humor…☆11Apr 30, 2020Updated 6 years ago
- ☆17Jan 29, 2025Updated last year
- DeepDip, a DRL Gym agent that plays no-press Diplomacy in BANDANA☆13Jul 22, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11Feb 25, 2020Updated 6 years ago
- Talking Avatar: create video from plain text or audio file in minutes, support up to 100+ languages and 350+ voice models.☆14Nov 16, 2022Updated 3 years ago
- How to link the DFPlayer MP3 player to an Arduino☆10May 20, 2018Updated 8 years ago
- POSIX: A Prompt Sensitivity Index for Language Models☆13Nov 13, 2024Updated last year
- 中国行政区，省市区信息（含边界GPS坐标点）☆10Jun 25, 2019Updated 7 years ago
- custom kubernetes scheduler for placing pods based on location data☆11Apr 7, 2023Updated 3 years ago
- GOST's combined tools for urban analysis☆13Updated this week
- React Component for china-location☆14Dec 6, 2022Updated 3 years ago
- ☆11Apr 22, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Pipeline for building Machine Learning Classifiers for the diagnosis of EHR text-data. We used this pipeline for our study, published her…☆12Jul 6, 2023Updated 3 years ago
- Website for the JuliaHealth organization (powered by Franklin.jl).☆14May 16, 2025Updated last year
- Walking Streets project☆15Sep 10, 2016Updated 10 years ago
- Generation of a planet through plate tectonics and simulation of weather, climate, and ocean currents.☆14Feb 16, 2023Updated 3 years ago
- Machine Learning Toolbox 2☆13Nov 22, 2025Updated 10 months ago
- Source code of ME2Vec.☆14Jun 26, 2023Updated 3 years ago
- ☆17Dec 2, 2025Updated 9 months ago
- With the phonenumber-normalizer library, you can normalize phone numbers to the E164 format and national format, even if national destina…☆24Jul 11, 2026Updated 2 months ago
- Black for Python docstrings and reStructuredText (rst).☆18Apr 7, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Seminar Research Class at UTD for PhD students in Criminology☆14Feb 23, 2020Updated 6 years ago
- Generate more expungements. Deliver more justice.☆15Aug 28, 2026Updated 3 weeks ago
- Iron Seed is a science-fiction DOS game from 1994, which was both developed and published by Channel 7. Gameplay is real-time, featuring…☆14Mar 15, 2025Updated last year
- Android App to display the geological time scale of the Earth's history.☆20Feb 18, 2025Updated last year
- Notes for learning and applying R to questions about crime and the justice system☆22Aug 24, 2026Updated 3 weeks ago
- Text summation using python, deep learning, machine learning, transformer, huggingface, openai and langchain☆13Nov 26, 2024Updated last year
- Web application for call center realtime monitoring (back and front end)☆15Jan 13, 2019Updated 7 years ago