Pre-train BERT from scratch, with HuggingFace. Accompanies the blog post: sidsite.com/posts/bert-from-scratch
☆43May 20, 2025Updated 9 months ago
Alternatives and similar repositories for pretraining-BERT
Users that are interested in pretraining-BERT are comparing it to the libraries listed below
Sorting:
- A single-line modification to any (dualizer-based) optimizer that allows the optimizer to adapt to the scale of the gradients as they cha…☆19Jan 11, 2025Updated last year
- A large-image collection explorer and fast classification tool☆24Jul 12, 2022Updated 3 years ago
- ☆26Sep 3, 2024Updated last year
- ☆26Apr 14, 2024Updated last year
- Official repository for Characterization of tumor heterogeneity through segmentation-free representation learning on multiplexed imaging …☆14Sep 28, 2025Updated 5 months ago
- DOSY processing☆10Mar 11, 2022Updated 3 years ago
- Benchmarking of 1D pattern classification networks☆10Jul 19, 2023Updated 2 years ago
- Vintage Typography with Web Fonts☆14Dec 22, 2015Updated 10 years ago
- Kinematic and dynamic models of continuum and articulated soft robots.☆15Nov 22, 2025Updated 3 months ago
- RATransformers 🐭- Make your transformer (like BERT, RoBERTa, GPT-2 and T5) Relation Aware!☆42Dec 14, 2022Updated 3 years ago
- Tree-Invent: A novel molecular generative model constrained with topological tree☆13Jul 26, 2023Updated 2 years ago
- RealTime Motion Capture Toolbox for Matlab☆10Apr 11, 2016Updated 9 years ago
- ☆16Dec 31, 2019Updated 6 years ago
- SPA: Efficient User-Preference Alignment against Uncertainty in Medical Image Segmentation (ICCV 2025)☆14Sep 26, 2025Updated 5 months ago
- MATLAB function to fill an area with hatching ~~or speckling~~☆11Mar 4, 2018Updated 8 years ago
- A tree view component for Vue 3.☆12Feb 18, 2026Updated 2 weeks ago
- ☆11Apr 10, 2022Updated 3 years ago
- Fundamentals public repo☆12Updated this week
- R functions for automation of biomarker discovery based on processing downstream of large LC-MS datasets from any peak picking software☆10May 17, 2017Updated 8 years ago
- ☆10Jun 4, 2020Updated 5 years ago
- ☆11Nov 10, 2020Updated 5 years ago
- Autonomous and accurate clustering of co-localized ion images in a self-supervised manner.☆11Dec 22, 2021Updated 4 years ago
- This jupyter notebook is part of the lecture "Data Science for Raman spectroscopy" imparted by Nicolás Coca-López during the Hands-on Wor…☆13Jan 15, 2023Updated 3 years ago
- From the medium article about Customer Retention☆11Nov 20, 2019Updated 6 years ago
- Code for the paper "Faster Neural Network Training with Approximate Tensor Operations"☆10Oct 23, 2021Updated 4 years ago
- An artificial matrix generator in C☆12Feb 16, 2023Updated 3 years ago
- ☆12Feb 26, 2026Updated last week
- This repo contains demonstrations of an extensible Crystal Structure Type Recognition Network (CSTRNet), which consists of a variable num…☆12May 21, 2024Updated last year
- ☆14Apr 14, 2025Updated 10 months ago
- This package is archived and further developed under the name RFSurrogates. In this R-package functions are provided to select important …☆11Jul 27, 2023Updated 2 years ago
- Hindi stardict dicts☆10Jan 14, 2026Updated last month
- CPRD Aurum codelists from the Exeter Diabetes team☆17Feb 24, 2026Updated last week
- A framework for steering MoE models by detecting and controlling behavior-linked experts.☆29Sep 12, 2025Updated 5 months ago
- Simple method used to load configuration variables from different sources.☆10Jun 20, 2018Updated 7 years ago
- using AI model to infer patient phenotypes from identified named entities (instances of biomedical concepts)☆10Jan 13, 2023Updated 3 years ago
- BERT Sentiment Classification on the IMDb Large Movie Review Dataset.☆16Sep 8, 2022Updated 3 years ago
- ☆14Mar 6, 2022Updated 4 years ago
- A notebook for the talk about Modern Pandas☆11Mar 16, 2020Updated 5 years ago
- Tools to be used within AWS☆13Jun 3, 2021Updated 4 years ago