Pre-train BERT from scratch, with HuggingFace. Accompanies the blog post: sidsite.com/posts/bert-from-scratch
☆45May 20, 2025Updated last year
Alternatives and similar repositories for pretraining-BERT
Users that are interested in pretraining-BERT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆26Sep 3, 2024Updated 2 years ago
- ☆14Mar 28, 2025Updated last year
- Research code and data evaluating GPT-4 on the Uniform Bar Examination and comparing its performance with people and earlier models.☆29Dec 19, 2023Updated 2 years ago
- Modular and simple vision language navigation framework☆12Aug 16, 2021Updated 5 years ago
- Feature resources of "Diagnosing the Environment Bias in Vision-and-Language Navigation"☆16May 6, 2020Updated 6 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Repository of the RANLP 2023 paper "Exploring the Landscape of Natural Language Processing Research".☆13Oct 20, 2024Updated last year
- codes and plots for "Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs"☆11Dec 30, 2024Updated last year
- Jupyter notebooks from our weekly (or so) hackathons☆11Dec 3, 2024Updated last year
- JAX implementation of the T5 model: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer☆24Jun 10, 2023Updated 3 years ago
- ☆16Feb 3, 2018Updated 8 years ago
- ☆16Apr 26, 2023Updated 3 years ago
- Code for Semi-crowdsourced Clustering with Deep Generative Models☆12Dec 9, 2022Updated 3 years ago
- Code accompanying VarGrad: A Low-Variance Gradient Estimator for Variational Inference☆12Oct 12, 2020Updated 5 years ago
- A large-image collection explorer and fast classification tool☆24Jul 12, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Make FP4 on 5090 Great Again☆24Jul 20, 2026Updated last month
- [COLM 2026] An efficient 3D sampling method for long-CoT LLM.☆16May 25, 2025Updated last year
- Posterior with interesting shapes from actually used models☆13Feb 10, 2025Updated last year
- ☆11Jul 25, 2021Updated 5 years ago
- Tree-Invent: A novel molecular generative model constrained with topological tree☆14Jul 26, 2023Updated 3 years ago
- PyTorch utilities for ML, specifically speech☆13Jan 30, 2024Updated 2 years ago
- An automatic Gaussian process classifier.☆13May 28, 2016Updated 10 years ago
- Userspace USB driver for CAN to USB adapters - based on the Kvaser canlib API☆19Feb 22, 2020Updated 6 years ago
- ☆18Nov 23, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- An implementation of Squared Earth-Mover's Distance loss for Neural Networks.☆14Mar 25, 2023Updated 3 years ago
- An attempt to create a free PROFINET daemon☆15Oct 24, 2018Updated 7 years ago
- ☆12Apr 20, 2023Updated 3 years ago
- Mini Model Daemon☆13Nov 9, 2024Updated last year
- ☆19Sep 20, 2023Updated 2 years ago
- Python interface for Enhanced Monte Carlo (EMC)☆25Aug 31, 2026Updated last week
- Development of High-Throughput Polymer Network Atomistic Simulation☆33Aug 31, 2026Updated last week
- Approximate Bayesian Inference Toolkit (Python, C++)☆14Apr 16, 2014Updated 12 years ago
- code supplement for variational boosting (https://arxiv.org/abs/1611.06585)☆11Jul 24, 2017Updated 9 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆13Aug 15, 2024Updated 2 years ago
- Scalable In-Memory Acceleration With Mesh: Device, Circuits, Architecture, and Algorithm☆15Oct 11, 2020Updated 5 years ago
- ☆19Sep 6, 2025Updated last year
- C++ implementation for Sequence Pair fixed-outline chip floorplanner☆12Dec 27, 2022Updated 3 years ago
- Design, verification and ASIC implementation of a complete RISC-V CPU with: five stages pipeline, forwarding, automatic hazard detection,…☆17Apr 12, 2020Updated 6 years ago
- MeTube browser extension for send links of youtube videos from context menu☆29May 16, 2026Updated 3 months ago
- Learning to Skip the Middle Layers of Transformers☆17Aug 7, 2025Updated last year