Nano-BERT is a straightforward, lightweight and comprehensible custom implementation of BERT, inspired by the foundational "Attention is All You Need" paper. The primary objective of this project is to distill the essence of transformers by simplifying the complexities and unnecessary details.
☆21Oct 19, 2023Updated 2 years ago
Alternatives and similar repositories for nano-BERT
Users that are interested in nano-BERT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13May 7, 2023Updated 3 years ago
- (NBCE)Naive Bayes-based Context Extension on ChatGLM-6b☆15Jun 7, 2023Updated 3 years ago
- Java port of wolfgarbe/PruningRadixTrie☆16Jun 29, 2021Updated 5 years ago
- 中文纠错-使用拼音树及编辑距离☆13Jul 19, 2019Updated 7 years ago
- Collaborative inference of latent diffusion via hivemind☆12May 29, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Java JNI wrapper for KenLM: Faster and Smaller Language Model Queries☆15Oct 25, 2020Updated 5 years ago
- 总结等效焦距以及相机内参中fx的计算☆11Nov 18, 2020Updated 5 years ago
- Blog post☆17Feb 16, 2024Updated 2 years ago
- ☆13Oct 15, 2023Updated 2 years ago
- Word Embeddings for Low Resource Languages: The Case of Buryat☆10Mar 12, 2025Updated last year
- An implementation of the Equivariant Graph Neural Network (EGNN) layer type for DGL-PyTorch.☆15Dec 27, 2022Updated 3 years ago
- The Polaris datasets and benchmarks recipes☆15May 26, 2025Updated last year
- A bot for fighting the first Tree Sentinel in ELDEN RING☆20Jan 18, 2024Updated 2 years ago
- Building Blocks for Equivariant Neural Networks in e3nn and PyTorch 2.0☆22Nov 16, 2025Updated 10 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A stand-alone pure C++ library for linear algebra and machine learning☆10Mar 16, 2016Updated 10 years ago
- A custom Huggingface trainer which supports logging auxiliary losses returned by your model☆15Jul 27, 2025Updated last year
- Boolean Question Answering with multi-task learning and uses large LM embeddings like BERT, RoBERTa☆18Aug 30, 2019Updated 7 years ago
- CRF(Conditional Random Field) Layer for TensorFlow 1.X with many powerful functions☆15Jan 3, 2020Updated 6 years ago
- 2018/2019/校招/春招/秋招/算法/机器学习(Machine Learning)/深度学习(Deep Learning)/自然语言处理(NLP)/C/C++/Python/面试笔记☆13Oct 6, 2018Updated 7 years ago
- ☆17Feb 20, 2026Updated 7 months ago
- ☆14Jul 24, 2025Updated last year
- [Nature Communications] The implementation for the paper "An equivariant pretrained transformer for unified 3D molecular representation l…☆18Jun 25, 2026Updated 3 months ago
- A Qwen .5B reasoning model trained on OpenR1-Math-220k☆14Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Jax / Haiku implementation of DimeNet++.☆18Mar 31, 2022Updated 4 years ago
- This repo contains the software that was used to conduct the experiments reported in our article titled "Improving Named Entity Recogniti…☆20Dec 22, 2022Updated 3 years ago
- Adaptive tokenization for proteins☆22Mar 4, 2026Updated 6 months ago
- A new approach for the real time 3D semantic segmentation based on feature abstract and deep learning method☆16Nov 28, 2017Updated 8 years ago
- Minimalistic, hackable PyTorch implementation of SimSiam in ~400 lines. Achieves good performance on ImageNet with ResNet50. Features dis…☆22Nov 25, 2024Updated last year
- ☆14Aug 28, 2016Updated 10 years ago
- Gradio Client in Rust.☆31Sep 8, 2026Updated 2 weeks ago
- Official implementation for paper: Sampling 3D Molecular Conformers with Diffusion Transformers (NeurIPS 2025)☆20Feb 3, 2026Updated 7 months ago
- SIMD instructions for faster distance calculations.☆25Apr 7, 2026Updated 5 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Framework for modified sampling from biomolecular generative models☆28Updated this week
- [ICML'25] The Price of Freedom: Exploring Expressivity and Runtime Tradeoffs in Equivariant Tensor Products☆19Jul 16, 2025Updated last year
- MESS: Modern Electronic Structure Simulations☆21Sep 24, 2024Updated 2 years ago
- Expert-Curated Oncology Reports to Advance Language Model Inference☆34Apr 17, 2024Updated 2 years ago
- QuintNet is a research-oriented PyTorch framework designed to explore and implement multi-dimensional parallelism strategies for distribu…☆19Feb 3, 2026Updated 7 months ago
- Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding (Findings of EMNLP'23)☆11Aug 24, 2024Updated 2 years ago
- Fully-Differentiable Tensor Spherical Harmonics in JAX☆22Apr 11, 2026Updated 5 months ago