Nano-BERT is a straightforward, lightweight and comprehensible custom implementation of BERT, inspired by the foundational "Attention is All You Need" paper. The primary objective of this project is to distill the essence of transformers by simplifying the complexities and unnecessary details.
☆21Oct 19, 2023Updated 2 years ago
Alternatives and similar repositories for nano-BERT
Users that are interested in nano-BERT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TheGlueNote is representation model for note-wise music alignment.☆14Jul 19, 2024Updated 2 years ago
- Detect solfege hand signs using machine learning ✋ 🎹☆16Nov 2, 2021Updated 4 years ago
- A web-based template for hosting systems for real-time music HCI.☆14Jul 6, 2024Updated 2 years ago
- Official code of "N-Gram Unsupervised Compoundation and Feature Injection for Better Symbolic Music Understanding"☆14Apr 10, 2024Updated 2 years ago
- [𝗜𝗖𝗠𝗟 𝟮𝟬𝟮𝟲] Dispersion loss counteracts embedding condensation and improves generalization in small language models☆21May 21, 2026Updated 4 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Metrics for assessing 3D molecular structures.☆11May 9, 2026Updated 5 months ago
- A Unified 3D Generative Model for Synthesizable Structure-Based Drug Design.☆98Oct 10, 2026Updated last week
- Collaborative inference of latent diffusion via hivemind☆12May 29, 2023Updated 3 years ago
- 🎹 App desktop gratuito para aprender piano — análise MIDI em tempo real, detecção de acordes, modo prática com feedback de timing. Free …☆21Oct 1, 2026Updated 2 weeks ago
- PianoCoRe: Combined and Refined Piano MIDI Dataset (TISMIR)☆30May 8, 2026Updated 5 months ago
- Code for the paper "Transcribing Human Piano Performances into Music Notation" accepted at ISMIR 2016☆16Jan 24, 2018Updated 8 years ago
- CQT-DTW Score Follower☆17Sep 24, 2022Updated 4 years ago
- Blog post☆17Feb 16, 2024Updated 2 years ago
- The Harmonic Memory☆20Oct 18, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆13Oct 15, 2023Updated 3 years ago
- An implementation of the Equivariant Graph Neural Network (EGNN) layer type for DGL-PyTorch.☆15Dec 27, 2022Updated 3 years ago
- Code for the paper "Secure Distributed Training at Scale" (ICML 2022)☆16Feb 4, 2025Updated last year
- SyMuPe: Affective and Controllable Symbolic Music Performance (ACM MM '25, Outstanding Paper Award)☆28May 8, 2026Updated 5 months ago
- Russian dialog datasets parsers and crawlers.☆15Sep 6, 2021Updated 5 years ago
- Boolean Question Answering with multi-task learning and uses large LM embeddings like BERT, RoBERTa☆18Aug 30, 2019Updated 7 years ago
- A custom Huggingface trainer which supports logging auxiliary losses returned by your model☆15Jul 27, 2025Updated last year
- ☆14Jul 24, 2025Updated last year
- [Nature Communications] The implementation for the paper "An equivariant pretrained transformer for unified 3D molecular representation l…☆18Jun 25, 2026Updated 3 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A Qwen .5B reasoning model trained on OpenR1-Math-220k☆14Updated this week
- ☆17Oct 8, 2026Updated last week
- Improving Neural Text Generation with Reinforcement Learning☆23Jan 13, 2021Updated 5 years ago
- Batched optimisation algorithms for neural network potential driven molecular dynamics.☆17Nov 27, 2025Updated 10 months ago
- Interactive ML Toolset☆17Jun 17, 2024Updated 2 years ago
- Jax / Haiku implementation of DimeNet++.☆18Mar 31, 2022Updated 4 years ago
- CASP15 performance benchmarking of the state-of-the-art protein structure prediction methods☆16Dec 13, 2023Updated 2 years ago
- Main repository for Smoosic, the music notation and playback library written in typescript☆32Updated this week
- Scripts for the creation of CryptoBench, a new dataset of cryptic binding sites☆23Jun 24, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The source code used for paper "Unsupervised Key Event Detection from Massive Text Corpora", published in KDD 2022.☆21Jul 15, 2023Updated 3 years ago
- Bridging Smoothed Molecular Dynamics and Score-Based Learning for Conformational Ensembles☆22May 16, 2026Updated 5 months ago
- Adaptive tokenization for proteins☆22Mar 4, 2026Updated 7 months ago
- An expressive accompaniment system for piano performances☆29Sep 22, 2026Updated 3 weeks ago
- Minimalistic, hackable PyTorch implementation of SimSiam in ~400 lines. Achieves good performance on ImageNet with ResNet50. Features dis…☆23Nov 25, 2024Updated last year
- Expert-Curated Oncology Reports to Advance Language Model Inference☆34Apr 17, 2024Updated 2 years ago
- Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding (Findings of EMNLP'23)☆11Aug 24, 2024Updated 2 years ago