nawnoes/pytorch-transformer-from-scratch external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

nawnoes/pytorch-transformer-from-scratch

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/nawnoes/pytorch-transformer-from-scratch)

Close

nawnoes / pytorch-transformer-from-scratchView on GitHubMore

• External links
• Readme badge

PyTorch Transformer from scratch: BERT, ELECTRA pretraining, and Ko→En translation.

☆55Jan 12, 2026Updated 9 months ago

Alternatives and similar repositories for pytorch-transformer-from-scratch

Users that are interested in pytorch-transformer-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• coverist / coverist-android

  View on GitHub
  커버리스트 - 북 커버 생성 AI 서비스
  ☆13Sep 11, 2022Updated 4 years ago
• Senitf / CafeOrderNLP

  View on GitHub
  GPT2 와 Bert 를 이용한 비대면 카페 주문 챗봇
  ☆10Jul 10, 2021Updated 5 years ago
• AIRC-KETI / long-ke-t5

  View on GitHub
  ☆13Jul 31, 2023Updated 3 years ago
• koalanlp / python-support

  View on GitHub
  Python wrapper for KoalaNLP (Korean NLP with Java/Scala)
  ☆31Jan 20, 2026Updated 9 months ago
• donguk071 / SADM

  View on GitHub
  [NeurIPS 2025] Dataset Distillation of 3D Point Clouds via Distribution Matching
  ☆14May 13, 2026Updated 5 months ago
• Virtual machines for every use case on DigitalOcean • Ad
  Get dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
• nawnoes / reformer-language-model

  View on GitHub
  Reformer Language Model
  ☆23Jan 12, 2026Updated 9 months ago
• bjpublic / DeepLearningProject

  View on GitHub
  파이토치 딥러닝 프로젝트 모음집
  ☆37Dec 18, 2022Updated 3 years ago
• asappresearch / dynamic-classification

  View on GitHub
  Code from the paper: "Metric Learning for Dynamic Text Classification"
  ☆12May 1, 2020Updated 6 years ago
• SKplanet / Dialog-KoELECTRA

  View on GitHub
  ELECTRA기반 한국어 대화체 언어모델
  ☆54Aug 4, 2021Updated 5 years ago
• seujung / t5-summarization

  View on GitHub
  ☆25Oct 28, 2020Updated 6 years ago
• hkjeon13 / noising-korean

  View on GitHub
  한국어 문서에 노이즈를 추가합니다.
  ☆27Nov 9, 2022Updated 3 years ago
• seujung / kolang-t5-base

  View on GitHub
  T5-base model for Korean
  ☆27May 20, 2021Updated 5 years ago
• maxxxzdn / eegVAE

  View on GitHub
  Variational Inference on EEG data
  ☆10Jun 7, 2022Updated 4 years ago
• BM-K / Styling-Chatbot-with-Transformer

  View on GitHub
  Language Style과 감정에 따른 챗봇 답변 변화 모델
  ☆33Aug 17, 2021Updated 5 years ago
• Proton VPN Special Offer - Get 70% off • Ad
  Special partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
• Yeachan-Heo / HSC2021-AlphaSolar

  View on GitHub
  ☆14Jun 11, 2021Updated 5 years ago
• eagle705 / awesome-nlp-note

  View on GitHub
  A curated list of resources dedicated to NLP (paper, blogs, note and etc)
  ☆13Nov 30, 2019Updated 6 years ago
• yseokchoi / SejongTree2Dependency

  View on GitHub
  세종 구문 분석 말뭉치의 의존 구문 구조로의 변환 도구
  ☆10Sep 7, 2018Updated 8 years ago
• hyunwoongko / nlp-datasets

  View on GitHub
  Curation note of NLP datasets
  ☆99Dec 6, 2022Updated 3 years ago
• paul-hyun / transformer-evolution

  View on GitHub
  Transformer 이후 나온 Pretrained Language Model을 간단하게 구현하였음.
  ☆125Aug 6, 2020Updated 6 years ago
• warnikchow / dlk2nlp

  View on GitHub
  Day-by-day line-by-line Keras-based Korean NLP
  ☆91Nov 21, 2022Updated 3 years ago
• affjljoo3581 / deit3-jax

  View on GitHub
  Jax/Flax implementation of DeiT and DeiT-III (ViT)
  ☆18Dec 21, 2024Updated last year
• nlpai-lab / Korean-CommonGen

  View on GitHub
  [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation
  ☆11May 27, 2022Updated 4 years ago
• kakaoenterprise / KorAdvMRSTestData

  View on GitHub
  Adversarial Test Dataset for Korean Multi-turn Response Selection
  ☆34Dec 16, 2021Updated 4 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
• ModuNLP / hacking_transformers

  View on GitHub
  ☆11Aug 12, 2020Updated 6 years ago
• MTynes / Meta-Learning-for-EEG-Classification-in-Schizophrenia

  View on GitHub
  Notebooks and pre-processing code for a meta learning paper/project involving the classification of EEG spectrograms.
  ☆13Sep 11, 2021Updated 5 years ago
• smothly / bad-word-detection

  View on GitHub
  비속어 탐지 모델
  ☆16Dec 19, 2019Updated 6 years ago
• ratsgo / embedding

  View on GitHub
  한국어 임베딩 (Sentence Embeddings Using Korean Corpora)
  ☆470Dec 1, 2021Updated 4 years ago
• weiglszonja / eeg-connectivity

  View on GitHub
  Framework for computing connectivity measures using MNE-Python
  ☆11Jul 6, 2023Updated 3 years ago
• CERC-AAI / bfm

  View on GitHub
  Code for "General-Purpose Brain Foundation Models for Time-Series Neuroimaging Data"
  ☆15Dec 14, 2024Updated last year
• taeminlee / KoGPT2-Transformers

  View on GitHub
  KoGPT2 on Huggingface Transformers
  ☆33May 4, 2021Updated 5 years ago
• monologg / korean-ner-pytorch

  View on GitHub
  NER Task with CNN + BiLSTM + CRF (with Naver NLP Challenge dataset) with Pytorch
  ☆31Jul 25, 2024Updated 2 years ago
• gilbutITbook / 080223

  View on GitHub
  ☆45Mar 18, 2021Updated 5 years ago
• Managed Kubernetes at scale on DigitalOcean • Ad
  DigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
• ModuNLP / weekly-meeting

  View on GitHub
  매주 목요일, 20:00 모임
  ☆16Jul 24, 2020Updated 6 years ago
• kuielab / lg_dacon_competition_template

  View on GitHub
  A hydra integrated template for LG-Dacon Competetion
  ☆13Jul 20, 2021Updated 5 years ago
• qbxlvnf11 / MultiWOZ2.1-parser

  View on GitHub
  MultiWOZ2.1-Parser for Dialogue State Tracking
  ☆13Aug 3, 2021Updated 5 years ago
• nawnoes / pytorch-gpt-x

  View on GitHub
  An implementation of an autoregressive language model using an improved Transformer and DeepSpeed pipeline parallelism.
  ☆29Jan 12, 2026Updated 9 months ago
• wikibook / tensorflow-projects

  View on GitHub
  《실전활용! 텐서플로 딥러닝 프로젝트》 예제 코드
  ☆19Nov 19, 2018Updated 7 years ago
• nlpai-lab / nlp-bible-code

  View on GitHub
  자연어처리 바이블의 실습 자료입니다.
  ☆54Jul 13, 2022Updated 4 years ago
• weixinxu666 / EEG_DisGCMAE

  View on GitHub
  [ICML'25] Pre-training graph contrastive masked autoencoders are strong distillers for EEG
  ☆14May 25, 2025Updated last year