Code example for pretraining an LLM with vanilla PyTorch training loop
☆10Jun 6, 2024Updated 2 years ago
Alternatives and similar repositories for LLMs-Pretraining-with-PyTorch
Users that are interested in LLMs-Pretraining-with-PyTorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Variable Selection Network with PyTorch☆12May 29, 2024Updated 2 years ago
- Master the essential steps of pretraining large language models (LLMs). Learn to create high-quality datasets, configure model architectu…☆27Aug 7, 2024Updated 2 years ago
- Read Image Files Concurrently☆17Sep 17, 2024Updated 2 years ago
- TensorFlow JS Experiments at Google I/O Extended Hanoi 2018☆20Jan 4, 2019Updated 7 years ago
- ✅ Predicting LLM correctness from model internals☆11Apr 20, 2026Updated 6 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- PyTorch solution of Vietnamese Named Entity Recognition task with Google AI's BERT model.☆23Dec 8, 2022Updated 3 years ago
- Demo of crawl 20 years lottery data and do EDA☆11May 6, 2021Updated 5 years ago
- Demo of using Airflow☆11Jun 24, 2022Updated 4 years ago
- CEPO: RLVR Self-Distillation using Contrastive Evidence Policy Optimization☆15May 25, 2026Updated 5 months ago
- ☆15Sep 29, 2026Updated last month
- ☆15Jul 24, 2026Updated 3 months ago
- PrAg-PO improves RL-based mathematical reasoning by training models across diverse prompt templates with template-specific format rewards…☆13May 12, 2026Updated 5 months ago
- [COLM 2026] From RLVR to RLSVR: Task Transformation Induces Self-Verifiable Rewards for Open-Ended LLM Self-Improvement☆13Jul 26, 2026Updated 3 months ago
- The open source extract transaction infomation by using OCR.☆20Jan 23, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- CS231n Convolutional Neural Networks for Visual Recognition☆12Aug 17, 2021Updated 5 years ago
- ITMO AI Talent Hub Speech Recognition and Generation course☆20Apr 16, 2026Updated 6 months ago
- ☆14Updated this week
- Official implementation of RP-OPSD for multimodal large language models☆13Aug 13, 2026Updated 2 months ago
- various tools to download, convert and process the full text of scientific articles☆10Apr 2, 2024Updated 2 years ago
- Script download ebook from VNUHCM Library☆12Mar 11, 2023Updated 3 years ago
- ☆10Dec 29, 2020Updated 5 years ago
- Các bài toán đặc trưng của xử lý ngôn ngữ tự nhiên☆10Jun 11, 2021Updated 5 years ago
- MMLU eval for RU/EN☆16Jul 31, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- LLM Uncertainty Quantification with Attention Chain☆11Mar 24, 2025Updated last year
- Easy OCR demo + Invoice for Youtube☆11Jul 15, 2020Updated 6 years ago
- ReflectRL: learning from Golden Negative Trajectories via Reflective-to-Direct reasoning.☆17Jul 4, 2026Updated 3 months ago
- [EMNLP 2026] SGSD: Skill-Conditioned Gated Self-Distillation for LLM Reasoning☆14Aug 21, 2026Updated 2 months ago
- [DEPRECATED] AutoCrawler - automate extracting main information from website☆16Jun 10, 2021Updated 5 years ago
- ☆15Jan 22, 2017Updated 9 years ago
- [arXiv 2026] Learning from Rare Success and Rich Feedback via Reflection-Enhanced Self-Distillation☆20May 21, 2026Updated 5 months ago
- ☆20Aug 14, 2026Updated 2 months ago
- Trying to build an all in one speech-text language model - a bit like GPT-4o☆22Jun 1, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Official Implementation for "CFPO: Counterfactual Policy Optimization for Multimodal Reasoning" (ICML 2026)☆16Jul 13, 2026Updated 3 months ago
- Full stack Arduino temperature monitor☆11Oct 31, 2017Updated 9 years ago
- ☆21Jul 31, 2026Updated 3 months ago
- Heart rate prediction from altitude changes, speed and cadence during running. Data collection was made using Garmin sports watch, fit f…☆27Jun 6, 2023Updated 3 years ago
- ☆16Sep 4, 2025Updated last year
- ☆12Sep 22, 2024Updated 2 years ago
- ☆36Apr 25, 2021Updated 5 years ago