Code example for pretraining an LLM with vanilla PyTorch training loop
☆10Jun 6, 2024Updated 2 years ago
Alternatives and similar repositories for LLMs-Pretraining-with-PyTorch
Users that are interested in LLMs-Pretraining-with-PyTorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Variable Selection Network with PyTorch☆12May 29, 2024Updated 2 years ago
- Master the essential steps of pretraining large language models (LLMs). Learn to create high-quality datasets, configure model architectu…☆28Aug 7, 2024Updated 2 years ago
- Read Image Files Concurrently☆17Sep 17, 2024Updated 2 years ago
- TensorFlow JS Experiments at Google I/O Extended Hanoi 2018☆20Jan 4, 2019Updated 7 years ago
- Demo of crawl 20 years lottery data and do EDA☆11May 6, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- PyTorch solution of Vietnamese Named Entity Recognition task with Google AI's BERT model.☆23Dec 8, 2022Updated 3 years ago
- [ACL'26 Main] Beyond Majority Voting: Towards Fine-grained and More Reliable Reward Signal for Test-Time Reinforcement☆13Apr 6, 2026Updated 7 months ago
- ☆15Jul 24, 2026Updated 3 months ago
- PrAg-PO improves RL-based mathematical reasoning by training models across diverse prompt templates with template-specific format rewards…☆13May 12, 2026Updated 6 months ago
- The open source extract transaction infomation by using OCR.☆20Jan 23, 2022Updated 4 years ago
- CS231n Convolutional Neural Networks for Visual Recognition☆12Aug 17, 2021Updated 5 years ago
- various tools to download, convert and process the full text of scientific articles☆10Apr 2, 2024Updated 2 years ago
- Official implementation of RP-OPSD for multimodal large language models☆13Aug 13, 2026Updated 3 months ago
- Demo of using Airflow☆11Jun 24, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆10Dec 29, 2020Updated 5 years ago
- ✅ Predicting LLM correctness from model internals☆11Apr 20, 2026Updated 7 months ago
- Các bài toán đặc trưng của xử lý ngôn ngữ tự nhiên☆10Jun 11, 2021Updated 5 years ago
- MMLU eval for RU/EN☆16Jul 31, 2023Updated 3 years ago
- ZwZ-v2: RL-trained vision-language models (4B/9B/27B) that connect fine-grained visual evidence across image regions, trained with GRPO o…☆17Oct 31, 2026Updated 3 weeks ago
- ☆15Jan 22, 2017Updated 9 years ago
- [DEPRECATED] AutoCrawler - automate extracting main information from website☆16Jun 10, 2021Updated 5 years ago
- [EMNLP 2026] SGSD: Skill-Conditioned Gated Self-Distillation for LLM Reasoning☆14Aug 21, 2026Updated 3 months ago
- CEPO: RLVR Self-Distillation using Contrastive Evidence Policy Optimization☆16May 25, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆14Updated this week
- Script download ebook from VNUHCM Library☆12Mar 11, 2023Updated 3 years ago
- ☆15Sep 29, 2026Updated last month
- Trying to build an all in one speech-text language model - a bit like GPT-4o☆22Jun 1, 2024Updated 2 years ago
- LLM Uncertainty Quantification with Attention Chain☆11Mar 24, 2025Updated last year
- Full stack Arduino temperature monitor☆11Oct 31, 2017Updated 9 years ago
- Easy OCR demo + Invoice for Youtube☆11Jul 15, 2020Updated 6 years ago
- Official Implementation for "CFPO: Counterfactual Policy Optimization for Multimodal Reasoning" (ICML 2026)☆16Jul 13, 2026Updated 4 months ago
- ☆16Sep 4, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆12Sep 22, 2024Updated 2 years ago
- “Simplicity is the ultimate sophistication”☆19Aug 19, 2026Updated 3 months ago
- Official implementation of OPD-Aha for fine-grained visual perception and multimodal reasoning☆15Sep 16, 2026Updated 2 months ago
- ☆36Apr 25, 2021Updated 5 years ago
- Demo of deploy YOLOv6 model as API☆10Aug 6, 2022Updated 4 years ago
- ☆12Nov 1, 2023Updated 3 years ago
- ReflectRL: learning from Golden Negative Trajectories via Reflective-to-Direct reasoning.☆17Jul 4, 2026Updated 4 months ago
Are these results useful?