Master the essential steps of pretraining large language models (LLMs). Learn to create high-quality datasets, configure model architectures, execute training runs, and assess model performance for efficient and effective LLM pretraining.
☆27Aug 7, 2024Updated 2 years ago
Alternatives and similar repositories for Pretraining-LLMs
Users that are interested in Pretraining-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Toonification of real face images using PyTorch, Stylegan2 and Image-to-Image translation☆13Jun 14, 2022Updated 4 years ago
- AutoML 2024: HPOD: Hyperparameter Optimization for Unsupervised Outlier Detection☆13Jul 12, 2024Updated 2 years ago
- A collection of example for learning how to use Golang.☆14May 4, 2019Updated 7 years ago
- An end to end ML project. Using MLflow for experiment tracking and model registry. Prefect for workflow orchestration. S3 for artifacts s…☆12Sep 11, 2022Updated 3 years ago
- Cell-type Assignment and Module Extraction based on a heterogeneous graph neural network.☆10Oct 30, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A repository of Dockerfiles, scripts, yaml files, Helm Charts, etc. used to build and scale the sample AI workflows with python, kubernet…☆12Feb 22, 2024Updated 2 years ago
- 🤯 Thoughts Lab 是基于 uni-app 开发的『工具集小程序』，采用通用型分层架构，支持多端发布、跨框架迁移 🤞☆16Dec 13, 2022Updated 3 years ago
- LiSSA: A Framework for Generic Traceability Link Recovery☆14Updated this week
- Code example for pretraining an LLM with vanilla PyTorch training loop☆10Jun 6, 2024Updated 2 years ago
- The scripts to build and test kubernetes in jenkins. Report bugs at https://bugs.launchpad.net/charmed-kubernetes.☆10Jul 16, 2026Updated 3 weeks ago
- Ollivier-Ricci Curvature for Hypergraphs: A Unified Framework (ICLR 2023)☆19Jun 14, 2023Updated 3 years ago
- Calculate allowed interactions in QED☆10Nov 2, 2022Updated 3 years ago
- OnLine Spectral Search ENgine for Proteomics big data using Apache Spark, Python/Flask, and AngularJS☆15Sep 14, 2015Updated 10 years ago
- This is the idea from scikit-learn to implement the task of multi-label for Chinese text.☆13Apr 17, 2017Updated 9 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Named-Entity-Recognition Workshop☆16May 27, 2019Updated 7 years ago
- YAML and instructions for deploying an nfs-server in K8S☆19Jul 18, 2017Updated 9 years ago
- ☆11Nov 14, 2020Updated 5 years ago
- 三大boosting算法的工程实现 XGBoost、LightGBM、Catboost原理实现及常见面试问题总结，以及其他理解深刻的机器学习、深度学习文章备份☆12Jul 7, 2021Updated 5 years ago
- 能说话的ChatPaper☆11Feb 8, 2024Updated 2 years ago
- Libraries and tools to support Transfer Learning☆20Apr 22, 2026Updated 3 months ago
- GPL bases sources for Intel NNP-I card☆18Nov 13, 2023Updated 2 years ago
- An R/Bioconductor package to identify higher-order molecular phenotypes☆19Jan 15, 2024Updated 2 years ago
- My implementation of the 15 puzzle game using the Pygame module with Python!☆11Oct 7, 2020Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This is the pipeline of our new article "Enzyme Co-Scientist: Harnessing Large Language Models for Enzyme Kinetic Data Extraction from Li…☆17May 23, 2025Updated last year
- ☆13Aug 28, 2018Updated 7 years ago
- Python implementation of machine learning metrics☆14Nov 13, 2017Updated 8 years ago
- [NeurIPS 2025] Official repository of the paper "Unlocking Aha Moments via Reinforcement Learning: Advancing Collaborative Visual Compreh…☆23Sep 27, 2025Updated 10 months ago
- Minimal (truly) muP implementation, consistent with TP4 and TP5 papers notation☆14Jan 2, 2026Updated 7 months ago
- Implementation of the WWW'23 paper "Toward Degree Bias in Embedding-Based Knowledge Graph Completion"☆15Jun 17, 2023Updated 3 years ago
- Codes for Evolving Plastic ANNs☆15Dec 18, 2022Updated 3 years ago
- The official baseline implementations for Chronocept. Published at EACL 2026.☆10Updated this week
- A n body simulation of our solar system completed in python☆10Jun 3, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆17Oct 14, 2025Updated 9 months ago
- Contains Jupyter notebooks and other materials prepared for the course Numerical Methods offered at TIFR Hyderabad (https://moldis-group.…☆13Dec 26, 2022Updated 3 years ago
- This repo contains code and data of our contribution to the 2024 LLM Hackathon, materials' property prediction from textual descriptions …☆12May 9, 2024Updated 2 years ago
- Example of hosting a Flask application load balanced in multiple Docker containers☆17Feb 27, 2019Updated 7 years ago
- ☆21Nov 12, 2025Updated 8 months ago
- natural annotated text-category pairs for text classification☆10Sep 10, 2021Updated 4 years ago
- keras 2.1.4 / tensorflow 1.7.0☆16Apr 20, 2018Updated 8 years ago