Master the essential steps of pretraining large language models (LLMs). Learn to create high-quality datasets, configure model architectures, execute training runs, and assess model performance for efficient and effective LLM pretraining.
☆27Aug 7, 2024Updated 2 years ago
Alternatives and similar repositories for Pretraining-LLMs
Users that are interested in Pretraining-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆31Sep 11, 2024Updated 2 years ago
- AutoML 2024: HPOD: Hyperparameter Optimization for Unsupervised Outlier Detection☆13Sep 8, 2026Updated last month
- Cell-type Assignment and Module Extraction based on a heterogeneous graph neural network.☆10Oct 30, 2023Updated 2 years ago
- Cell-type Assignment and Module Extraction based on a heterogeneous graph neural network.☆13Jan 27, 2024Updated 2 years ago
- Annotation builder to use segmentation in Mask_RCNN, even if your annotations are rectangular instead of polygon.☆15Feb 16, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A repository of Dockerfiles, scripts, yaml files, Helm Charts, etc. used to build and scale the sample AI workflows with python, kubernet…☆12Feb 22, 2024Updated 2 years ago
- End to End usecases using Intel System Stacks☆13Dec 17, 2022Updated 3 years ago
- LiSSA: A Framework for Generic Traceability Link Recovery☆17Sep 30, 2026Updated last week
- 该存储库，主要存放根据自己所掌握的NGS差异表达分析技术方法为主，具体的实验以及方案设计等将不会存放在此存储库。☆15May 19, 2020Updated 6 years ago
- VT3D: a versatile Visualization Toolbox for 3D spatial transcriptomics atlas☆14Nov 6, 2024Updated last year
- The scripts to build and test kubernetes in jenkins. Report bugs at https://bugs.launchpad.net/charmed-kubernetes.☆10Updated this week
- Ollivier-Ricci Curvature for Hypergraphs: A Unified Framework (ICLR 2023)☆19Jun 14, 2023Updated 3 years ago
- Calculate allowed interactions in QED☆10Nov 2, 2022Updated 3 years ago
- Training PyTorch Faster-RCNN on custom dataset☆14Jun 2, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- OnLine Spectral Search ENgine for Proteomics big data using Apache Spark, Python/Flask, and AngularJS☆15Sep 14, 2015Updated 11 years ago
- Data Science & Machine Learning Project applied to Healthcare☆16Dec 1, 2021Updated 4 years ago
- 🧀 KoBART summarization using pytorch☆13Jun 7, 2023Updated 3 years ago
- ☆16Jul 18, 2024Updated 2 years ago
- Python port to the normalizer in https://github.com/twitter/twitter-korean-text☆12Apr 26, 2016Updated 10 years ago
- Named-Entity-Recognition Workshop☆16May 27, 2019Updated 7 years ago
- YAML and instructions for deploying an nfs-server in K8S☆19Jul 18, 2017Updated 9 years ago
- This is the official implementation for the paper: Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models☆19Sep 11, 2024Updated 2 years ago
- Code for “ACE-HGNN: Adaptive Curvature ExplorationHyperbolic Graph Neural Network”☆17Mar 3, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Libraries and tools to support Transfer Learning☆20Apr 22, 2026Updated 5 months ago
- An R/Bioconductor package to identify higher-order molecular phenotypes☆19Jan 15, 2024Updated 2 years ago
- My implementation of the 15 puzzle game using the Pygame module with Python!☆11Oct 7, 2020Updated 6 years ago
- This is a detailed code demo on how to conduct Full-Param Supervised Fine-tuning (SFT) and DPO (Direct Preference Optimization)☆21Jan 9, 2025Updated last year
- OPUS-Rota4: A Gradient-Based Protein Side-Chain Modeling Framework Assisted by Deep Learning-Based Predictors☆10Apr 14, 2022Updated 4 years ago
- Program to plot a Ramachandran plot of all dihedral angles from a given PDB file. Background is empirically generated from the peptides …☆14Feb 25, 2025Updated last year
- memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B☆21May 26, 2024Updated 2 years ago
- Minimal (truly) muP implementation, consistent with TP4 and TP5 papers notation☆14Jan 2, 2026Updated 9 months ago
- Implementation of the WWW'23 paper "Toward Degree Bias in Embedding-Based Knowledge Graph Completion"☆15Jun 17, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3☆23May 20, 2021Updated 5 years ago
- NanoGPT (124M) in 5 minutes☆16Feb 14, 2025Updated last year
- The official baseline implementations for Chronocept. Published at EACL 2026.☆10Aug 4, 2026Updated 2 months ago
- Codes for Evolving Plastic ANNs☆15Dec 18, 2022Updated 3 years ago
- A n body simulation of our solar system completed in python☆10Sep 29, 2026Updated last week
- This repo contains code and data of our contribution to the 2024 LLM Hackathon, materials' property prediction from textual descriptions …☆12May 9, 2024Updated 2 years ago
- ☆21Aug 17, 2026Updated last month