Master the essential steps of pretraining large language models (LLMs). Learn to create high-quality datasets, configure model architectures, execute training runs, and assess model performance for efficient and effective LLM pretraining.
☆27Aug 7, 2024Updated last year
Alternatives and similar repositories for Pretraining-LLMs
Users that are interested in Pretraining-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆31Sep 11, 2024Updated last year
- ☆12Feb 22, 2023Updated 3 years ago
- An end to end ML project. Using MLflow for experiment tracking and model registry. Prefect for workflow orchestration. S3 for artifacts s…☆12Sep 11, 2022Updated 3 years ago
- [🎖️1등(장관상) 솔루션] 2022 국립국어원 인공 지능 언어 능력 평가 (쇼핑몰 리뷰 데이터 속성 기반 감성 분석 : Aspect-Based Sentiment Analysis)☆11Jun 6, 2023Updated 3 years ago
- Toonification of real face images using PyTorch, Stylegan2 and Image-to-Image translation☆13Jun 14, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Experiment with NVIDIA Triton and Whisper☆15Apr 29, 2024Updated 2 years ago
- ☆17Jan 21, 2025Updated last year
- [Paper][AAAI2023] Analogical Inference Enhanced Knowledge Graph Embedding☆14Jan 19, 2023Updated 3 years ago
- Pretrained Language Model(from huggingface)을 사용하여 간단하게 비슷한 의미를 가지는 문장을 찾을 수 있는 metric을 제공☆13Jul 6, 2023Updated 3 years ago
- Named-Entity-Recognition Workshop☆16May 27, 2019Updated 7 years ago
- Code for "What really matters in matrix-whitening optimizers?"☆24Oct 31, 2025Updated 8 months ago
- Image Segmentation On Custom Dataset Using YOLOv8☆19Jan 12, 2023Updated 3 years ago
- Annotation builder to use segmentation in Mask_RCNN, even if your annotations are rectangular instead of polygon.☆15Feb 16, 2022Updated 4 years ago
- Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed☆21May 27, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Python port to the normalizer in https://github.com/twitter/twitter-korean-text☆12Apr 26, 2016Updated 10 years ago
- OMNI-P2x: A universal neural network potential for excited states☆15Mar 19, 2026Updated 3 months ago
- The project aims to detect ships in million pixels satellite images using different object detection algorithms. This makes use of variou…☆15Jun 28, 2020Updated 6 years ago
- Semantic and Instance Segmentation on iOS Using a Flask API — DeepLabV3+ and Mask R-CNN☆20Oct 3, 2020Updated 5 years ago
- LoRA supervised fine-tuning, RLHF (PPO) and RAG with llama-3-8B on the TLDR summarization dataset☆14Feb 2, 2025Updated last year
- OPUS-Rota4: A Gradient-Based Protein Side-Chain Modeling Framework Assisted by Deep Learning-Based Predictors☆11Apr 14, 2022Updated 4 years ago
- Program to plot a Ramachandran plot of all dihedral angles from a given PDB file. Background is empirically generated from the peptides …☆13Feb 25, 2025Updated last year
- Minimal (truly) muP implementation, consistent with TP4 and TP5 papers notation☆14Jan 2, 2026Updated 6 months ago
- This is a detailed code demo on how to conduct Full-Param Supervised Fine-tuning (SFT) and DPO (Direct Preference Optimization)☆19Jan 9, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Contains Jupyter notebooks and other materials prepared for the course Numerical Methods offered at TIFR Hyderabad (https://moldis-group.…☆13Dec 26, 2022Updated 3 years ago
- The official baseline implementations for Chronocept☆10Mar 31, 2026Updated 3 months ago
- ☆24Jun 29, 2026Updated last week
- A short lecture introducing plane-wave DFT methods and DFTK☆13Jun 20, 2022Updated 4 years ago
- natural annotated text-category pairs for text classification☆10Sep 10, 2021Updated 4 years ago
- Computational predictor of protein intrinsic disorder and its functions☆11Dec 4, 2023Updated 2 years ago
- Model to predict kinase-ligand pKi values.☆12Jul 6, 2023Updated 3 years ago
- A step-by-step tutorial to code the McMurchie-Davidson scheme to compute molecular integrals☆10Jul 4, 2021Updated 5 years ago
- Fine tuned llama 3 models for context based question answering in bengali language.☆18Oct 14, 2024Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3☆23May 20, 2021Updated 5 years ago
- Deep learning AI for generating new molecules that bond to the COVID-19.☆12Sep 17, 2020Updated 5 years ago
- A visualization experience of AI/ML academic papers hosted on ArXiV - for project work at the University of California, Berkeley MIDS pro…☆10Feb 10, 2023Updated 3 years ago
- ☆14Jul 13, 2022Updated 3 years ago
- ☆14May 25, 2022Updated 4 years ago
- OPUS-Rota4: A Gradient-Based Protein Side-Chain Modeling Framework Assisted by Deep Learning-Based Predictors☆10Apr 14, 2022Updated 4 years ago
- HIP: Hessians with Interatomic Potentials☆39Jun 23, 2026Updated 2 weeks ago