Master the essential steps of pretraining large language models (LLMs). Learn to create high-quality datasets, configure model architectures, execute training runs, and assess model performance for efficient and effective LLM pretraining.
☆27Aug 7, 2024Updated 2 years ago
Alternatives and similar repositories for Pretraining-LLMs
Users that are interested in Pretraining-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Python implementation of the 15 puzzle game☆10Dec 30, 2016Updated 9 years ago
- Codes and data for KDD 2024 Research Track paper "ProCom: A Few-shot Targeted Community Detection Algorithm"☆11Aug 15, 2024Updated 2 years ago
- ReasonFlow is a novel framework designed to implement o1-like reasoning capabilities in large language models.☆19Feb 25, 2025Updated last year
- Reverse engineered API for Quora's Poe - access Claude (Anthropic) and ChatGPT (OpenAI)☆15Sep 8, 2023Updated 2 years ago
- Cell-type Assignment and Module Extraction based on a heterogeneous graph neural network.☆13Jan 27, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- LiSSA: A Framework for Generic Traceability Link Recovery☆16Aug 19, 2026Updated last week
- You can now run long training sessions in colab!☆16Dec 10, 2020Updated 5 years ago
- Ollivier-Ricci Curvature for Hypergraphs: A Unified Framework (ICLR 2023)☆19Jun 14, 2023Updated 3 years ago
- Code for "Whole brain alignment of spatial transcriptomics between humans and mice with BrainAlign"☆17Oct 4, 2024Updated last year
- An unofficial API for Node.js based off of the Perplexity.AI website and mobile app☆21Dec 8, 2023Updated 2 years ago
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆62Nov 4, 2024Updated last year
- ☆19May 8, 2026Updated 3 months ago
- node tree based loom for base model completions☆16Dec 10, 2025Updated 8 months ago
- An R/Bioconductor package to identify higher-order molecular phenotypes☆19Jan 15, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A simple script to install rnsd on pi and configure it for LoRa using a reticulum rnode device☆18Jul 1, 2026Updated last month
- OPUS-Rota4: A Gradient-Based Protein Side-Chain Modeling Framework Assisted by Deep Learning-Based Predictors☆11Apr 14, 2022Updated 4 years ago
- Program to plot a Ramachandran plot of all dihedral angles from a given PDB file. Background is empirically generated from the peptides …☆13Feb 25, 2025Updated last year
- [NeurIPS 2025] Official repository of the paper "Unlocking Aha Moments via Reinforcement Learning: Advancing Collaborative Visual Compreh…☆22Sep 27, 2025Updated 11 months ago
- Minimal (truly) muP implementation, consistent with TP4 and TP5 papers notation☆14Jan 2, 2026Updated 7 months ago
- Implementation of the WWW'23 paper "Toward Degree Bias in Embedding-Based Knowledge Graph Completion"☆15Jun 17, 2023Updated 3 years ago
- NanoGPT (124M) in 5 minutes☆16Feb 14, 2025Updated last year
- Codes for Evolving Plastic ANNs☆15Dec 18, 2022Updated 3 years ago
- The official baseline implementations for Chronocept. Published at EACL 2026.☆10Aug 4, 2026Updated 3 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A n body simulation of our solar system completed in python☆10Jun 3, 2026Updated 2 months ago
- ☆17Oct 14, 2025Updated 10 months ago
- natural annotated text-category pairs for text classification☆10Sep 10, 2021Updated 4 years ago
- Curvature Graph Network☆19Jul 1, 2020Updated 6 years ago
- Main code for "Revisiting over-smoothing and over-squashing using the Ollivier-Ricci curvature" paper☆19May 30, 2023Updated 3 years ago
- A short lecture introducing plane-wave DFT methods and DFTK☆13Jun 20, 2022Updated 4 years ago
- A MoE impl for PyTorch, [ATC'23] SmartMoE☆73Jul 11, 2023Updated 3 years ago
- Computational predictor of protein intrinsic disorder and its functions☆11Dec 4, 2023Updated 2 years ago
- Model to predict kinase-ligand pKi values.☆12Jul 6, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Overcoming Long-Context Limitations of State-Space Models via Context-Dependent Sparse Attention (NeurIPS 2025)☆23Sep 30, 2025Updated 11 months ago
- A quick tutorial for modern materials science, should the reader be not familiar with it and just wishing to crack the data☆19Aug 24, 2025Updated last year
- A visualization experience of AI/ML academic papers hosted on ArXiV - for project work at the University of California, Berkeley MIDS pro…☆10Feb 10, 2023Updated 3 years ago
- OPUS-Rota4: A Gradient-Based Protein Side-Chain Modeling Framework Assisted by Deep Learning-Based Predictors☆10Apr 14, 2022Updated 4 years ago
- A morphosyntactic analyzer for the Arabic language.☆25Mar 3, 2020Updated 6 years ago
- ☆14Jul 13, 2022Updated 4 years ago
- ☆24Feb 22, 2023Updated 3 years ago