Master the essential steps of pretraining large language models (LLMs). Learn to create high-quality datasets, configure model architectures, execute training runs, and assess model performance for efficient and effective LLM pretraining.
☆28Aug 7, 2024Updated 2 years ago
Alternatives and similar repositories for Pretraining-LLMs
Users that are interested in Pretraining-LLMs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Jul 8, 2026Updated 4 months ago
- DeepSeek-V4-Flash W4A16-FP8 quantization on 8x H200 — patches, recipe, mission report☆13Sep 26, 2026Updated last month
- ☆13Jul 23, 2024Updated 2 years ago
- 🐶 An LLM-powered local-service watchdog: probe → diagnose with LLM → 4 guardrails → fix → verify → self-heal. Learns from bugs it fixes.…☆13Nov 6, 2026Updated 2 weeks ago
- "Open Source Models with Hugging Face" course empowers you with the skills to leverage open-source models from the Hugging Face Hub for v…☆35Mar 6, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A book by Eli Stevens, Luca Antiga, Thomas Viehmann, and Soumith Chintala☆13Aug 29, 2020Updated 6 years ago
- ☆20Updated this week
- Specialization after Generalization☆11Oct 14, 2026Updated last month
- MiniMax-M3 (MXFP4, MSA) serving on SM120 (RTX PRO 6000 Blackwell) — patched vLLM image + launch recipe, 192K context☆23Jun 15, 2026Updated 5 months ago
- TikTok LIVE API for Python: The definitive 3rd-party library to receive livestream events (comments, gifts, etc.) in realtime from TikTok…☆22Sep 5, 2026Updated 2 months ago
- A programmable soundscape tool☆11Apr 27, 2020Updated 6 years ago
- Codes and data for KDD 2024 Research Track paper "ProCom: A Few-shot Targeted Community Detection Algorithm"☆11Aug 15, 2024Updated 2 years ago
- Open WorkBuddy — 开源版 WorkBuddy,本地多智能体工作台(Desktop + Web + CLI)☆25Updated this week
- ReasonFlow is a novel framework designed to implement o1-like reasoning capabilities in large language models.☆19Feb 25, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Benchmark Large Language Models Reliably On Your Data☆18Dec 27, 2025Updated 10 months ago
- Code to reproduce experiments from the paper "Continual Pre-Training Mitigates Forgetting in Language and Vision" https://arxiv.org/abs/2…☆22Oct 23, 2023Updated 3 years ago
- Practical Jupyter notebooks from Andrew Ng and Giskard team's "Red Teaming LLM Applications" course on DeepLearning.AI.☆25Apr 8, 2024Updated 2 years ago
- Unlock automation and system building with the ChatGPT API. Master chain calls, Python interactions, and create a customer service chatbo…☆19Jun 21, 2023Updated 3 years ago
- Implementation of Squeeze-and-Excitiation Network on Keras☆22Sep 22, 2019Updated 7 years ago
- Graph clustering based on dynamic Ollivier-Ricci curvature.☆13May 25, 2023Updated 3 years ago
- A repository of Dockerfiles, scripts, yaml files, Helm Charts, etc. used to build and scale the sample AI workflows with python, kubernet…☆12Feb 22, 2024Updated 2 years ago
- 🤯 Thoughts Lab 是基于 uni-app 开发的『工具集小程序』,采用通用型分层架构,支持多端发布、跨框架迁移 🤞☆16Dec 13, 2022Updated 3 years ago
- "🐈 nanobot: The Ultra-Lightweight Clawdbot"☆20Feb 7, 2026Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Estimating Individual Tree Height and Species from UAV Imagery☆24Sep 4, 2026Updated 2 months ago
- Learn the ins and outs of efficiently serving Large Language Models (LLMs). Dive into optimization techniques, including KV caching and L…☆23Apr 12, 2024Updated 2 years ago
- A Node.js REST interface for an Apache Spark REPL which can execute JavaScript.☆17Mar 21, 2016Updated 10 years ago
- The scripts to build and test kubernetes in jenkins. Report bugs at https://bugs.launchpad.net/charmed-kubernetes.☆10Nov 9, 2026Updated last week
- Code and studynote for the course Building Agentic RAG with LlamaIndex☆23Jun 2, 2024Updated 2 years ago
- ☆21Jan 16, 2025Updated last year
- Cell-type Assignment and Module Extraction based on a heterogeneous graph neural network.☆13Jan 27, 2024Updated 2 years ago
- single cell sequencing analysis tutorial☆18Jan 15, 2020Updated 6 years ago
- Generates a theme for Egui based on M3 color palettes.☆13Apr 8, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Pin any tweet your Twitter profile.☆18Aug 6, 2026Updated 3 months ago
- Ollivier-Ricci Curvature for Hypergraphs: A Unified Framework (ICLR 2023)☆19Jun 14, 2023Updated 3 years ago
- 一个优雅的桌面智能体☆26Updated this week
- [Paper][AAAI2023] Analogical Inference Enhanced Knowledge Graph Embedding☆14Jan 19, 2023Updated 3 years ago
- Simple RAG tutorials that can be run locally or using Google Colab (only Pro version).☆54Jul 22, 2024Updated 2 years ago
- GPL bases sources for Intel NNP-I card☆18Nov 13, 2023Updated 3 years ago
- 该存储库,主要存放根据自己所掌握的NGS差异表达分析技术方法为主,具体的实验以及方案设计等将不会存放在此存储库。☆15May 19, 2020Updated 6 years ago
Are these results useful?