Megatron-LM setup in the smol-cluster
☆12Aug 26, 2024Updated 2 years ago
Alternatives and similar repositories for nanotron-smol-cluster
Users that are interested in nanotron-smol-cluster are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Scripts and documentation on scaling large language model training on the LUMI supercomputer☆10Jun 30, 2023Updated 3 years ago
- Karras et al. (2022) diffusion models for PyTorch☆14Nov 15, 2022Updated 3 years ago
- ☆16Feb 6, 2024Updated 2 years ago
- ☆14Jun 24, 2024Updated 2 years ago
- A Langchain email agent that responds to incoming email. Email service with AWS SES.☆11May 18, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆12Nov 21, 2024Updated last year
- Building PaliGemma from scratch, a Vision Language Model by GoogleDeepmind designed to address a broad range of vision-language tasks. It…☆14Dec 22, 2024Updated last year
- ☆16Apr 7, 2024Updated 2 years ago
- [DEPRECATED] Command line tool for Deep Infra (no longer maintained)☆39Updated this week
- ☆18Sep 22, 2024Updated 2 years ago
- Autonomous AI Agent - Raspberry Pi-5 - Grok-4-Fast and Grok-4☆14Nov 7, 2025Updated last year
- ☆10Dec 27, 2022Updated 3 years ago
- Pragmatic approach to parsing import profiles for CI's☆12Jul 1, 2024Updated 2 years ago
- ☆11Oct 15, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Daily Positive Thoughts Emails☆10Jan 5, 2025Updated last year
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆24Aug 18, 2024Updated 2 years ago
- ☆45Nov 4, 2020Updated 6 years ago
- ☆27Dec 18, 2024Updated last year
- Surgical GPU kernel benchmark: 7 hard problems, frontier coding agents, roofline-graded against hardware peak.☆19Jun 12, 2026Updated 4 months ago
- ☆11Jan 27, 2025Updated last year
- A Lua kernel for JupyterLite, powered by Xeus☆14Feb 26, 2025Updated last year
- Explore training for quantized models☆29Jul 12, 2025Updated last year
- ☆31May 4, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Tutorial on how to convert machine learned models into ONNX☆14Mar 11, 2023Updated 3 years ago
- ☆11Jun 2, 2021Updated 5 years ago
- [ICCV 2025] Dynamic-VLM☆28Dec 16, 2024Updated last year
- NVLink microbenchmark with IBM Power8 and NVIDIA P100 GPU - Master Thesis☆11Aug 23, 2017Updated 9 years ago
- All the useful tools I have been using while working in data science for remote sensing☆11Nov 27, 2019Updated 6 years ago
- ☆24May 12, 2026Updated 5 months ago
- ☆12Jan 26, 2023Updated 3 years ago
- This repository contains the code for my home improvements projects (home automation, plants watering, everyday calendar, motorized mobil…☆10Dec 9, 2022Updated 3 years ago
- Python scripts to facilitate easy working☆11Mar 23, 2026Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A tool written in Go that helps you monitor a collection of websites using various metrics.☆12Nov 9, 2021Updated 4 years ago
- LLM checkpointing for DeepSpeed/Megatron☆27Nov 30, 2025Updated 11 months ago
- ☆13Nov 22, 2022Updated 3 years ago
- Reinforcement learning modular with pytorch☆11Jan 18, 2021Updated 5 years ago
- Code for reproducing the experiments on large-scale pre-training and transfer learning for the paper "Effect of large-scale pre-training …☆19May 29, 2022Updated 4 years ago
- Mixture of Expert (MoE) techniques for enhancing LLM performance through expert-driven prompt mapping and adapter combinations.☆11Feb 11, 2024Updated 2 years ago
- CSCS User Lab Day – Meet the Swiss National Supercomputing Centre☆14Sep 3, 2026Updated 2 months ago