Scripts and documentation on scaling large language model training on the LUMI supercomputer
☆10Jun 30, 2023Updated 3 years ago
Alternatives and similar repositories for lumi-llm-scaling
Users that are interested in lumi-llm-scaling are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Megatron-LM setup in the smol-cluster☆12Aug 26, 2024Updated 2 years ago
- Python Kinetic 1D-space, 2D-velocity neutral edge model☆11Sep 21, 2026Updated last month
- Fine tuning Mistral-7b with PEFT(Parameter Efficient Fine-Tuning) and LoRA(Low-Rank Adaptation) on Puffin Dataset(multi-turn conversation…☆12Nov 23, 2023Updated 2 years ago
- Tool to profile usage of HPC resources by regularly probing processes.☆13Updated this week
- ☆12Jan 2, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Python bindings for diffsol, Rust JIT-compiled ODE solver☆11Oct 14, 2026Updated 3 weeks ago
- ☆12May 24, 2023Updated 3 years ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆20Oct 23, 2023Updated 3 years ago
- Chu-Liu-Edmonds maximum spanning algorithm from TurboParser for use within Python☆11Mar 9, 2024Updated 2 years ago
- Merge of megatron-train, autoexperiment and oellm_pretrain.☆19Updated this week
- simple interactive web-based demo for socratic models; image captioning, auto tagging, keyword generation☆10Jul 26, 2022Updated 4 years ago
- A Norwegian Language Understanding and Generation Evaluation Benchmark☆13Updated this week
- ☆10Sep 11, 2020Updated 6 years ago
- Collaborative distributed version control lesson.☆10Oct 6, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16May 14, 2024Updated 2 years ago
- Morfessor EM+Prune☆10Jul 22, 2020Updated 6 years ago
- zero-vocab or low-vocab embeddings☆18Jul 17, 2022Updated 4 years ago
- LUMI containers - recipes and build/tests infrastructure.☆10Mar 18, 2025Updated last year
- LinPipe: Multilingual Processing Tool☆11Updated this week
- Some ZFS kernel modules and binaries, automatically built from CoreOS stable/beta/alpha channels☆13Apr 2, 2016Updated 10 years ago
- Simple script to re-rank images using OpenAI's CLIP https://github.com/openai/CLIP.☆15May 3, 2021Updated 5 years ago
- An interactive viewer for N-dimensional datasets, stored locally or in cloud object storage. Built in Rust with GPU rendering, available …☆19Updated this week
- Code for the paper "The Sound of Water: Inferring Physical Properties from Pouring Liquids".☆14Sep 22, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆11Jun 29, 2021Updated 5 years ago
- ☆11Jul 8, 2025Updated last year
- The OpenAI Whisper speech-to-text model as a simple HTTP server☆14Oct 26, 2023Updated 3 years ago
- Guacamole HMAC Auth Plugin (Pre-Packaged)☆12Jun 18, 2014Updated 12 years ago
- A version of Chairmarks with nice histograms☆19Dec 26, 2024Updated last year
- MultiLexNorm 2021 competition system from ÚFAL☆16Dec 30, 2021Updated 4 years ago
- Base container to deploy a chroot ssh server mounting in a volume a list of user directories from host☆14Dec 9, 2016Updated 9 years ago
- Multi-Domain Expert Learning☆65Jan 23, 2024Updated 2 years ago
- Webvision Challenge 2020 developer kit☆10Dec 8, 2022Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A strategy for Passport authentication that supports encrypted SAML responses☆13Aug 19, 2025Updated last year
- ☆14Aug 28, 2022Updated 4 years ago
- ☆18Updated this week
- Display contacts from the AddressBook database☆11May 4, 2022Updated 4 years ago
- X-MIC: Cross-Modal Instance Conditioning for Egocentric Action Generalization, CVPR 2024☆11Nov 7, 2024Updated 2 years ago
- A Docker image to run the OpenAI Gym environment in Jupyter notebooks. No host system X11 support needed, graphical parts of the Gym are …☆10Nov 4, 2016Updated 10 years ago
- Script for doing Slurm Calculations☆12Updated this week
Are these results useful?