Scripts and documentation on scaling large language model training on the LUMI supercomputer
☆10Jun 30, 2023Updated 3 years ago
Alternatives and similar repositories for lumi-llm-scaling
Users that are interested in lumi-llm-scaling are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Megatron-LM setup in the smol-cluster☆12Aug 26, 2024Updated 2 years ago
- Fine tuning Mistral-7b with PEFT(Parameter Efficient Fine-Tuning) and LoRA(Low-Rank Adaptation) on Puffin Dataset(multi-turn conversation…☆12Nov 23, 2023Updated 2 years ago
- Tool to profile usage of HPC resources by regularly probing processes.☆12Updated this week
- ☆12Jan 2, 2024Updated 2 years ago
- Collaborative distributed version control lesson.☆10Oct 6, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12May 24, 2023Updated 3 years ago
- ☆10Sep 11, 2020Updated 6 years ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆20Oct 23, 2023Updated 2 years ago
- ☆16May 14, 2024Updated 2 years ago
- LUMI containers - recipes and build/tests infrastructure.☆10Mar 18, 2025Updated last year
- simple interactive web-based demo for socratic models; image captioning, auto tagging, keyword generation☆10Jul 26, 2022Updated 4 years ago
- Morfessor EM+Prune☆10Jul 22, 2020Updated 6 years ago
- zero-vocab or low-vocab embeddings☆18Jul 17, 2022Updated 4 years ago
- Simple script to re-rank images using OpenAI's CLIP https://github.com/openai/CLIP.☆15May 3, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Some ZFS kernel modules and binaries, automatically built from CoreOS stable/beta/alpha channels☆13Apr 2, 2016Updated 10 years ago
- LinPipe: Multilingual Processing Tool☆11Updated this week
- MultiLexNorm 2021 competition system from ÚFAL☆16Dec 30, 2021Updated 4 years ago
- The OpenAI Whisper speech-to-text model as a simple HTTP server☆14Oct 26, 2023Updated 2 years ago
- Script for doing Slurm Calculations☆12Jul 20, 2026Updated 3 months ago
- ☆20Apr 16, 2022Updated 4 years ago
- Base container to deploy a chroot ssh server mounting in a volume a list of user directories from host☆14Dec 9, 2016Updated 9 years ago
- A version of Chairmarks with nice histograms☆19Dec 26, 2024Updated last year
- A Docker image to run the OpenAI Gym environment in Jupyter notebooks. No host system X11 support needed, graphical parts of the Gym are …☆10Nov 4, 2016Updated 9 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆11Jun 29, 2021Updated 5 years ago
- A strategy for Passport authentication that supports encrypted SAML responses☆13Aug 19, 2025Updated last year
- ☆12Mar 12, 2023Updated 3 years ago
- X-MIC: Cross-Modal Instance Conditioning for Egocentric Action Generalization, CVPR 2024☆11Nov 7, 2024Updated last year
- A Lua kernel for JupyterLite, powered by Xeus☆14Feb 26, 2025Updated last year
- Webvision Challenge 2020 developer kit☆10Dec 8, 2022Updated 3 years ago
- ☆18Oct 14, 2026Updated last week
- Multi-Domain Expert Learning☆65Jan 23, 2024Updated 2 years ago
- ☆13Nov 20, 2015Updated 10 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆14Aug 28, 2022Updated 4 years ago
- A repository for contributed EasyConfig files that LUMI users can install at their own discretion or use as a starting base for their own…☆22Oct 14, 2026Updated last week
- ☆22Aug 27, 2026Updated last month
- Guacamole HMAC Auth Plugin (Pre-Packaged)☆12Jun 18, 2014Updated 12 years ago
- ☆20Jul 26, 2022Updated 4 years ago
- Flash-GMM, a memory-efficient GPU kernel that unlocks GMM soft clustering at billion-scale☆25Sep 30, 2026Updated 2 weeks ago
- One-dimensional plasma-neutral simulation for SOL and divertor studies☆22Nov 15, 2023Updated 2 years ago