soketlabs / coomLinks
A training framework for large-scale language models based on Megatron-Core, the COOM Training Framework is designed to efficiently handle extensive model training inspired by Deepseek's HAI-LLM optimizations.
☆24Updated 2 months ago
Alternatives and similar repositories for coom
Users that are interested in coom are comparing it to the libraries listed below
Sorting:
- A lightweight evaluation suite tailored specifically for assessing Indic LLMs across a diverse range of tasks☆38Updated last year
- ☆45Updated 7 months ago
- Curated collection of community environments☆208Updated this week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆197Updated 8 months ago
- So, I trained a Llama a 130M architecture I coded from ground up to build a small instruct model from scratch. Trained on FineWeb dataset…☆16Updated 10 months ago
- "LLM from Zero to Hero: An End-to-End Large Language Model Journey from Data to Application!"☆141Updated last month
- A zero-to-one guide on scaling modern transformers with n-dimensional parallelism.☆114Updated last month
- Basically a repo containing architectures/algorithms/papers from scratch in pytorch☆30Updated this week
- ☆29Updated last year
- A repository consisting of paper/architecture replications of classic/SOTA AI/ML papers in pytorch☆402Updated 2 months ago
- rl from zero pretrain, can it be done? yes.☆286Updated 4 months ago
- ☆46Updated 10 months ago
- Simple & Scalable Pretraining for Neural Architecture Research☆307Updated last month
- Collection of scripts and notebooks for OpenAI's latest GPT OSS models☆496Updated 5 months ago
- This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…☆23Updated 2 years ago
- ☆89Updated last week
- ☆68Updated last year
- ☆237Updated 3 weeks ago
- ☆137Updated 10 months ago
- ☆116Updated last week
- Simple UI for debugging correlations of text embeddings☆305Updated 8 months ago
- ☆68Updated 8 months ago
- in this repository, i'm going to implement increasingly complex llm inference optimizations☆81Updated 8 months ago
- code for training & evaluating Contextual Document Embedding models☆202Updated 8 months ago
- everything i know about cuda and triton☆13Updated last year
- A blueprint for creating Pretraining and Fine-Tuning datasets for Indic languages☆388Updated last year
- ☆46Updated 8 months ago
- ☆92Updated last year
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆110Updated 10 months ago
- Library for text-to-text regression, applicable to any input string representation and allows pretraining and fine-tuning over multiple r…☆313Updated last month