stanford-futuredata / Megatron-LMLinks
Ongoing research training transformer models at scale
☆38Updated last year
Alternatives and similar repositories for Megatron-LM
Users that are interested in Megatron-LM are comparing it to the libraries listed below
Sorting:
- an implementation of Self-Extend, to expand the context window via grouped attention☆119Updated last year
- Just a bunch of benchmark logs for different LLMs☆119Updated last year
- ☆45Updated 2 years ago
- Cerule - A Tiny Mighty Vision Model☆68Updated last month
- inference code for mixtral-8x7b-32kseqlen☆104Updated 2 years ago
- KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…☆24Updated 2 years ago
- ☆117Updated 11 months ago
- An automated tool for discovering insights from research papaer corpora☆137Updated last year
- look how they massacred my boy☆63Updated last year
- ☆28Updated last year
- A framework for orchestrating AI agents using a mermaid graph☆77Updated last year
- auto fine tune of models with synthetic data☆76Updated last year
- ☆106Updated 2 years ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆108Updated 9 months ago
- ☆86Updated last year
- Verbosity control for AI agents☆64Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated last month
- ☆68Updated last year
- GRDN.AI app for garden optimization☆69Updated 3 weeks ago
- Mixing Language Models with Self-Verification and Meta-Verification☆110Updated last year
- Simple examples using Argilla tools to build AI☆56Updated last year
- A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.☆76Updated 10 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated last year
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆107Updated 2 months ago
- ☆62Updated 2 years ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆58Updated last year
- Demo of AI chatbot that predicts user message to generate response quickly.☆104Updated last year
- Scripts to create your own moe models using mlx☆90Updated last year
- ☆164Updated 4 months ago
- Simple Graph Memory for AI applications☆89Updated 6 months ago