frankxu2004 / gpt-neoxLinks
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
☆17Updated 3 years ago
Alternatives and similar repositories for gpt-neox
Users that are interested in gpt-neox are comparing it to the libraries listed below
Sorting:
- ☆14Updated 2 years ago
- DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.☆169Updated last month
- MozoLM: A language model (LM) serving library☆45Updated last month
- Downloads 2020 English Wikipedia articles as plaintext☆24Updated 2 years ago
- Repository for analysis and experiments in the BigCode project.☆125Updated last year
- SLIDE (Sub-LInear Deep learning Engine) written in Go☆45Updated 5 years ago
- Official code release for the paper Coder Reviewer Reranking for Code Generation.☆45Updated 2 years ago
- Neural MMO - A Massively Multiagent Environment for Artificial Intelligence Research☆15Updated last year
- Renee: End-to-end training of extreme classification models☆23Updated 2 years ago
- URL downloader supporting checkpointing and continuous checksumming.☆19Updated last year
- Minimal library to train LLMs on TPU in JAX with pjit().☆298Updated last year
- Implementation of the SOTA Transformer architecture from PaLM - Scaling Language Modeling with Pathways in JAX/Flax☆14Updated 3 years ago
- Evaluation suite for large-scale language models.☆128Updated 4 years ago
- ☆17Updated 6 years ago
- ☆78Updated last year
- ☆44Updated last year
- This repository contains all the code for collecting large scale amounts of code from GitHub.☆109Updated 2 years ago
- Python tools for processing the stackexchange data dumps into a text dataset for Language Models☆82Updated last year
- GPT* - Training faster small transformers using ALiBi, Parallel Residual Connections and more!☆21Updated 3 years ago
- ☆92Updated 3 years ago
- ☆26Updated 2 years ago
- Background materials for the article "Productivity Assessment of Neural Code Completion"☆12Updated 2 years ago
- ☆26Updated last year
- ☆21Updated 4 years ago
- Easily benchmark Machine Learning models on selected tasks and datasets☆16Updated 2 years ago
- Web queries dataset for code search☆32Updated 2 years ago
- Implementation of "Analysing Mathematical Reasoning Abilities of Neural Models"☆30Updated 2 years ago
- ☆24Updated 3 years ago
- First-order logic theorem prover supporting unification with approximate vector similarity☆13Updated 2 years ago
- Helper scripts and notes that were used while porting various nlp models☆48Updated 3 years ago