frankxu2004 / gpt-neoxLinks
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
☆17Updated 3 years ago
Alternatives and similar repositories for gpt-neox
Users that are interested in gpt-neox are comparing it to the libraries listed below
Sorting:
- URL downloader supporting checkpointing and continuous checksumming.☆19Updated last year
- MozoLM: A language model (LM) serving library☆45Updated last week
- ☆14Updated 2 years ago
- ☆53Updated 6 months ago
- Repository for analysis and experiments in the BigCode project.☆124Updated last year
- ☆44Updated last year
- Official code release for the paper Coder Reviewer Reranking for Code Generation.☆45Updated 2 years ago
- Python tools for processing the stackexchange data dumps into a text dataset for Language Models☆84Updated last year
- Scripts to parse arxiv documents for NLP tasks☆18Updated 2 years ago
- ☆26Updated 2 years ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆18Updated 2 years ago
- DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.☆168Updated 2 months ago
- PyTorch library for synthesizing programs from natural language☆18Updated last year
- Script for downloading GitHub.☆97Updated last year
- Downloads 2020 English Wikipedia articles as plaintext☆25Updated 2 years ago
- Pre-training code for CrystalCoder 7B LLM☆55Updated last year
- a list of StrongAI related resources.☆11Updated 2 years ago
- ☆78Updated 6 months ago
- T5Patches is a set of tools for fast and targeted editing of generative language models built with T5X.☆12Updated last year
- ☆17Updated 6 years ago
- Implementation of "Analysing Mathematical Reasoning Abilities of Neural Models"☆30Updated 2 years ago
- ☆91Updated 3 years ago
- ☆21Updated last year
- Helper scripts and notes that were used while porting various nlp models☆47Updated 3 years ago
- This repository contains all the code for collecting large scale amounts of code from GitHub.☆110Updated 2 years ago
- Semantic Code Search☆36Updated 2 years ago
- Renee: End-to-end training of extreme classification models☆23Updated last year
- A Python implementation of Toolformer using Huggingface Transformers☆14Updated 2 years ago
- Minimal library to train LLMs on TPU in JAX with pjit().☆301Updated last year
- ☆21Updated 3 years ago