frankxu2004 / gpt-neoxLinks
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
☆17Updated 3 years ago
Alternatives and similar repositories for gpt-neox
Users that are interested in gpt-neox are comparing it to the libraries listed below
Sorting:
- ☆14Updated 2 years ago
- MozoLM: A language model (LM) serving library☆47Updated 3 weeks ago
- Minimal library to train LLMs on TPU in JAX with pjit().☆301Updated 2 years ago
- ☆44Updated last year
- Scripts to parse arxiv documents for NLP tasks☆19Updated 2 years ago
- Evaluation suite for large-scale language models.☆129Updated 4 years ago
- ☆51Updated 5 years ago
- Official code release for the paper Coder Reviewer Reranking for Code Generation.☆45Updated 2 years ago
- ☆17Updated 6 years ago
- Repository for analysis and experiments in the BigCode project.☆128Updated last year
- URL downloader supporting checkpointing and continuous checksumming.☆19Updated 2 years ago
- Fault-aware neural code rankers☆30Updated 3 years ago
- This repository contains all the code for collecting large scale amounts of code from GitHub.☆110Updated 2 years ago
- PyTorch library for synthesizing programs from natural language☆18Updated last year
- PLUR (Programming-Language Understanding and Repair) is a collection of source code datasets suitable for graph-based machine learning. W…☆87Updated 3 years ago
- Semantic Code Search☆37Updated 2 years ago
- Neural MMO - A Massively Multiagent Environment for Artificial Intelligence Research☆15Updated last year
- Web queries dataset for code search☆32Updated 2 years ago
- Python tools for processing the stackexchange data dumps into a text dataset for Language Models☆85Updated 2 years ago
- Implementation of the SOTA Transformer architecture from PaLM - Scaling Language Modeling with Pathways in JAX/Flax☆14Updated 3 years ago
- Downloads 2020 English Wikipedia articles as plaintext☆25Updated 2 years ago
- ☆26Updated last year
- Jigsaw Dataset: Natural language to Python Pandas code☆55Updated 3 years ago
- A Python implementation of Toolformer using Huggingface Transformers☆14Updated 2 years ago
- Stuff related to scraping the Code Review StackExchange☆12Updated 2 years ago
- Pre-training code for CrystalCoder 7B LLM☆56Updated last year
- ☆26Updated 2 years ago
- ☆43Updated last year
- Renee: End-to-end training of extreme classification models☆23Updated 2 years ago
- ☆22Updated 2 years ago