frankxu2004 / gpt-neoxLinks
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
☆17Updated 3 years ago
Alternatives and similar repositories for gpt-neox
Users that are interested in gpt-neox are comparing it to the libraries listed below
Sorting:
- ☆14Updated last year
- Official code release for the paper Coder Reviewer Reranking for Code Generation.☆45Updated 2 years ago
- Neural MMO - A Massively Multiagent Environment for Artificial Intelligence Research☆16Updated last year
- A collection of models built with ColossalAI☆32Updated 2 years ago
- MozoLM: A language model (LM) serving library☆45Updated this week
- URL downloader supporting checkpointing and continuous checksumming.☆19Updated last year
- ☆78Updated 3 months ago
- Implementation of "Analysing Mathematical Reasoning Abilities of Neural Models"☆30Updated 2 years ago
- ☆44Updated last year
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆18Updated 2 years ago
- Repository for analysis and experiments in the BigCode project.☆120Updated last year
- Re-implement DeepCoder (https://openreview.net/pdf?id=ByldLrqlx)☆108Updated 5 years ago
- DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.☆168Updated last month
- Python tools for processing the stackexchange data dumps into a text dataset for Language Models☆83Updated last year
- ☆26Updated 2 years ago
- Semantic Code Search☆35Updated 2 years ago
- ☆52Updated 4 months ago
- A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆32Updated 2 years ago
- This repo contains a set of notebooks to reproduce reinforcement learning algorithms.☆15Updated 2 years ago
- ☆43Updated 2 years ago
- ☆26Updated last year
- Evaluation suite for large-scale language models.☆126Updated 3 years ago
- Fault-aware neural code rankers☆28Updated 2 years ago
- Scripts to parse arxiv documents for NLP tasks☆18Updated 2 years ago
- Stuff related to scraping the Code Review StackExchange☆11Updated 2 years ago
- benchmarking some transformer deployments☆26Updated 2 years ago
- Code for the paper "Efficient Training of Language Models to Fill in the Middle"☆183Updated 2 years ago
- Minimal library to train LLMs on TPU in JAX with pjit().☆290Updated last year
- GPT* - Training faster small transformers using ALiBi, Parallel Residual Connections and more!☆20Updated 2 years ago
- Codebase for plCoP, a Prolog Technology Reinforcement Learning Prover☆12Updated 4 years ago