EleutherAI / gpt-neo
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
☆8,232Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for gpt-neo
- An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries☆6,947Updated this week
- Model parallel transformers in JAX and Haiku☆6,298Updated last year
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆35,508Updated this week
- Repo for external large-scale work☆6,516Updated 6 months ago
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆20,199Updated 3 months ago
- A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Auto…☆12,150Updated this week
- A collection of libraries to optimise AI model performances☆8,375Updated 3 months ago
- Code for the paper "Language Models are Unsupervised Multitask Learners"☆22,546Updated 3 months ago
- Instruct-tune LLaMA on consumer hardware☆18,653Updated 3 months ago
- GPT-3: Language Models are Few-Shot Learners☆15,692Updated 4 years ago
- Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM☆7,705Updated 10 months ago
- Running large language models on a single GPU for throughput-oriented scenarios.☆9,198Updated 3 weeks ago
- Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!☆34,030Updated this week
- A very simple framework for state-of-the-art Natural Language Processing (NLP)☆13,946Updated this week
- RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…☆12,672Updated this week
- Train transformer language models with reinforcement learning.☆10,086Updated this week
- Ongoing research training transformer models at scale☆10,595Updated this week
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆30,552Updated last month
- ☆1,508Updated last year
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆29,561Updated 4 months ago
- 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…☆7,958Updated this week
- Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch☆5,572Updated 9 months ago
- Python package to easily retrain OpenAI's GPT-2 text-generating model on new texts☆3,398Updated last year
- A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆4,502Updated 10 months ago
- ☆2,686Updated this week
- 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading☆9,248Updated 2 months ago
- GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)☆7,657Updated last year
- 💥 Fast State-of-the-Art Tokenizers optimized for Research and Production☆9,052Updated this week
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆16,471Updated this week