openai / gpt-3

Related projects ⓘ

Alternatives and complementary repositories for gpt-3

• openai / gpt-2
  Code for the paper "Language Models are Unsupervised Multitask Learners"
  ☆22,489Updated 2 months ago
• EleutherAI / gpt-neox
  An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
  ☆6,928Updated this week
• google-research / bert
  TensorFlow code and pre-trained models for BERT
  ☆38,156Updated 3 months ago
• EleutherAI / gpt-neo
  An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.
  ☆8,233Updated 2 years ago
• microsoft / DeepSpeed
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
  ☆35,365Updated this week
• google-research / text-to-text-transfer-transformer
  Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"
  ☆6,160Updated last month
• microsoft / unilm
  Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
  ☆20,122Updated last week
• openai / gpt-2-output-dataset
  Dataset of GPT-2 outputs for research in detection, biases, and more
  ☆1,939Updated 10 months ago
• NVIDIA / Megatron-LM
  Ongoing research training transformer models at scale
  ☆10,480Updated this week
• explosion / spaCy
  💫 Industrial-strength Natural Language Processing (NLP) in Python
  ☆30,128Updated 2 weeks ago
• huggingface / tokenizers
  💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
  ☆9,038Updated this week
• facebookresearch / fastText
  Library for fast text representation and classification.
  ☆25,928Updated 7 months ago
• google-research / albert
  ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
  ☆3,245Updated last year
• FMInference / FlexLLMGen
  Running large language models on a single GPU for throughput-oriented scenarios.
  ☆9,186Updated last week
• facebookresearch / fairseq
  Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
  ☆30,468Updated 3 weeks ago
• google / sentencepiece
  Unsupervised text tokenizer for Neural Network-based text generation.
  ☆10,252Updated last week
• huggingface / transformers
  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
  ☆134,531Updated this week
• zihangdai / xlnet
  XLNet: Generalized Autoregressive Pretraining for Language Understanding
  ☆6,181Updated last year
• huggingface / diffusers
  🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
  ☆26,052Updated this week
• meta-llama / llama
  Inference code for Llama models
  ☆56,320Updated 2 months ago
• kingoflolz / mesh-transformer-jax
  Model parallel transformers in JAX and Haiku
  ☆6,291Updated last year
• elyase / awesome-gpt3
  ☆4,587Updated last year
• facebookresearch / faiss
  A library for efficient similarity search and clustering of dense vectors.
  ☆31,320Updated this week
• allenai / allennlp
  An open-source NLP research library, built on PyTorch.
  ☆11,756Updated last year
• facebookresearch / metaseq
  Repo for external large-scale work
  ☆6,513Updated 6 months ago
• horovod / horovod
  Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
  ☆14,247Updated 2 months ago
• microsoft / qlib
  Qlib is an AI-oriented quantitative investment platform that aims to realize the potential, empower research, and create value using AI t…
  ☆15,473Updated last month
• lucidrains / PaLM-rlhf-pytorch
  Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
  ☆7,700Updated 9 months ago
• salesforce / CodeGen
  CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.
  ☆4,931Updated 7 months ago