Alternatives and similar repositories for gpt-j-6b:

Users that are interested in gpt-j-6b are comparing it to the libraries listed below

• finetunej / transformers
  🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
  ☆56Updated 3 years ago
• leogao2 / commoncrawl_downloader
  ☆33Updated last year
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 2 years ago
• zphang / minimal-gpt-neox-20b
  ☆129Updated 2 years ago
• microsoft / xtreme-distil-transformers
  XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale
  ☆153Updated last year
• EleutherAI / openwebtext2
  ☆89Updated 2 years ago
• VE-FORBRYDERNE / mtj-softtuner
  Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance
  ☆27Updated 2 years ago
• LAION-AI / blade2blade
  Adversarial Training and SFT for Bot Safety Models
  ☆39Updated last year
• labmlai / neox
  Simple Annotated implementation of GPT-NeoX in PyTorch
  ☆110Updated 2 years ago
• finetunej / gpt-neo_finetune_2.7B
  ☆28Updated last year
• Rallio67 / language-model-agents
  Experiments with generating opensource language model assistants
  ☆97Updated last year
• EleutherAI / DeeperSpeed
  DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
  ☆164Updated 2 weeks ago
• guilhermemr04 / scaling-zero-shot-retrieval
  No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval
  ☆29Updated 2 years ago
• bloomberg / minilmv2.bb
  Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)
  ☆61Updated last year
• AI21Labs / lm-evaluation
  Evaluation suite for large-scale language models.
  ☆124Updated 3 years ago
• weaviate / biggraph-wikidata-search-with-weaviate
  Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine
  ☆31Updated 3 years ago
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated 2 years ago
• sdtblck / youtube_subtitle_dataset
  YT_subtitles - extracts subtitles from YouTube videos to raw text for Language Model training
  ☆41Updated 4 years ago
• basusourya / mirostat
  Code for the paper-"Mirostat: A Perplexity-Controlled Neural Text Decoding Algorithm" (https://arxiv.org/abs/2007.14966).
  ☆58Updated 3 years ago
• google-research-datasets / presto
  A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs
  ☆114Updated 2 years ago
• jina-ai / big_creative_ai
  BIG: Back In the Game of Creative AI
  ☆27Updated 2 years ago
• LAION-AI / interesting-text-datasets
  ☆43Updated 2 years ago
• curai / curai-research
  ☆93Updated 3 months ago
• csinva / iprompt
  Finding semantically meaningful and accurate prompts.
  ☆46Updated last year
• sleekmike / Finetune_GPT-J_6B_8-bit
  Fine-tuning GPT-J-6B on colab or equivalent PC GPU with your custom datasets: 8-bit weights with low-rank adaptors (LoRA)
  ☆74Updated 2 years ago
• lucidrains / marge-pytorch
  Implementation of Marge, Pre-training via Paraphrasing, in Pytorch
  ☆75Updated 4 years ago
• EagleW / Stage-wise-Fine-tuning
  Code for Stage-wise Fine-tuning for Graph-to-Text Generation
  ☆26Updated 2 years ago
• krandiash / gpt3-nli
  Training a model without a dataset for natural language inference (NLI)
  ☆25Updated 4 years ago
• CG80499 / trlx-with-T5
  [Added T5 support to TRLX] A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
  ☆47Updated 2 years ago
• AeroScripts / HiddenEngrams
  Hidden Engrams: Long Term Memory for Transformer Model Inference
  ☆35Updated 3 years ago