Alternatives and similar repositories for Megatron-LM:

Users that are interested in Megatron-LM are comparing it to the libraries listed below

• huggingface / roots-search-tool
  Scripts supporting the development and serving the Roots Search Tool - https://hf.co/spaces/bigscience-data/roots-search
  ☆10Updated last year
• microsoft / AMOS
  [ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
  ☆24Updated last year
• salesforce / adversarial-polyglots
  Code for the paper "Code-Mixing on Sesame Street: Dawn of the Adversarial Polyglots" (NAACL-HLT 2021)
  ☆10Updated 2 years ago
• EleutherAI / best-download
  URL downloader supporting checkpointing and continuous checksumming.
  ☆19Updated last year
• TheoCoombes / crawlingathome
  A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.
  ☆32Updated last year
• MilaNLProc / language-invariant-properties
  ☆22Updated 2 years ago
• jackbandy / bookcorpus-datasheet
  Documentation effort for the BookCorpus dataset
  ☆33Updated 3 years ago
• EagleW / Stage-wise-Fine-tuning
  Code for Stage-wise Fine-tuning for Graph-to-Text Generation
  ☆26Updated last year
• rycolab / probing-via-prompting
  ☆11Updated 2 years ago
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• EleutherAI / tokengrams
  Efficiently computing & storing token n-grams from large corpora
  ☆17Updated 3 months ago
• comet-ml / blog-serving-hugging-face-models
  ☆20Updated 3 years ago
• huggingface / gaia
  Hugging Face and Pyserini interoperability
  ☆20Updated last year
• microsoft / CyBERTron-LM
  CyBERTron-LM is a project which collects some pre-trained Transformer-based models.
  ☆12Updated last year
• salesforce / simplification
  ☆21Updated last year
• LauraRuis / do-pigs-fly
  ☆16Updated last year
• salesforce / TaiChi
  Open source library for few shot NLP
  ☆77Updated last year
• overwindows / PALM
  PALM: Pre-training an Autoencoding & Autoregressive Language Model for Context-conditioned Generation
  ☆34Updated last year
• huggingface / spm_precompiled
  Highly specialized crate to parse and use `google/sentencepiece` 's precompiled_charsmap in `tokenizers`
  ☆18Updated 2 years ago
• dojoteef / storium-gpt2
  Source code for the GPT-2 story generation models in the EMNLP 2020 paper "STORIUM: A Dataset and Evaluation Platform for Human-in-the-Lo…
  ☆39Updated last year
• ncoop57 / vscode-codecomplete
  This repo contains all of the code for my Youtube series on how to create a VSCode extension for autocompleting code using Deep Learning!
  ☆15Updated 3 years ago
• microsoft / DeFacto
  DeFacto - Demonstrations and Feedback for improving factual consistency of text summarization
  ☆27Updated 2 years ago
• benpry / chain-of-thought-metaphor
  This repo contains code for the paper "Psychologically-informed chain-of-thought prompts for metaphor understanding in large language mod…
  ☆14Updated last year
• kaustubhdhole / natural-dont-know
  Code for the paper: Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queries
  ☆19Updated 3 years ago
• boschresearch / adversarial_meta_embeddings
  Resources related to EMNLP 2021 paper "FAME: Feature-Based Adversarial Meta-Embeddings for Robust Input Representations"
  ☆13Updated 3 years ago
• bltlab / seqscore
  SeqScore: Scoring for named entity recognition and other sequence labeling tasks
  ☆22Updated 2 weeks ago
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated last year
• gonglinyuan / metro_t0
  Code repo for "Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers" (ACL 2023)
  ☆22Updated last year
• basusourya / mirostat
  Code for the paper-"Mirostat: A Perplexity-Controlled Neural Text Decoding Algorithm" (https://arxiv.org/abs/2007.14966).
  ☆57Updated 2 years ago