Alternatives and similar repositories for aws-neuron-reference-for-megatron-lm

Users that are interested in aws-neuron-reference-for-megatron-lm are comparing it to the libraries listed below

• cybertronai / bflm
  ☆17Updated 6 years ago
• stas00 / porting
  Helper scripts and notes that were used while porting various nlp models
  ☆48Updated 3 years ago
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆44Updated last year
• srush / tangent
  Source-to-Source Debuggable Derivatives in Pure Python
  ☆15Updated last year
• HazyResearch / embroid
  Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
  ☆11Updated 2 years ago
• srush / transformers-bet
  ☆12Updated 3 years ago
• facebookresearch / coder_reviewer_reranking
  Official code release for the paper Coder Reviewer Reranking for Code Generation.
  ☆45Updated 2 years ago
• stanfordnlp / multi-distribution-retrieval
  Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval
  ☆15Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated 2 years ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆68Updated last year
• ari-holtzman / newformer
  ☆15Updated 2 years ago
• microsoft / REBEL
  ☆42Updated 7 months ago
• UmerHA / triton_util
  Make triton easier
  ☆49Updated last year
• sunyt32 / torchscale
  Transformers at any scale
  ☆42Updated last year
• srush / LLM-Talk
  ☆52Updated last year
• r2llab / wrangl
  Parallel data preprocessing for NLP and ML.
  ☆34Updated last year
• eyalbd2 / RL-based-Language-Modeling
  ☆13Updated 6 years ago
• prateeky2806 / ComPEFT
  ☆26Updated 2 years ago
• IBM / model-recycling
  Ranking of fine-tuned HF models as base models.
  ☆36Updated 2 months ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆35Updated 2 years ago
• kyegomez / MM1
  PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"
  ☆24Updated last week
• AI21Labs / lm-evaluation
  Evaluation suite for large-scale language models.
  ☆128Updated 4 years ago
• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆49Updated last year
• sayakpaul / count-tokens-hf-datasets
  This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…
  ☆27Updated 3 years ago
• facebookresearch / concurrentqa
  This repo contains data and code for the paper "Reasoning over Public and Private Data in Retrieval-Based Systems."
  ☆46Updated last year
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆49Updated 2 years ago
• codekansas / rwkv
  RWKV model implementation
  ☆38Updated 2 years ago
• stanford-crfm / helm-efficiency
  ☆10Updated 2 years ago
• yangkevin2 / emnlp2020-stream-beam-mt
  ☆13Updated 5 years ago