Alternatives and similar repositories for aws-neuron-reference-for-megatron-lm

Users that are interested in aws-neuron-reference-for-megatron-lm are comparing it to the libraries listed below

• cybertronai / bflm
  ☆17Updated 6 years ago
• stas00 / porting
  Helper scripts and notes that were used while porting various nlp models
  ☆49Updated 3 years ago
• facebookresearch / coder_reviewer_reranking
  Official code release for the paper Coder Reviewer Reranking for Code Generation.
  ☆45Updated 2 years ago
• srush / tangent
  Source-to-Source Debuggable Derivatives in Pure Python
  ☆15Updated 2 years ago
• leogao2 / lm_dataformat
  ☆78Updated 2 years ago
• HazyResearch / embroid
  Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
  ☆11Updated 2 years ago
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆44Updated 2 years ago
• sunyt32 / torchscale
  Transformers at any scale
  ☆42Updated 2 years ago
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated last month
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆69Updated last year
• AI21Labs / lm-evaluation
  Evaluation suite for large-scale language models.
  ☆129Updated 4 years ago
• stanfordnlp / multi-distribution-retrieval
  Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval
  ☆15Updated 2 years ago
• sayakpaul / count-tokens-hf-datasets
  This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…
  ☆27Updated 3 years ago
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated 2 years ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆59Updated 3 years ago
• prateeky2806 / ComPEFT
  ☆26Updated 2 years ago
• srush / LLM-Talk
  ☆53Updated 2 years ago
• ari-holtzman / newformer
  ☆15Updated 2 years ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆49Updated 2 years ago
• zomux / lanmt-ebm
  lanmt ebm
  ☆12Updated 5 years ago
• jungokasai / beam_with_patience
  ☆46Updated 3 years ago
• kyegomez / MM1
  PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"
  ☆26Updated last week
• srush / transformers-bet
  ☆12Updated 3 years ago
• haileyschoelkopf / triton-index
  See https://github.com/cuda-mode/triton-index/ instead!
  ☆11Updated last year
• UmerHA / triton_util
  Make triton easier
  ☆50Updated last year
• modal-labs / stopwatch
  A tool for benchmarking LLMs on Modal
  ☆46Updated 5 months ago
• felixzli / synthetic_pretraining
  ☆38Updated 3 years ago
• TalSchuster / CATs
  Confident Adaptive Transformers
  ☆14Updated 4 years ago
• yurakuratov / t5-experiments
  Tools and scripts for experimenting with Transformers: Bert, T5...
  ☆61Updated 2 years ago