Alternatives and similar repositories for aws-neuron-reference-for-megatron-lm

Users that are interested in aws-neuron-reference-for-megatron-lm are comparing it to the libraries listed below

• cybertronai / bflm
  ☆17Updated 6 years ago
• haileyschoelkopf / triton-index
  See https://github.com/cuda-mode/triton-index/ instead!
  ☆10Updated last year
• stas00 / porting
  Helper scripts and notes that were used while porting various nlp models
  ☆48Updated 3 years ago
• srush / tangent
  Source-to-Source Debuggable Derivatives in Pure Python
  ☆15Updated last year
• HazyResearch / embroid
  Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
  ☆11Updated 2 years ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• UmerHA / triton_util
  Make triton easier
  ☆48Updated last year
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆44Updated last year
• samblouir / birdie
  ☆13Updated 5 months ago
• stanfordnlp / multi-distribution-retrieval
  Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval
  ☆15Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated 2 years ago
• eyalbd2 / RL-based-Language-Modeling
  ☆13Updated 6 years ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆68Updated 10 months ago
• srush / transformers-bet
  ☆12Updated 3 years ago
• lvwerra / deep-math
  Implementation of "Analysing Mathematical Reasoning Abilities of Neural Models"
  ☆30Updated 2 years ago
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆34Updated 2 years ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆35Updated 2 years ago
• ari-holtzman / newformer
  ☆16Updated 2 years ago
• prateeky2806 / ComPEFT
  ☆26Updated last year
• leogao2 / lm_dataformat
  ☆79Updated last year
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated last year
• renll / SeqBoat
  [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling
  ☆39Updated last year
• facebookresearch / concurrentqa
  This repo contains data and code for the paper "Reasoning over Public and Private Data in Retrieval-Based Systems."
  ☆46Updated last year
• facebookresearch / coder_reviewer_reranking
  Official code release for the paper Coder Reviewer Reranking for Code Generation.
  ☆45Updated 2 years ago
• sayakpaul / count-tokens-hf-datasets
  This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…
  ☆27Updated 3 years ago
• HazyResearch / mongoose
  A Learnable LSH Framework for Efficient NN Training
  ☆33Updated 4 years ago
• AI21Labs / lm-evaluation
  Evaluation suite for large-scale language models.
  ☆128Updated 4 years ago
• kyegomez / MM1
  PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"
  ☆24Updated last week
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆59Updated 2 years ago
• microsoft / REBEL
  ☆41Updated 6 months ago