Alternatives and similar repositories for aws-neuron-reference-for-megatron-lm

Users that are interested in aws-neuron-reference-for-megatron-lm are comparing it to the libraries listed below

• srush / tangent
  Source-to-Source Debuggable Derivatives in Pure Python
  ☆15Updated last year
• cybertronai / bflm
  ☆17Updated 6 years ago
• HazyResearch / embroid
  Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
  ☆11Updated 2 years ago
• stas00 / porting
  Helper scripts and notes that were used while porting various nlp models
  ☆48Updated 3 years ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• HendrikStrobelt / LMdiff
  A diff tool for language models
  ☆44Updated last year
• kyegomez / MM1
  PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"
  ☆24Updated this week
• stanfordnlp / multi-distribution-retrieval
  Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval
  ☆15Updated last year
• haileyschoelkopf / triton-index
  See https://github.com/cuda-mode/triton-index/ instead!
  ☆10Updated last year
• srush / LLM-Talk
  ☆52Updated last year
• stanford-crfm / helm-efficiency
  ☆10Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆37Updated 2 years ago
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆35Updated 2 years ago
• prateeky2806 / ComPEFT
  ☆26Updated last year
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated 2 years ago
• UmerHA / triton_util
  Make triton easier
  ☆48Updated last year
• facebookresearch / coder_reviewer_reranking
  Official code release for the paper Coder Reviewer Reranking for Code Generation.
  ☆45Updated 2 years ago
• UKPLab / on-emergence
  Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning
  ☆33Updated 10 months ago
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated last year
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆68Updated 11 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆20Updated 9 months ago
• sayakpaul / count-tokens-hf-datasets
  This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…
  ☆27Updated 3 years ago
• ari-holtzman / newformer
  ☆15Updated 2 years ago
• srush / transformers-bet
  ☆12Updated 3 years ago
• srush / drop7
  ☆18Updated last year
• zomux / lanmt-ebm
  lanmt ebm
  ☆12Updated 5 years ago
• anyscale / long-context-fine-tuning-blogpost
  ☆17Updated last year
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆75Updated last year
• yikangshen / megablocks
  ☆20Updated last year
• codekansas / rwkv
  RWKV model implementation
  ☆38Updated 2 years ago