aws-neuron / aws-neuron-reference-for-megatron-lm
☆14Updated last year
Alternatives and similar repositories for aws-neuron-reference-for-megatron-lm:
Users that are interested in aws-neuron-reference-for-megatron-lm are comparing it to the libraries listed below
- Code for our paper Resources and Evaluations for Multi-Distribution Dense Information Retrieval☆14Updated last year
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- Minimum Description Length probing for neural network representations☆19Updated last month
- Official code release for the paper Coder Reviewer Reranking for Code Generation.☆42Updated 2 years ago
- Ranking of fine-tuned HF models as base models.☆35Updated last year
- Some microbenchmarks and design docs before commencement☆12Updated 4 years ago
- Resources accompanying the "Zero-Shot Recommendation as Language Modeling" paper (ECIR2022)☆13Updated last year
- NLG Best Practices for Data-Efficient Modeling How to Train Production-Ready Models with Little Data☆10Updated 3 years ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated last year
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- Helper scripts and notes that were used while porting various nlp models☆45Updated 3 years ago
- Aioli: A unified optimization framework for language model data mixing☆22Updated 2 months ago
- See https://github.com/cuda-mode/triton-index/ instead!☆11Updated 10 months ago
- Transformers at any scale☆41Updated last year
- [ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators☆24Updated last year
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆23Updated last week
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆47Updated last year
- Analogous Safe-state Exploration (ASE) is an algorithm for provably safe and optimal exploration in MDPs with unknown, stochastic dynamic…☆11Updated 4 years ago
- ☆15Updated last year
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆32Updated 10 months ago
- A Benchmark for Robust, Multi-evidence, Multi-answer Question Answering☆16Updated 2 years ago
- ☆9Updated last year
- Parallel data preprocessing for NLP and ML.☆34Updated 4 months ago
- Learning to Model Editing Processes☆26Updated 2 years ago
- HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]☆14Updated last year
- Code for "Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-Ranking" (https://arxiv.org/abs/2…☆13Updated last year
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 10 months ago
- Code repo for "Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers" (ACL 2023)☆22Updated last year
- Implementation of N-Grammer in Flax☆17Updated 2 years ago