EleutherAI / openwebtext2Links
☆90Updated 2 years ago
Alternatives and similar repositories for openwebtext2
Users that are interested in openwebtext2 are comparing it to the libraries listed below
Sorting:
- Python tools for processing the stackexchange data dumps into a text dataset for Language Models☆80Updated last year
- Pipeline for pulling and processing online language model pretraining data from the web☆178Updated last year
- ☆78Updated last year
- Open source library for few shot NLP☆78Updated last year
- ☆97Updated 2 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated 2 years ago
- The pipeline for the OSCAR corpus☆167Updated last year
- Experiments with generating opensource language model assistants☆97Updated 2 years ago
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆209Updated last year
- Tools for managing datasets for governance and training.☆85Updated last week
- ☆33Updated 2 years ago
- Techniques used to run BLOOM at inference in parallel☆37Updated 2 years ago
- A framework for few-shot evaluation of autoregressive language models.☆103Updated 2 years ago
- This project studies the performance and robustness of language models and task-adaptation methods.☆150Updated last year
- Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)☆61Updated last year
- ☆72Updated 2 years ago
- ☆98Updated 2 years ago
- Adversarial Training and SFT for Bot Safety Models☆40Updated 2 years ago
- Transformers at any scale☆41Updated last year
- An experimental implementation of the retrieval-enhanced language model☆74Updated 2 years ago
- Script for downloading GitHub.☆95Updated 11 months ago
- ☆111Updated 2 years ago
- Evaluation suite for large-scale language models.☆125Updated 3 years ago
- YT_subtitles - extracts subtitles from YouTube videos to raw text for Language Model training☆43Updated 4 years ago
- ☆67Updated 2 years ago
- Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"☆59Updated 4 months ago
- Downloads 2020 English Wikipedia articles as plaintext☆24Updated 2 years ago
- The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)☆157Updated 2 years ago
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆180Updated 2 years ago
- Summary Explorer is a tool to visually explore the state-of-the-art in text summarization.☆44Updated last year