malteos / llm-datasetsLinks
A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
☆59Updated 10 months ago
Alternatives and similar repositories for llm-datasets
Users that are interested in llm-datasets are comparing it to the libraries listed below
Sorting:
- ☆48Updated 4 months ago
- Fine-tune ModernBERT on a large Dataset with Custom Tokenizer Training☆65Updated 4 months ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆129Updated last year
- Using open source LLMs to build synthetic datasets for direct preference optimization☆64Updated last year
- [EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.☆109Updated last year
- Generalist and Lightweight Model for Text Classification☆133Updated last week
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆77Updated 8 months ago
- ☆96Updated 6 months ago
- [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"☆32Updated 2 weeks ago
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning☆30Updated 2 years ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆48Updated last year
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆101Updated last year
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆58Updated last month
- ☆65Updated last year
- GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embeddings☆43Updated last year
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆72Updated last year
- Tools for managing datasets for governance and training.☆85Updated 3 weeks ago
- Efficient few-shot learning with cross-encoders.☆52Updated last year
- ☆100Updated 2 years ago
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆138Updated 2 weeks ago
- ☆57Updated 9 months ago
- ☆28Updated last year
- ☆86Updated 2 months ago
- Pretraining Efficiently on S2ORC!☆164Updated 8 months ago
- ☆44Updated 7 months ago
- German Alpaca Dataset (Cleaned + Translated)☆25Updated 2 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated 2 years ago
- One-stop shop for running and fine-tuning transformer-based language models for retrieval☆56Updated this week
- Retrieval-Augmented Generation battle!☆52Updated 6 months ago
- ☆10Updated 8 months ago