EleutherAI / pile-pubmedcentral
A script for collecting the PubMed Central dataset in a language modelling friendly format.
☆24Updated 4 years ago
Alternatives and similar repositories for pile-pubmedcentral:
Users that are interested in pile-pubmedcentral are comparing it to the libraries listed below
- Download, parse, and filter data PubMed, data-ready for The-Pile☆23Updated 3 years ago
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆40Updated last month
- Embedding Recycling for Language models☆38Updated last year
- This is the official PyTorch repo for "UNIREX: A Unified Learning Framework for Language Model Rationale Extraction" (ICML 2022).☆24Updated 2 years ago
- SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…☆33Updated 11 months ago
- Code and Dataset for Learning to Solve Complex Tasks by Talking to Agents☆24Updated 2 years ago
- Code for paper 'Data-Efficient FineTuning'☆29Updated last year
- official repo of AAAI2024 paper Mitigating the Impact of False Negatives in Dense Retrieval with Contrastive Confidence Regularization☆13Updated last year
- Aioli: A unified optimization framework for language model data mixing☆23Updated 3 months ago
- ☆46Updated last year
- Adding new tasks to T0 without catastrophic forgetting☆33Updated 2 years ago
- ☆25Updated last year
- Transformers at any scale☆41Updated last year
- Multimodal Transformers for biomedical text and Knowledge Graph data☆34Updated 2 years ago
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆35Updated 2 months ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆19Updated 2 months ago
- Code for "Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-Ranking" (https://arxiv.org/abs/2…☆13Updated 2 years ago
- [NeurIPS 2023 Main Track] This is the repository for the paper titled "Don’t Stop Pretraining? Make Prompt-based Fine-tuning Powerful Lea…☆73Updated last year
- In-BoXBART: Get Instructions into Biomedical Multi-task Learning☆14Updated 2 years ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated last year
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆30Updated this week
- The codebase for our ACL2023 paper: Did You Read the Instructions? Rethinking the Effectiveness of Task Definitions in Instruction Learni…☆29Updated last year
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆48Updated last year
- Tasks for describing differences between text distributions.☆16Updated 8 months ago
- ☆26Updated 11 months ago
- Codes for paper: Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERT☆33Updated 2 years ago
- [EMNLP-2022 Findings] Code for paper “ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback”.☆26Updated 2 years ago
- ☆35Updated last year
- ☆28Updated last month
- Zero-Shot Learning in Named Entity Recognition with Common Sense Knowledge☆17Updated 3 years ago