Alternatives and similar repositories for The-Pile-PubMed

Users that are interested in The-Pile-PubMed are comparing it to the libraries listed below

• EleutherAI / pile-pubmedcentral
  A script for collecting the PubMed Central dataset in a language modelling friendly format.
  ☆25Updated 4 years ago
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆31Updated 2 years ago
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆48Updated 2 years ago
• Alab-NII / Awesome-SciLM
  Pre-trained Language Model for Scientific Text
  ☆45Updated last year
• hartvigsen-group / composable-interventions
  ☆28Updated 11 months ago
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆82Updated 3 years ago
• ShiZhengyan / PowerfulPromptFT
  [NeurIPS 2023 Main Track] This is the repository for the paper titled "Don’t Stop Pretraining? Make Prompt-based Fine-tuning Powerful Lea…
  ☆76Updated last year
• allenai / data-efficient-finetuning
  Code for paper 'Data-Efficient FineTuning'
  ☆28Updated 2 years ago
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆47Updated 10 months ago
• felixzli / synthetic_pretraining
  ☆38Updated 3 years ago
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆33Updated last year
• allenai / peS2o
  Pretraining Efficiently on S2ORC!
  ☆179Updated last year
• abhika-m / FAVA
  ☆75Updated last year
• eric11eca / disco
  Generating diverse counterfactual data for Natural Language Understanding tasks using Large Language Models (LLMs). The generator support…
  ☆38Updated 2 years ago
• csitfun / LogiCoT
  the instructions and demonstrations for building a formal logical reasoning capable GLM
  ☆55Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated 2 years ago
• Gleghorn-Lab / Mixture-of-Experts-Sentence-Similarity
  ☆16Updated 11 months ago
• mandyyyyii / scibench
  ☆130Updated last year
• kayoyin / interpret-lm
  Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)
  ☆62Updated 3 years ago
• luohongyin / UniLC
  Interpretable unified language safety checking with large language models
  ☆31Updated 2 years ago
• frankaging / Causal-Distill
  The Codebase for Causal Distillation for Language Models (NAACL '22)
  ☆26Updated 3 years ago
• Xianjun-Yang / DNA-GPT
  Offiical codes for DNA-GPT (ICLR 2024)
  ☆56Updated last year
• swj0419 / in-context-pretraining
  ☆55Updated last year
• THUDM / SciGLM
  SciGLM: Training Scientific Language Models with Self-Reflective Instruction Annotation and Tuning (NeurIPS D&B Track 2024)
  ☆86Updated last year
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆102Updated last year
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 3 years ago
• cambridgeltl / mop
  Codes for paper: Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERT
  ☆34Updated 3 years ago
• gersteinlab / BioCoder
  BioCoder: A Benchmark for Bioinformatics Code Generation with Large Language Models https://arxiv.org/abs/2308.16458
  ☆53Updated 6 months ago
• sunyt32 / torchscale
  Transformers at any scale
  ☆42Updated 2 years ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆78Updated 2 years ago