EleutherAI / pile_dedupe

Related projects ⓘ

Alternatives and complementary repositories for pile_dedupe

• gmftbyGMFTBY / Rep-Dropout
  [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
  ☆30Updated last year
• swj0419 / in-context-pretraining
  ☆39Updated 7 months ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• McGill-NLP / retriever-lm-reasoning
  Code for "Can Retriever-Augmented Language Models Reason? The Blame Game Between the Retriever and the Language Model", EMNLP Findings 20…
  ☆27Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆18Updated 3 months ago
• allenai / data-efficient-finetuning
  Code for paper 'Data-Efficient FineTuning'
  ☆29Updated last year
• ChiyuSONG / dynamics-of-instruction-tuning
  ☆16Updated 8 months ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆73Updated last year
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆47Updated 4 months ago
• KwanWaiChung / M4LE
  Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models
  ☆22Updated 3 months ago
• Leezekun / dialogic
  [EMNLP 2022] Code and data for "Controllable Dialogue Simulation with In-Context Learning"
  ☆34Updated last year
• Muennighoff / FLAN
  Provides a minimal implementation to extract FLAN datasets for further processing
  ☆11Updated last year
• ndaheim / faithful-dialogue
  ☆23Updated last year
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated 10 months ago
• Adaxry / Post-Instruction
  ☆21Updated last year
• prakharguptaz / Instructdial
  Code for the paper Code for the paper InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning
  ☆97Updated last year
• gmftbyGMFTBY / MomentumDecoding
  Momentum Decoding: Open-ended Text Generation as Graph Exploration
  ☆19Updated last year
• Shark-NLP / CAB
  ☆30Updated last year
• FreedomIntelligence / DPTDR
  Code for COLING22 paper, DPTDR: Deep Prompt Tuning for Dense Passage Retrieval
  ☆24Updated last year
• jxhe / efficient-knnlm
  Pytorch implementation of paper "Efficient Nearest Neighbor Language Models" (EMNLP 2021)
  ☆71Updated 2 years ago
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆79Updated 2 months ago
• princeton-nlp / Collie
  [ICLR 2024] COLLIE: Systematic Construction of Constrained Text Generation Tasks
  ☆52Updated last year
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆83Updated last year
• nayeon7lee / FactualityPrompt
  ☆80Updated 2 years ago
• mtbench101 / mt-bench-101
  [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues
  ☆51Updated 4 months ago
• anadim / the-little-retrieval-test
  ☆31Updated last year
• krystalan / chatgpt_as_nlg_evaluator
  Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study
  ☆42Updated last year
• suzgunmirac / crowd-sampling
  Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding
  ☆18Updated 2 years ago
• RUCAIBox / ELMER
  This repository is the official implementation of our EMNLP 2022 paper ELMER: A Non-Autoregressive Pre-trained Language Model for Efficie…
  ☆26Updated 2 years ago
• LLaMafia / SFT_function_learning
  Explore what LLMs are really leanring over SFT
  ☆26Updated 7 months ago