bamman-group / gpt4-booksLinks
Code and data to support "Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4"
☆69Updated 2 years ago
Alternatives and similar repositories for gpt4-books
Users that are interested in gpt4-books are comparing it to the libraries listed below
Sorting:
- Code for SaGe subword tokenizer (EACL 2023)☆25Updated 6 months ago
- ☆22Updated 5 months ago
- ☆67Updated last year
- Efficiently computing & storing token n-grams from large corpora☆24Updated 8 months ago
- Plug-and-play Search Interfaces with Pyserini and Hugging Face☆32Updated last year
- Documentation effort for the BookCorpus dataset☆34Updated 4 years ago
- ☆38Updated last year
- BPE modification that implements removing of the intermediate tokens during tokenizer training.☆25Updated 7 months ago
- ☆95Updated last year
- Understanding how features learned by neural networks evolve throughout training☆36Updated 8 months ago
- ☆36Updated 2 years ago
- Search through Facebook Research's PyTorch BigGraph Wikidata-dataset with the Weaviate vector search engine☆31Updated 3 years ago
- 🤗 Disaggregators: Curated data labelers for in-depth analysis.☆66Updated 2 years ago
- [EMNLP 2024 Main] Virtual Personas for Language Models via an Anthology of Backstories☆28Updated 7 months ago
- Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)☆41Updated 3 years ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 9 months ago
- ☆35Updated 2 years ago
- Code repo for "Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers" (ACL 2023)☆22Updated last year
- Ranking of fine-tuned HF models as base models.☆35Updated last month
- ☆31Updated 2 years ago
- Finding semantically meaningful and accurate prompts.☆47Updated last year
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆34Updated last year
- An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)☆33Updated last year
- This repo contains code for the paper "Psychologically-informed chain-of-thought prompts for metaphor understanding in large language mod…☆14Updated 2 years ago
- ☆13Updated 2 years ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- Embedding Recycling for Language models☆38Updated last year
- Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"☆28Updated 3 years ago
- Learning to route instances for Human vs AI Feedback (ACL 2025 Main)☆23Updated last month
- analysis of public NLP corpora☆11Updated 2 years ago