ltgoslo / gpt-bert
Official implementation of "GPT or BERT: why not both?"
☆12Updated this week
Related projects ⓘ
Alternatives and complementary repositories for gpt-bert
- Code for the paper "Getting the most out of your tokenizer for pre-training and domain adaptation"☆11Updated 9 months ago
- ☆14Updated last month
- Repo for "Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks" ACL 2023 Findings☆16Updated last year
- An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text Generation☆26Updated 5 months ago
- A package for fine tuning of pretrained NLP transformers using Semi Supervised Learning☆15Updated 3 years ago
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆18Updated 2 months ago
- ☆15Updated 3 months ago
- ☆15Updated 3 months ago
- ☆21Updated last week
- T-Projection is a method to perform high-quality Annotation Projection of Sequence Labeling datasets.☆11Updated 11 months ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆17Updated 3 weeks ago
- Transformers at any scale☆41Updated 9 months ago
- ☆44Updated 4 months ago
- DPO, but faster 🚀☆21Updated 2 weeks ago
- SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…☆44Updated last year
- ☆25Updated 11 months ago
- GlotCC Dataset and Pipline -- NeurIPS 2024☆16Updated last week
- Index of URLs to pdf files all over the internet and scripts☆21Updated last year
- In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning☆33Updated last year
- ☆28Updated 2 years ago
- HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]☆14Updated last year
- ☆26Updated 4 months ago
- Adding new tasks to T0 without catastrophic forgetting☆30Updated 2 years ago
- MAIR: A Massive Benchmark for Evaluating Instructed Retrieval. Evaluate your retrieval models on 126 diverse tasks. [EMNLP 2024]☆12Updated last week
- Few-shot Learning with Auxiliary Data☆26Updated 11 months ago
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Updated 8 months ago
- An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)☆24Updated 4 months ago
- 🌏 Modular retrievers for zero-shot multilingual IR.☆26Updated 8 months ago
- ☆19Updated last year