Experiments on including metadata such as URLs, timestamps, website descriptions and HTML tags during pretraining.
☆29Jun 12, 2023Updated 3 years ago
Alternatives and similar repositories for metadata
Users that are interested in metadata are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆65Aug 7, 2023Updated 3 years ago
- A barebones set of utilities that help run few-shot prompting using hf☆10Jul 1, 2026Updated 4 months ago
- A minimal example package running ollama on baskerville.☆11Nov 8, 2024Updated 2 years ago
- ParCourE - Parallel Corpus Explorer☆12Dec 27, 2021Updated 4 years ago
- ☆45Oct 3, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- [ICLR 2022] Towards Continual Knowledge Learning of Language Models☆91Oct 11, 2022Updated 4 years ago
- Web archiving utility library☆12Nov 3, 2026Updated 2 weeks ago
- Train word and document vectors using quanteda☆16Oct 30, 2026Updated 3 weeks ago
- ☆14Sep 27, 2023Updated 3 years ago
- CD20200004 from 01/01/2021 to 31/12/2023 - LIG UGA - Python Notebook and Models for the MT Lab @ ALPS 2022☆13Apr 1, 2024Updated 2 years ago
- Gram2Vec is a document embedding algorithm that embeds documents into a higher dimensional space based off grammatical style.☆12Sep 17, 2025Updated last year
- Aggregation for complex labels, described in https://www.ischool.utexas.edu/~ml/papers/braylan_web2020.pdf☆16Jun 7, 2024Updated 2 years ago
- ☆25Jan 22, 2024Updated 2 years ago
- evclust : Python library for evidential clustering☆14Mar 10, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Code used for sourcing and cleaning the BigScience ROOTS corpus☆319Mar 20, 2023Updated 3 years ago
- Pretrained Span and span Pair Encoder, code for "Pre-training Entity Relation Encoder with Intra-span and Inter-spanInformation.", EMNLP2…☆18Jan 26, 2022Updated 4 years ago
- Split bib files for anthology bibliography for overleaf☆11Aug 25, 2024Updated 2 years ago
- Metric Space Magnitude Computations☆15Jun 30, 2026Updated 4 months ago
- ☆15Jul 7, 2026Updated 4 months ago
- Code for the paper "Greed is All You Need: An Evaluation of Tokenizer Inference Methods"☆16Sep 2, 2026Updated 2 months ago
- ACL 2021 paper "Style is NOT a single variable: Case Studies for Cross-Style Language Understanding " by Dongyeop Kang and Eduard Hovy☆15Jul 19, 2021Updated 5 years ago
- [EMNLP 2022] Adapting a Language Model While Preserving its General Knowledge☆21Feb 12, 2023Updated 3 years ago
- Can Large Language Models Identify Authorship? (EMNLP 2024 Findings)☆14Feb 4, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Estimation of party positions from Wikipedia tags (see Herrmann/Döring 2021)☆10Aug 22, 2026Updated 2 months ago
- French to English translator on character level implemented by Keras☆10Jun 15, 2017Updated 9 years ago
- [EMNLP 2020] Collective HumAn OpinionS on Natural Language Inference Data☆45Updated this week
- Dialogue Act classification☆18Jan 15, 2024Updated 2 years ago
- Complete set of English dialect transformation rules and evaluation code☆16Jun 7, 2024Updated 2 years ago
- ☆14Jan 14, 2022Updated 4 years ago
- The Python library with command line tools to interact with Dynabench(https://dynabench.org/), such as uploading models.☆56Jun 23, 2022Updated 4 years ago
- All-in-one repository for Fine-tuning & Pretraining (Large) Language Models☆15Mar 8, 2023Updated 3 years ago
- Couchsurfing profile importer and previewer.☆14Jan 8, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- LLMJudge: LLM4Eval workshop data challenge on automatic relevance judgment☆14Jan 6, 2026Updated 10 months ago
- This is the repository for MorphScore, a tokenizer evaluation framework for morphological alignment.☆19Jul 10, 2025Updated last year
- A Test Collection for Evaluating Retrieval of Studies for Inclusion in Systematic Reviews☆13Sep 22, 2023Updated 3 years ago
- Measure the similarity of text corpora for 74 languages☆14Jan 26, 2024Updated 2 years ago
- ☆10Aug 11, 2019Updated 7 years ago
- Convert arctic_shift Reddit data dumps into thread-view documents☆11Jun 19, 2024Updated 2 years ago
- Translation Memory Open-source Purifier☆35Nov 6, 2022Updated 4 years ago
Are these results useful?