Experiments on including metadata such as URLs, timestamps, website descriptions and HTML tags during pretraining.
☆29Jun 12, 2023Updated 3 years ago
Alternatives and similar repositories for metadata
Users that are interested in metadata are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ParCourE - Parallel Corpus Explorer☆12Dec 27, 2021Updated 4 years ago
- [EMNLP 2022] TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models☆75May 15, 2024Updated 2 years ago
- Tutorial on Transformers 🤖, HuggingFace 🤗 and Social Science Applications 👥 @ IC2S2☆17Aug 8, 2021Updated 5 years ago
- ☆14Sep 27, 2023Updated 2 years ago
- [ICLR 2022] Towards Continual Knowledge Learning of Language Models☆91Oct 11, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Train word and document vectors using quanteda☆16Sep 10, 2026Updated last week
- ☆16Aug 10, 2022Updated 4 years ago
- evclust : Python library for evidential clustering☆14Mar 10, 2025Updated last year
- ☆25Jan 22, 2024Updated 2 years ago
- Self-hosted open-source platform / harness for AI-powered survey interviews. Voice-to-voice and text chat agents with semi-structured int…☆25Sep 11, 2026Updated last week
- Code for the paper "Greed is All You Need: An Evaluation of Tokenizer Inference Methods"☆15Sep 2, 2026Updated 2 weeks ago
- Code used for sourcing and cleaning the BigScience ROOTS corpus☆318Mar 20, 2023Updated 3 years ago
- Pretrained Span and span Pair Encoder, code for "Pre-training Entity Relation Encoder with Intra-span and Inter-spanInformation.", EMNLP2…☆18Jan 26, 2022Updated 4 years ago
- Metric Space Magnitude Computations☆15Jun 30, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [EMNLP 2022] Adapting a Language Model While Preserving its General Knowledge☆21Feb 12, 2023Updated 3 years ago
- Dialogue Act classification☆18Jan 15, 2024Updated 2 years ago
- Couchsurfing profile importer and previewer.☆14Jan 8, 2023Updated 3 years ago
- The Python library with command line tools to interact with Dynabench(https://dynabench.org/), such as uploading models.☆56Jun 23, 2022Updated 4 years ago
- Keyphase Extraction Package☆10Aug 24, 2020Updated 6 years ago
- Stuff related to scraping the Code Review StackExchange☆11Jan 19, 2023Updated 3 years ago
- Repository of GitHub Actions used by the Oh My Zsh project☆22Sep 4, 2020Updated 6 years ago
- ☆14Jan 25, 2026Updated 7 months ago
- An opinionated NLP research template☆10Aug 29, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This is the repository for the CMU course 67-300: Search Engines☆11Nov 8, 2023Updated 2 years ago
- Repository for code related to "LLM-Based Machine Translation for Expansion of Spoken Language Understanding Systems to New Languages" pu…☆16Apr 12, 2024Updated 2 years ago
- Translation Memory Open-source Purifier☆35Nov 6, 2022Updated 3 years ago
- GLADIS: A General and Large Acronym Disambiguation Benchmark (EACL 23)☆18Jun 24, 2024Updated 2 years ago
- GermaParl: Corpus of Plenary Protocols of the German Bundestag (TEI Format)☆39Jun 1, 2023Updated 3 years ago
- A scikit-learn compliant implementation of Monroe et al.'s Fightin' Words analysis method.☆11May 26, 2026Updated 3 months ago
- Reproduction of Vision Transformer in Tensorflow2. Train from scratch and Finetune.☆49Dec 19, 2021Updated 4 years ago
- ☆10Aug 11, 2019Updated 7 years ago
- [TACL 2024] Improving Probability-based Prompt Selection Through Unified Evaluation and Analysis☆11Nov 14, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- FastContext is an optimized Java implementation of ConText algorithm (https://www.ncbi.nlm.nih.gov/pubmed/23920642).☆14Oct 19, 2021Updated 4 years ago
- Python source code for EMNLP 2020 paper "Reusing a Pretrained Language Model on Languages with Limited Corpora for Unsupervised NMT".☆35Mar 16, 2022Updated 4 years ago
- [ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning☆98Apr 26, 2023Updated 3 years ago
- GeoServer & GeoTools SQL Injection (CVE-2023-25157 & CVE-2023-25158)☆14Jun 11, 2023Updated 3 years ago
- Toolkit for domain-specific information retrieval experimentation☆19May 18, 2026Updated 4 months ago
- Data Management with SQL for Social Scientists☆12Updated this week
- Code for 'Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality', EMNLP 2022☆31May 29, 2023Updated 3 years ago