google-research-datasets / common-crawl-domain-names
Corpus of domain names scraped from Common Crawl and manually annotated to add word boundaries (e.g. "commoncrawl" to "common crawl").
☆17Updated 3 years ago
Related projects: ⓘ
- scraper for facebook, gab, google and tiktok☆22Updated 2 months ago
- Unreliable News Index (for Columbia Journalism Review)☆55Updated 2 years ago
- This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around t…☆31Updated last year
- ☆31Updated last year
- Chrome extension to scrape a user's entire timeline, bypassing the Twitter API 3200 tweet limit☆25Updated last year
- arXiv plain text extraction☆41Updated last year
- Code and Dataset for Memeify: A Large-scale Meme Generation System☆25Updated 4 years ago
- Architecture of Twint scrapper which allow download tweets on many instances without api restrictions☆10Updated 3 years ago
- Automatically exported from code.google.com/p/wiki-links☆41Updated 8 years ago
- Common crawl extractor☆67Updated 4 months ago
- Tools & scripts to infer new Wikipedia infobox to ontology mappings☆21Updated 8 years ago
- Detecting gibberish as a type of sentiment analysis with GPT2☆24Updated 3 years ago
- Training a model without a dataset for natural language inference (NLI)☆25Updated 4 years ago
- An authorship attribution project with particular emphasis on Twitter analysis☆16Updated 2 years ago
- 📜Neural Text Simplification to Improve Chatbot Performance☆13Updated 6 years ago
- Detects if a sentence is in a subjective or objective form☆23Updated last year
- The News Landscape Toolkit (NELA)☆15Updated 3 years ago
- Statistics of Common Crawl monthly archives mined from URL index files☆140Updated 2 weeks ago
- Cloud crawler functions for scrapeulous☆44Updated 3 years ago
- Matrix-based News Aggregation to Explore Media Bias☆19Updated 6 years ago
- A summarization dataset consisting of over 17k open access business journal articles.☆9Updated 3 years ago
- ☆16Updated this week
- YT_subtitles - extracts subtitles from YouTube videos to raw text for Language Model training☆38Updated 3 years ago
- A simple web scraper using Python, Selenium, and requests-html to grab screenshots of google ads landing pages☆12Updated 4 years ago
- Documentation effort for the BookCorpus dataset☆30Updated 3 years ago
- Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends☆57Updated 7 months ago
- Index Common Crawl archives in tabular format☆105Updated last week
- DomainsProject.org HTTP worker☆20Updated last year
- Analyze and extract Wikipedia article text and attributes and store them into an ElasticSearch index or to json files (multilingual suppo…☆45Updated last year
- Common Crawl Index Server☆65Updated 8 months ago