datawizard1337 / ARGUS
ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9
☆88Updated 3 years ago
Alternatives and similar repositories for ARGUS:
Users that are interested in ARGUS are comparing it to the libraries listed below
- Tag news stories based on models trained on the NYT corpus.☆42Updated 2 years ago
- Extracts key terminology (n-grams) from any large collection of documents (>1000) and forecasts emergence☆64Updated last year
- A set of jupyter notebooks demonstrating how to use the Media Cloud API.☆37Updated last year
- Scraper for Facebook's Archive of Ads with Political Content☆36Updated 6 years ago
- A helper library full of URL-related heuristics.☆69Updated last month
- A Python scraper for the Facebook Ad Library, using the official Facebook Ad Library API.☆119Updated 5 years ago
- A Python Client for collect and parse public data from the Youtube Data API☆81Updated last year
- Given a job title and job description, the algorithm assigns a standard occupational classification (SOC) code to the job.☆73Updated 10 months ago
- A classifier that distinguishes political from non-political news articles.☆30Updated last year
- Pre-built Scrapy spiders for AutoExtract☆19Updated last year
- Pushshift Telegram Ingest☆86Updated 5 years ago
- Given a set of URLs, this packages detects coordinated link sharing behavior on social media and outputs the network of entities that per…☆75Updated 8 months ago
- Tools for auditing autocomplete on Google and Bing☆23Updated 3 months ago
- Collector for Facebook's Political Ad API☆31Updated 2 years ago
- Social Watcher on Facebook Marketing API☆114Updated 2 years ago
- Examples for getting started using https://case.law☆65Updated 2 years ago
- A multi-modal Twitter dataset with 7.6M tweets and 25.6M retweets related to voter fraud claims.☆53Updated 3 years ago
- An automated, programming-free web scraper for interactive sites☆110Updated last year
- This repository provides usage examples for the Python module Newspaper3k.☆147Updated last year
- Fast, flexible name matching for large datasets☆72Updated last year
- Public client for consuming content from the Media Cloud Online News Archive & Directory.☆72Updated 5 months ago
- ☆22Updated 3 years ago
- Command-line utility to help researchers collect video metadata from Youtube API☆29Updated 8 months ago
- A list of over 5000 US news domains and their social media accounts☆44Updated 2 years ago
- Extract networks of entities from journalistic reporting☆48Updated last year
- Google Trends, made easy.☆107Updated 10 months ago
- Tool to scrape linkedin☆78Updated 3 years ago
- Find rss, atom, xml, and rdf feeds on webpages☆30Updated 7 months ago
- Tools for collecting social media data around focal events☆84Updated 3 years ago
- Now included in rigour☆151Updated this week