datawizard1337 / ARGUS
ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9
☆88Updated 3 years ago
Alternatives and similar repositories for ARGUS:
Users that are interested in ARGUS are comparing it to the libraries listed below
- Scraper for Facebook's Archive of Ads with Political Content☆36Updated 6 years ago
- Extracts key terminology (n-grams) from any large collection of documents (>1000) and forecasts emergence☆62Updated last year
- A helper library full of URL-related heuristics.☆64Updated 4 months ago
- A Python scraper for the Facebook Ad Library, using the official Facebook Ad Library API.☆118Updated 5 years ago
- Given a set of URLs, this packages detects coordinated link sharing behavior on social media and outputs the network of entities that per…☆74Updated 6 months ago
- ☆22Updated 2 years ago
- Pre-built Scrapy spiders for AutoExtract☆19Updated 9 months ago
- Political Discourse Analysis Using Pre-Trained Word Vectors.☆22Updated 2 years ago
- The documentation and scripts for the Local News Dataset☆24Updated 2 years ago
- Command-line utility to help researchers collect video metadata from Youtube API☆29Updated 5 months ago
- The most advanced debugging and testing tool for Scrapy☆16Updated last year
- A Python Client for collect and parse public data from the Youtube Data API☆80Updated last year
- ☆24Updated last year
- A set of jupyter notebooks demonstrating how to use the Media Cloud API.☆36Updated last year
- This repository provides usage examples for the Python module Newspaper3k.☆146Updated last year
- Utilties which support the proccessing of XML based USPTO trademark bulk download files☆29Updated 5 years ago
- A webmining CLI tool & library for python.☆301Updated this week
- Make it easier to compare and cross-reference the names of companies and people by applying strong normalisation.☆148Updated 3 weeks ago
- Pushshift Telegram Ingest☆85Updated 5 years ago
- Public client for consuming content from the Media Cloud Online News Archive & Directory.☆72Updated 2 months ago
- Mecodify tool for twitter data analysis and visualisation☆42Updated last year
- A multi-modal Twitter dataset with 7.6M tweets and 25.6M retweets related to voter fraud claims.☆53Updated 3 years ago
- ☆16Updated 6 years ago
- Tools for auditing autocomplete on Google and Bing☆23Updated 2 weeks ago
- Tool to scrape linkedin☆78Updated 3 years ago
- A tool for Semantic Scaling of Political Text (branch of Topfish, a suite of tools for Political Text Analysis)☆27Updated last year
- Examples for getting started using https://case.law☆65Updated 2 years ago
- Tag news stories based on models trained on the NYT corpus.☆42Updated last year
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 5 years ago
- Broad crawler for domain discovery☆19Updated 6 years ago