datawizard1337 / ARGUS
ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9
☆88Updated 3 years ago
Alternatives and similar repositories for ARGUS:
Users that are interested in ARGUS are comparing it to the libraries listed below
- Tag news stories based on models trained on the NYT corpus.☆42Updated 2 years ago
- Collector for Facebook's Political Ad API☆31Updated 2 years ago
- Scraper for Facebook's Archive of Ads with Political Content☆36Updated 6 years ago
- A helper library full of URL-related heuristics.☆66Updated 5 months ago
- A set of jupyter notebooks demonstrating how to use the Media Cloud API.☆37Updated last year
- Pre-built Scrapy spiders for AutoExtract☆19Updated 10 months ago
- A Python scraper for the Facebook Ad Library, using the official Facebook Ad Library API.☆118Updated 5 years ago
- Given a job title and job description, the algorithm assigns a standard occupational classification (SOC) code to the job.☆73Updated 8 months ago
- Tool to scrape linkedin☆78Updated 3 years ago
- Broad crawler for domain discovery☆19Updated 6 years ago
- Extract networks of entities from journalistic reporting☆48Updated last year
- Given a set of URLs, this packages detects coordinated link sharing behavior on social media and outputs the network of entities that per…☆75Updated 7 months ago
- A list of over 5000 US news domains and their social media accounts☆45Updated 2 years ago
- Tools for auditing autocomplete on Google and Bing☆23Updated last month
- A complimentary proxy to help to use SPM with headless browsers☆108Updated last year
- Page Object pattern for Scrapy☆120Updated last month
- Pushshift Telegram Ingest☆86Updated 5 years ago
- API client for Aleph, supports bulk entity and document upload.☆28Updated 5 months ago
- Fast, flexible name matching for large datasets☆71Updated last year
- Make it easier to compare and cross-reference the names of companies and people by applying strong normalisation.☆148Updated last month
- Web scraper for generating a graph of media connections via articles, twitter, reddit, and more☆33Updated 7 years ago
- Generate network visualizations from Twitter data.☆19Updated 2 years ago
- An open interface to GDELT APIs☆46Updated last year
- ☆22Updated 2 years ago
- Scrapy + Puppeteer☆111Updated 3 years ago
- Command-line utility to help researchers collect video metadata from Youtube API☆29Updated 6 months ago
- A Python Client for collect and parse public data from the Youtube Data API☆80Updated last year
- An automated, programming-free web scraper for interactive sites☆110Updated last year
- A base library for building web scrapers for statistical data, and a helper ontology for (primarily Swedish) statistical data.☆13Updated 3 weeks ago
- Political Discourse Analysis Using Pre-Trained Word Vectors.☆22Updated 2 years ago