datawizard1337 / ARGUSLinks
ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9
☆90Updated 4 years ago
Alternatives and similar repositories for ARGUS
Users that are interested in ARGUS are comparing it to the libraries listed below
Sorting:
- A Python scraper for the Facebook Ad Library, using the official Facebook Ad Library API.☆128Updated 6 years ago
- An automated, programming-free web scraper for interactive sites☆111Updated 2 years ago
- A helper library full of URL-related heuristics.☆73Updated 3 months ago
- Public client for consuming content from the Media Cloud Online News Archive & Directory.☆78Updated this week
- Examples for getting started using https://case.law☆70Updated 3 years ago
- Scraper for Facebook's Archive of Ads with Political Content☆37Updated 7 years ago
- A Python Client for collect and parse public data from the Youtube Data API☆82Updated 2 years ago
- Now included in rigour☆152Updated last month
- Pushshift Telegram Ingest☆85Updated 6 years ago
- A list of over 5000 US news domains and their social media accounts☆48Updated 2 years ago
- An open interface to GDELT APIs☆64Updated 2 years ago
- Frontend component for Hoaxy, a tool to visualize the spread of claims and fact checking☆73Updated 3 years ago
- Tag news stories based on models trained on the NYT corpus.☆42Updated 2 years ago
- The documentation and scripts for the Local News Dataset☆25Updated 3 years ago
- Given a set of URLs, this packages detects coordinated link sharing behavior on social media and outputs the network of entities that per…☆75Updated last year
- Code to get data from WhatsApp public groups☆111Updated 6 years ago
- Fast, flexible name matching for large datasets☆71Updated 4 months ago
- A framework for observing Twitter through interactive networks.☆74Updated 2 months ago
- YTDT is a collection of simple tools for extracting data from the YouTube platform via the YouTube API v3.☆128Updated last year
- A webmining CLI tool & library for python.☆346Updated last week
- A set of jupyter notebooks demonstrating how to use the Media Cloud API.☆40Updated 7 months ago
- Pre-built Scrapy spiders for AutoExtract☆19Updated last year
- Command-line utility to help researchers collect video metadata from Youtube API☆29Updated last year
- A base library for building web scrapers for statistical data, and a helper ontology for (primarily Swedish) statistical data.☆14Updated 10 months ago
- Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends☆58Updated last year
- A Python Package which helps to scrape all news details from any news websites☆221Updated 7 months ago
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 6 years ago
- Python client for the Genderize.io web service.☆78Updated 5 years ago
- API client for Aleph, supports bulk entity and document upload.☆29Updated last year
- Tool to scrape linkedin☆79Updated 4 years ago