datawizard1337 / ARGUSLinks
ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9
☆88Updated 3 years ago
Alternatives and similar repositories for ARGUS
Users that are interested in ARGUS are comparing it to the libraries listed below
Sorting:
- A helper library full of URL-related heuristics.☆70Updated 2 weeks ago
- An automated, programming-free web scraper for interactive sites☆111Updated 2 years ago
- A Python Client for collect and parse public data from the Youtube Data API☆82Updated 2 years ago
- A Python scraper for the Facebook Ad Library, using the official Facebook Ad Library API.☆123Updated 5 years ago
- Given a job title and job description, the algorithm assigns a standard occupational classification (SOC) code to the job.☆74Updated last year
- This repository provides usage examples for the Python module Newspaper3k.☆148Updated last year
- Pre-built Scrapy spiders for AutoExtract☆19Updated last year
- Examples for getting started using https://case.law☆68Updated 3 years ago
- Extracts key terminology (n-grams) from any large collection of documents (>1000) and forecasts emergence☆66Updated 2 years ago
- Scraper for Facebook's Archive of Ads with Political Content☆37Updated 7 years ago
- Public client for consuming content from the Media Cloud Online News Archive & Directory.☆76Updated 2 months ago
- A webmining CLI tool & library for python.☆339Updated this week
- Extract place names from a URL or text, and add context to those names -- for example distinguishing between a country, region or city.☆129Updated 2 months ago
- Given a set of URLs, this packages detects coordinated link sharing behavior on social media and outputs the network of entities that per…☆75Updated last year
- A framework for observing Twitter through interactive networks.☆73Updated 11 months ago
- Pushshift Telegram Ingest☆86Updated 6 years ago
- Fast, flexible name matching for large datasets☆71Updated last month
- Now included in rigour☆151Updated 3 weeks ago
- Websites crawler with built-in exploration and control web interface☆358Updated 3 weeks ago
- Company Name Processor written in Python☆341Updated last year
- Fast and robust date extraction from web pages, with Python or on the command-line☆141Updated 2 months ago
- A set of jupyter notebooks demonstrating how to use the Media Cloud API.☆38Updated 3 months ago
- Tools for auditing autocomplete on Google and Bing☆24Updated 3 months ago
- A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.☆460Updated last year
- Extract text from HTML☆134Updated 5 years ago
- Collector for Facebook's Political Ad API☆31Updated 2 years ago
- Scrapes posts and comments from public Facebook pages.☆109Updated 6 years ago
- Code to get data from WhatsApp public groups☆111Updated 6 years ago
- Geotext extracts country and city mentions from text☆139Updated 2 years ago
- A database of courts, tests and other experiments☆93Updated 3 weeks ago