Generator of User-Agent header
☆345Sep 14, 2025Updated 6 months ago
Alternatives and similar repositories for user_agent
Users that are interested in user_agent are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A browser extension to monitor your spiders deployed on Scrapy Cloud.☆16Mar 8, 2025Updated last year
- Up-to-date simple useragent faker with real world database☆4,044Mar 29, 2026Updated last week
- A Scrapy extension to log items coverage when the spider shuts down☆19Apr 11, 2020Updated 5 years ago
- Tool to flatten stream of JSON-like objects, configured via schema☆33Oct 19, 2019Updated 6 years ago
- A Python library that provides an easy way to identify devices like mobile phones, tablets and their capabilities by parsing (browser) us…☆1,518Feb 16, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- REST API for controlling Google Chrome☆13Sep 23, 2015Updated 10 years ago
- Web Scraping Framework☆2,460Sep 19, 2025Updated 6 months ago
- Convert Javascript code to an XML document☆187Mar 14, 2022Updated 4 years ago
- Html content extractor: cx-extractor in python and sf-extractor☆18Apr 18, 2016Updated 9 years ago
- Random User-Agent middleware based on fake-useragent☆689Sep 18, 2023Updated 2 years ago
- Analyze scraped data☆46Dec 9, 2019Updated 6 years ago
- Show summary of a large number of URLs in a Jupyter Notebook☆19Updated this week
- Load items from Scrapinghub to ElasticSearch☆11Dec 8, 2022Updated 3 years ago
- HTTP API for Scrapy spiders☆879Mar 20, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Skinfer is a tool for inferring and merging JSON schemas☆141Apr 24, 2024Updated last year
- a tor socks proxy docker image☆12Feb 10, 2026Updated 2 months ago
- Universal python API to captcha solving services☆256Apr 17, 2023Updated 2 years ago
- List of libraries, tools and APIs for web scraping and data processing.☆7,831Apr 2, 2026Updated last week
- Cкрипт для парсинга XML-дампа БД RuTracker.org в CSV и DB sqlite3☆18Apr 1, 2020Updated 6 years ago
- use python parse database uri address, return format☆11Nov 14, 2015Updated 10 years ago
- Scrapy spider middleware to split an item into multiple items using a multi-valued key☆21Feb 8, 2017Updated 9 years ago
- 京东商品爬虫服务☆13Jul 23, 2017Updated 8 years ago
- Automatic Item List Extraction☆86Jun 15, 2016Updated 9 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Extract price amount and currency symbol from a raw text string☆345Mar 19, 2026Updated 3 weeks ago
- Screen scraping and web crawling framework☆59Apr 25, 2017Updated 8 years ago
- Quickly open Python modules in your text editor☆45Updated this week
- A Scrapy pipeline to categorize items using MonkeyLearn☆38Apr 28, 2017Updated 8 years ago
- Python implementation of the Parsley language for extracting structured data from web pages☆92Oct 26, 2017Updated 8 years ago
- Random proxy middleware for Scrapy☆1,672Oct 1, 2019Updated 6 years ago
- Asynchronous Library made using Python and aiohttp to get proxies from multiple services!☆21May 15, 2023Updated 2 years ago
- Detect and classify pagination links☆107Updated this week
- Async wrapper for requests / aiohttp, and some crawler toolkits. Let synchronization code enjoy the performance of asynchronous programmi…☆24Feb 9, 2025Updated last year
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆39May 21, 2024Updated last year
- Crochet-based blocking API for Scrapy.☆47Feb 24, 2017Updated 9 years ago
- python parser for human readable dates☆2,797Mar 31, 2026Updated last week
- Pipeline for distributed Natural Language Processing, made in Python☆65Jan 31, 2017Updated 9 years ago
- A tiny library for Python text normalisation. Useful for ad-hoc text processing.☆156Mar 8, 2026Updated last month
- Python interface for c-ares☆182Apr 2, 2026Updated last week
- Proxy [Finder | Checker | Server]. HTTP(S) & SOCKS☆4,131Mar 18, 2024Updated 2 years ago