Extract text from HTML
☆135Feb 10, 2026Updated last month
Alternatives and similar repositories for html-text
Users that are interested in html-text are comparing it to the libraries listed below
Sorting:
- Python clients for Zyte AutoExtract API☆41Jan 17, 2022Updated 4 years ago
- extract difference between two html pages☆33Feb 10, 2026Updated last month
- NER toolkit for HTML data☆259May 3, 2024Updated last year
- Formasaurus tells you the type of an HTML form and its fields using machine learning☆121Feb 23, 2026Updated 3 weeks ago
- A component that tries to avoid downloading duplicate content☆28Feb 10, 2026Updated last month
- A classifier for detecting soft 404 pages☆60Feb 10, 2026Updated last month
- Adaptive crawler which uses Reinforcement Learning methods☆169Feb 10, 2026Updated last month
- A generic crawler☆79Feb 10, 2026Updated last month
- Page Object pattern for Scrapy☆127Updated this week
- ☆16Apr 24, 2024Updated last year
- Common interface for data container classes☆68Updated this week
- Library to populate items using XPath and CSS with a convenient API☆48Jan 29, 2026Updated last month
- A fork of http://pydispatcher.sourceforge.net/ with PyPy support☆16Jul 3, 2017Updated 8 years ago
- A project to attempt to automatically login to a website given a single seed☆129Feb 23, 2026Updated 3 weeks ago
- Spider templates for automatic crawlers.☆34Jan 8, 2026Updated 2 months ago
- Library for annotation-based dependency injection☆24Mar 3, 2026Updated 2 weeks ago
- Detect and classify pagination links☆107Feb 10, 2026Updated last month
- 🕶 Awesome list of Scrapy tools and libraries☆61Jul 6, 2020Updated 5 years ago
- https://mimesniff.spec.whatwg.org/ implementation for Python☆13Jan 16, 2024Updated 2 years ago
- ☆18Oct 6, 2025Updated 5 months ago
- Extract embedded metadata from HTML markup☆956Oct 1, 2025Updated 5 months ago
- A Scrapy extension to log items coverage when the spider shuts down☆19Apr 11, 2020Updated 5 years ago
- Use pyppeteer from a Scrapy spider☆59Feb 5, 2020Updated 6 years ago
- Pluggable DSL that uses pipes to perform a series of linear transformations to extract data☆16Jul 9, 2024Updated last year
- Splash + HAProxy + Docker Compose☆195Feb 10, 2026Updated last month
- a tor socks proxy docker image☆12Feb 10, 2026Updated last month
- use multiple proxies with Scrapy☆773Feb 10, 2026Updated last month
- Streaming web crawler with WebSocket API☆45Mar 13, 2026Updated last week
- Extract price amount and currency symbol from a raw text string☆346Updated this week
- Scrapy middleware for the autologin☆37Feb 10, 2026Updated last month
- ☆11Jul 6, 2020Updated 5 years ago
- Web scraping Page Objects core library☆104Mar 10, 2026Updated last week
- ☆14Jan 7, 2024Updated 2 years ago
- A dataset of popular pages (taken from <dir.yahoo.com>) with manually marked up semantic blocks.☆15Feb 9, 2014Updated 12 years ago
- A simple algorithm for clustering web pages, suitable for crawlers☆35Mar 6, 2017Updated 9 years ago
- Simple Scrapy middleware to process non-well-formed HTML with BeautifulSoup☆21Sep 26, 2016Updated 9 years ago
- Flatten, format, and export any JSON-like data to CSV (or any other string output).☆17Sep 13, 2021Updated 4 years ago
- A classifier for detecting soft 404 pages☆16Sep 10, 2022Updated 3 years ago
- Web Crawling UI and HTTP API, based on Scrapy and Tornado☆161Feb 10, 2026Updated last month