新闻网页正文通用抽取器 Beta 版.
☆3,777Apr 21, 2026Updated last month
Alternatives and similar repositories for GeneralNewsExtractor
Users that are interested in GeneralNewsExtractor are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Auto Extractor Module☆336Aug 19, 2024Updated last year
- Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架☆12,209Feb 10, 2026Updated 3 months ago
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,405Feb 19, 2025Updated last year
- 基于行块分布函数的通用网页正文抽取算法的Python版本实现，添加了英文支持/ Web page content extraction algorithm, support both Chinese and English☆482Jul 9, 2019Updated 6 years ago
- Python ProxyPool for web spider☆23,384Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js☆3,505Oct 29, 2024Updated last year
- SEKIRO is a multi-language, distributed, network topology-independent service publishing platform. By writing handlers in their respectiv…☆1,906Jan 22, 2026Updated 4 months ago
- JSpider会每周更新至少一个网站的JS解密方式，欢迎 Star，交流微信：13298307816☆1,091Jun 22, 2022Updated 3 years ago
- 😮python模拟登陆一些大型网站，还有一些简单的爬虫，希望对你们有所帮助❤️，如果喜欢记得给个star哦🌟☆16,225Jul 26, 2022Updated 3 years ago
- 书籍《Python3 反爬虫原理与绕过实战》配套代码☆627Oct 25, 2021Updated 4 years ago
- 基于搜狗微信搜索的微信公众号爬虫接口☆6,293Mar 7, 2026Updated 2 months ago
- 开源微信爬虫：爬取公众号所有 文章、阅读量、点赞量和评论内容。易部署。持续维护！！！☆2,824May 29, 2026Updated last week
- 🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬…☆3,698Updated this week
- Async Python 3.6+ web scraping micro-framework based on asyncio☆1,744Jul 1, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 爬虫js解密、python解密 大众点评|中国移动|新浪微博|汽车之家|Steam|中华英才网|拼多多|36氪|今日头条... 欢迎Star☆345Dec 31, 2020Updated 5 years ago
- Tinepeas，我们自己的爬虫框架。☆59Aug 9, 2024Updated last year
- newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:☆15,069May 13, 2026Updated 3 weeks ago
- High available distributed ip proxy pool, powerd by Scrapy and Redis☆5,537Dec 26, 2022Updated 3 years ago
- Intelligent proxy pool for Humans™ to extract content from the internet and build your own Large Language Models in this new AI era☆4,017Jun 9, 2025Updated 11 months ago
- 微信公众号文章的爬虫☆3,446Apr 18, 2024Updated 2 years ago
- Python based web automation tool. Powerful and elegant.☆12,040May 26, 2026Updated last week
- 中英文敏感词、语言检测、中外手机/电话归属地/运营商查询、名字推断性别、手机号抽取、身份证抽取、邮箱抽取、中日文人名库、中文缩写库、拆字词典、词汇情感值、停用词、反动词表、暴恐词表、繁简体转换、英文模拟中文发音、汪峰歌词生成器、职业名称词库、同义词库、反义词库、否定词库、汽…☆81,076May 10, 2024Updated 2 years ago
- 数据接口：百度、谷歌、头条、微博指 数,宏观数据，利率数据，货币汇率，千里马、独角兽公司，新闻联播文字稿，影视票房数据，高校名单，疫情数据…☆2,554Sep 15, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An intelligent web service to automatically detect web content and extract information from it.☆86Jul 13, 2023Updated 2 years ago
- [验证码识别-训练] This project is based on CNN/ResNet/DenseNet+GRU/LSTM+CTC/CrossEntropy to realize verification code identification. This proje…☆3,202Nov 9, 2025Updated 6 months ago
- 来自一位 Pythonista 的编程经验分享，内容涵盖编码技巧、最佳实践与思维模式等方面。☆7,210May 16, 2024Updated 2 years ago
- 越来越多的网 站具有反爬虫特性，有的用图片隐藏关键数据，有的使用反人类的验证码，建立反反爬虫的代码仓库，通过与不同特性的网站做斗争（无恶意）提高技术。（欢迎提交难以采集的网站）（因工作原因，项目暂停）☆7,295Oct 17, 2021Updated 4 years ago
- 中文近义词：聊天机器人，智能问答工具包☆5,106Feb 1, 2026Updated 4 months ago
- 模仿着写一个 chrome 插件，用来快速调试前端 js 代码。☆2,984Apr 27, 2026Updated last month
- 基于httpx的一个大型项目 ，爬取黑胶唱片网站 Discogs☆102Jul 14, 2025Updated 10 months ago
- Collection of China illegal cases about web crawler 本项目用来整理所有中国大陆爬虫开发者涉诉与违规相关的新闻、资料与法律法规。致力于帮助在中国大陆工作的爬虫行业从业者了解我国相关法律，避免触碰数据合规红线。☆4,625Mar 12, 2026Updated 2 months ago
- 极验滑块js代码脱壳-js控制流平坦化反混淆☆237Oct 3, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Article publishing platform that automatically distributes your articles to various media channels☆3,199Jan 29, 2026Updated 4 months ago
- Dumb downloader that scrapes the web☆56,852Apr 30, 2026Updated last month
- 实战🐍多种网站、电商数据爬虫🕷。包含🕸：淘宝商品、微信公众号、大众点评、企查查、招聘网站、闲鱼、阿里任务、博客园、微博、百度贴吧、豆瓣电影、包图网、全景网、豆瓣音乐、某省药监局、搜狐新闻、机器学习文本采集、fofa资产采集、汽车之家、国家统计局、百度关键词收录数、蜘蛛…☆5,540May 22, 2024Updated 2 years ago
- A distributed crawler for weibo, building with celery and requests.☆4,789Jul 11, 2020Updated 5 years ago
- An Efficient ProxyPool with Getter, Tester and Server☆6,216Mar 28, 2026Updated 2 months ago
- 搜狗词库下载、新词发现算法、常见的工具类、百度应用、翻译、天气预报、汉语纠错、字符串文本数据提取时间解析、百度文库下载、实体抽取等等☆728Mar 24, 2022Updated 4 years ago
- 带带弟弟 通用验证码识别OCR pypi版☆14,201Mar 10, 2026Updated 2 months ago