WebHunger is an extensible, full-scale crawler framework that supports distributed crawling, aiming at getting users focused on web page parsing without concerning for the crawling process.
☆18Apr 11, 2018Updated 8 years ago
Alternatives and similar repositories for webhunger
Users that are interested in webhunger are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- php定时任务框架☆10Oct 24, 2019Updated 6 years ago
- 使用倒排索引及二分法实现了一个简单的规则匹配☆18Mar 14, 2019Updated 7 years ago
- Sync是一款分布式场景下基于Redis的安全高效的线程同步组件，提供分布式可重入互斥锁、分布式可重入读写锁、分布式信号量。提供相应注解，使用简单，可与spring-boot无缝集成。☆13Oct 8, 2022Updated 3 years ago
- ☆13Jun 14, 2016Updated 10 years ago
- ☆20Jan 4, 2019Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Dependency Container / Service Locator for PHP☆20Aug 21, 2018Updated 8 years ago
- 分布式爬虫框架,基于webdrvier模拟用户请求,kafka消息传递,分布式网页存储使用hbase,task异步任务多线程解析,提供基础服务如:proxy ip服务和号码验证服务等, proxy page使用H5和we版进行接入☆13Dec 18, 2015Updated 10 years ago
- A (massive) DNS tools (reverse lookup for now)☆12Jul 6, 2022Updated 4 years ago
- Deploy ProcessGroup into your LIVE NiFi data-flow.☆13Oct 14, 2016Updated 9 years ago
- Swip - Plugin for IntelliJ IDEA that can create a fully functional (Spring Boot) WebApp with just a few clicks☆13Jan 4, 2020Updated 6 years ago
- 每天三分钟的科技新闻聚合阅读☆18May 15, 2018Updated 8 years ago
- META-list of awesome lists☆25Oct 20, 2017Updated 8 years ago
- Grawlox is a profanity filter which offers methods for detecting and replacing swearwords.☆11Jul 16, 2017Updated 9 years ago
- ner using crf++☆10Mar 24, 2015Updated 11 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Java SDK for the TextRazor Text Analytics API☆18Mar 2, 2026Updated 6 months ago
- 爬虫抓取框架,封装HttpClient,Htmlunit,Selenium等工具☆26Nov 15, 2018Updated 7 years ago
- ☆12Jun 7, 2019Updated 7 years ago
- Be notified of recent events in the news by setting up alerts. Program uses NLP techniques such as keyword matching, k-clustering and sem…☆11Jun 27, 2016Updated 10 years ago
- Keyword Extraction system using Brown Clustering - (This version is trained to extract keywords from job listings)☆18Sep 16, 2014Updated 12 years ago
- JavaAgent内存马实现、检测、修复demo☆11Dec 7, 2022Updated 3 years ago
- Fine-grained named entity recognition using BERT☆11Feb 5, 2020Updated 6 years ago
- A compendium of data projects and associated blog posts☆10Nov 4, 2019Updated 6 years ago
- A toolkit for generating paraphrase vector representations for words in context☆23May 19, 2015Updated 11 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 高效GUID产生算法(sequence),基于Snowflake实现64位自增ID算法.☆39Aug 27, 2017Updated 9 years ago
- ☆14Mar 21, 2023Updated 3 years ago
- Apache NiFi NLP Processor☆18May 8, 2026Updated 4 months ago
- ADEL is a robust and efficient entity linking framework that is adaptive to text genres and language, entity types for the classification…☆20Jan 8, 2020Updated 6 years ago
- Generating spiders dynamically to crawl and check those free proxy ip on the internet with scrapy.☆43Oct 6, 2018Updated 7 years ago
- Neural Machine Translation of WordPress Strings☆21Aug 9, 2026Updated last month
- 基于spring-cloud-alibaba开源高度定制化网关☆19Dec 16, 2023Updated 2 years ago
- 基金管理系统后台代码☆10Jul 3, 2017Updated 9 years ago
- Event Time Extraction with a Decision Tree of Neural Classifiers☆18Feb 28, 2019Updated 7 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Lightweight method based on shortest path on word graphs and NLP to generate single sentence summaries that highly relevant and grammatic…☆19Jan 29, 2017Updated 9 years ago
- Code for Keith et al., EMNLP-2017 "Identifying civilians killed by police with distantly supervised entity-event extraction."☆15Jul 5, 2022Updated 4 years ago
- ☆12Nov 25, 2024Updated last year
- Convert DOT files into Interactive SVG websites☆18Feb 25, 2019Updated 7 years ago
- ☆13Jul 31, 2017Updated 9 years ago
- Agent that detects certain memory leaks☆21Aug 8, 2024Updated 2 years ago
- ☆11May 25, 2024Updated 2 years ago