WebHunger is an extensible, full-scale crawler framework that supports distributed crawling, aiming at getting users focused on web page parsing without concerning for the crawling process.
☆18Apr 11, 2018Updated 8 years ago
Alternatives and similar repositories for webhunger
Users that are interested in webhunger are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Example server for https://github.com/NaikSoftware/StompProtocolAndroid/tree/master/example-client☆11Feb 28, 2017Updated 9 years ago
- php定时任务框架☆10Oct 24, 2019Updated 6 years ago
- 使用倒排索引及二分法实现了一个简单的规则匹配☆18Mar 14, 2019Updated 7 years ago
- 分布式爬虫框架,基于webdrvier模拟用户请求,kafka消息传递,分布式网页存储使用hbase,task异步任务多线程解析,提供基础服务如:proxy ip服务和号码验证服务等, proxy page使用H5和we版进行接入☆13Dec 18, 2015Updated 10 years ago
- A (massive) DNS tools (reverse lookup for now)☆12Jul 6, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 每天三分钟的科技新闻聚合阅读☆18May 15, 2018Updated 8 years ago
- A module that processes new Edgar filings and sends out notifications☆14Dec 28, 2015Updated 10 years ago
- Annotated Gigaword Java API and Command Line Tools☆15Mar 30, 2016Updated 10 years ago
- Anything we need to maintain the Linked Open Data (LOD) publication of CEUR-WS.org☆16Jun 10, 2020Updated 6 years ago
- META-list of awesome lists☆25Oct 20, 2017Updated 8 years ago
- NYC Data Science Academy capstone project - build event driven financial model using deep learning artificial neural network.☆15Mar 27, 2017Updated 9 years ago
- ☆19Jan 11, 2023Updated 3 years ago
- 数据平台(DataPlateform)，最初的设计想法是：当今大数据横行，我们也不能落后。所以就想着写一个这样的平台系统。此项目集爬虫、搜索、Hadoop、Dwr推送、Quartz定时任务于一体的平台，其目的是想通过抓取互联网数据，通过大数据推测人或者某一事物的下一行为。C…☆18Jul 31, 2017Updated 9 years ago
- Be notified of recent events in the news by setting up alerts. Program uses NLP techniques such as keyword matching, k-clustering and sem…☆11Jun 27, 2016Updated 10 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- an idiomatic port of FlashText.py to Java using streams☆15Sep 27, 2024Updated last year
- Keyword Extraction system using Brown Clustering - (This version is trained to extract keywords from job listings)☆18Sep 16, 2014Updated 11 years ago
- JavaAgent内存马实现、检测、修复demo☆11Dec 7, 2022Updated 3 years ago
- API - extract a list of keywords from a text.☆18Jul 6, 2017Updated 9 years ago
- An attempt to use natural language processing techniques in order to aid stock price forecasts.☆15Oct 4, 2017Updated 8 years ago
- DJIA index prices of 10 years and NYtimes news articles headline has been used to predict the DJIA index prices☆18Feb 21, 2018Updated 8 years ago
- ADEL is a robust and efficient entity linking framework that is adaptive to text genres and language, entity types for the classification…☆20Jan 8, 2020Updated 6 years ago
- Extra pluggable modules for Apache MetaModel (but licensed with LGPL)☆17Jan 2, 2022Updated 4 years ago
- fork of .net port and adaptation of libots, initially by PatrickBurrows☆20Aug 15, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆13Jul 16, 2023Updated 3 years ago
- Generating spiders dynamically to crawl and check those free proxy ip on the internet with scrapy.☆43Oct 6, 2018Updated 7 years ago
- Neural Machine Translation of WordPress Strings☆21Aug 9, 2026Updated 3 weeks ago
- 基于spring-cloud-alibaba开源高度定制化网关☆19Dec 16, 2023Updated 2 years ago
- Entity/Relation/Event extraction on ACE 2005 corpus☆14Mar 26, 2019Updated 7 years ago
- 基金管理系统后台代码☆10Jul 3, 2017Updated 9 years ago
- Event Time Extraction with a Decision Tree of Neural Classifiers☆18Feb 28, 2019Updated 7 years ago
- Takes a context-free grammar and converts it into a decision-making graph. Can produce interactive Guides which generate valid sentences …☆23Jul 7, 2017Updated 9 years ago
- Simple DAG-based job scheduler in Python☆13May 10, 2017Updated 9 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆13Nov 25, 2024Updated last year
- Code for Keith et al., EMNLP-2017 "Identifying civilians killed by police with distantly supervised entity-event extraction."☆15Jul 5, 2022Updated 4 years ago
- Convert DOT files into Interactive SVG websites☆18Feb 25, 2019Updated 7 years ago
- Agent that detects certain memory leaks☆21Aug 8, 2024Updated 2 years ago
- ☆11May 25, 2024Updated 2 years ago
- A tool to leverage Virus Total's API key with advanced queries to download malware(s) and report(s).☆11Apr 24, 2013Updated 13 years ago
- ☆21Oct 13, 2016Updated 9 years ago