Alternatives and similar repositories for octopus_spider

Users that are interested in octopus_spider are comparing it to the libraries listed below

• yangjing / crawler-service
  基于Akka开发的爬虫服务，非阻塞、高并发、实时
  ☆26Updated 9 years ago
• yangbajing / scala-applications
  Scala Applications
  ☆17Updated 6 years ago
• yangwx1402 / young-crawler
  scala结合actor编写的分布式网络爬虫
  ☆15Updated 9 years ago
• hustnn / AkkaLearning
  notes on learning akka
  ☆31Updated 9 years ago
• wypb / spark-summit-east-2017
  ☆30Updated 8 years ago
• wengbenjue / spark_recomend
  使用Spark的MLlib、Hbase作为模型、Hive作数据清洗的核心推荐引擎,在Spark on Yarn测试通过
  ☆30Updated 8 years ago
• endymecy / akka-guide-zh
  akka 中文文档，通过官方文档翻译
  ☆28Updated 10 years ago
• sjtu-iiot / graphx-algorithm
  Graph algorithms implemented in GraphX and Spark styles
  ☆15Updated 10 years ago
• agiledon / scala_coding_convention
  Scala编码规范与最佳实践
  ☆102Updated 10 years ago
• yangbajing / scala-web-development
  Scala Web 开发 - 使用 Akka
  ☆44Updated 5 years ago
• allwefantasy / ServiceframeworkDispatcher
  Serviceframework一个简单但灵活的模块引擎
  ☆31Updated 8 years ago
• yangbajing / akka-cookbook
  提供清晰、实用的Akka应用指导
  ☆31Updated 3 years ago
• EdwardsBean / flume-spark-streaming
  conbine flume,spark-streaming and redis for real-time computing
  ☆22Updated 11 years ago
• OopsOutOfMemory / spark-sql-hbase
  A Spark SQL HBase connector
  ☆29Updated 10 years ago
• yxlHuster / news-duplicated
  文本去重算法，研究自推荐系统中新闻的去重，采用了雅虎的Near-duplicates and shingling算法，服务端用c实现，客户端用java实现，利用thrift框架进行通信，为了提高扩展性，去重可以在服务端实现，服务器也提供了计算的接口，方便客户端自己扩展
  ☆24Updated 11 years ago
• soulmachine / spark-example-project
  A Spark WordCount example as a standalone SBT project
  ☆17Updated 10 years ago
• playcommunity / play-community
  一个基于 Play Framework 开发的开源社区系统。
  ☆104Updated 4 years ago
• bdo-cash / reflow
  A light-weight lock-free series/parallel combined scheduling framework for tasks. The goal is to maximize parallelism in order to minimiz…
  ☆24Updated 2 years ago
• scalad / SpringBoot-Scala
  可以说近几年Spark的流行带动了Scala的发展，它集成了面向对象编程和函数式编程的各种特性，Scala具有更纯Lambda表粹的函数式业务逻辑解决方案，其语法比Java8后Lambda更加简洁方便，SpringBoot为Spring提供了一种更加方便快捷的方式，不再要求…
  ☆61Updated 8 years ago
• souo / biplatform
  基于akka-http、akka-cluster、akka-stream 构建的报表工具
  ☆28Updated 8 years ago
• sderosiaux / parquet-custom-reader-writer
  Simple implementation of a custom parquet reader/writer
  ☆11Updated 9 years ago
• ycloudnet / ya100
  一个比Spark-Parquet还快5~100倍的存储格式
  ☆12Updated 9 years ago
• jadetang / scala_sql
  scala sql is a simple SQL like DSL implementation writen in scala. It's main function is to do some computation with List<Map> by writen…
  ☆38Updated 5 years ago
• notyy / scalaSnippet
  在工作中和各种scala培训中积累的代码片段
  ☆55Updated 6 years ago
• endymecy / AlgorithmsOnSpark
  Some popular algorithms(dbscan,knn,fm etc.) on spark
  ☆32Updated 7 years ago
• yangjing / akka-action
  Akka实战
  ☆20Updated 8 years ago
• wangzaixiang / scala-sql
  scala SQL api
  ☆88Updated 4 months ago
• Bayakala / FunDA
  FunDA, a functional data processing library to supplement FRM (Functional-Relational-Mapper)
  ☆29Updated 8 years ago
• flowers2023 / spark-streaming
  spark流数据处理，可以从flume-ng，kafka接收数据
  ☆11Updated 10 years ago
• ZubairNabi / prosparkstreaming
  Code used in "Pro Spark Streaming: The Zen of Real-time Analytics using Apache Spark" published by Apress Publishing.
  ☆48Updated 9 years ago