s

scriptspider

ScriptSpider(SS) is a Java distributed crawler framework that supports hot swappable components. SS是一个java版本的分布式的通用爬虫，可以热插拔各个组件（提供默认的），自动切换代理，自动结构化数据与存储。使用redis，分布式调度等技术。
https://github.com/xjtushilei/ScriptSpider
The Apache Software License, Version 2.0
shilei
that redis swappable distributed java supports components scriptspider framework crawler
Aggregated version Version Update time
0.3 0.3 Mar 30, 2018
0.2 0.2 Apr 13, 2017
0.1 0.1.1 Apr 12, 2017
0.0 0.0.1 Apr 12, 2017
4 Records