mvncenter: com.github.xjtushilei:scriptspider:0.3

scriptspider

ScriptSpider(SS) is a Java distributed crawler framework that supports hot swappable components. SS是一个java版本的分布式的通用爬虫，可以热插拔各个组件（提供默认的），自动切换代理，自动结构化数据与存储。使用redis，分布式调度等技术。

https://github.com/xjtushilei/ScriptSpider

The Apache Software License, Version 2.0

shilei

Files download

File	Operation
scriptspider-0.3.jar	download
scriptspider-0.3.pom	download
scriptspider-0.3-sources.jar	download

Apache Maven

<dependency>
  <groupId>com.github.xjtushilei</groupId>
  <artifactId>scriptspider</artifactId>
  <version>0.3</version>
</dependency>

Gradle Groovy

implementation 'com.github.xjtushilei:scriptspider:0.3'

Gradle Kotlin

implementation("com.github.xjtushilei:scriptspider:0.3")

Scala SBT

libraryDependencies += "com.github.xjtushilei" % "scriptspider" % "0.3"

Groovy Grape

@Grapes(
  @Grab(group='com.github.xjtushilei', module='scriptspider', version='0.3')
)

Apache Ivy

<dependency org="com.github.xjtushilei" name="scriptspider" rev="0.3" />

Leiningen

[com.github.xjtushilei/scriptspider "0.3"]

Apache Buildr

'com.github.xjtushilei:scriptspider:jar:0.3'

Dependencies

compile

|-- ch.qos.logback:logback-classic:1.2.3

|-- ch.qos.logback:logback-access:1.2.3

|-- ch.qos.logback:logback-core:1.2.3

|-- org.slf4j:slf4j-api:1.7.25

|-- org.jsoup:jsoup:1.11.2

|-- redis.clients:jedis:2.9.0

|-- org.apache.httpcomponents:httpclient:4.5.3

|-- com.google.code.gson:gson:2.8.2

|-- commons-io:commons-io:2.6