mvncenter: com.github.xjtushilei:scriptspider:0.1.1

scriptspider

ScriptSpider(SS) is a Java distributed crawler framework that supports hot swappable components. SS是一个java版本的分布式的通用爬虫，可以热插拔各个组件（提供默认的），自动切换代理，自动结构化数据与存储。使用redis，分布式调度等技术。

https://github.com/xjtushilei/ScriptSpider

The Apache Software License, Version 2.0

shilei

Files download

File	Operation
scriptspider-0.1.1.jar	download
scriptspider-0.1.1.pom	download
scriptspider-0.1.1-sources.jar	download

Apache Maven

<dependency>
  <groupId>com.github.xjtushilei</groupId>
  <artifactId>scriptspider</artifactId>
  <version>0.1.1</version>
</dependency>

Gradle Groovy

implementation 'com.github.xjtushilei:scriptspider:0.1.1'

Gradle Kotlin

implementation("com.github.xjtushilei:scriptspider:0.1.1")

Scala SBT

libraryDependencies += "com.github.xjtushilei" % "scriptspider" % "0.1.1"

Groovy Grape

@Grapes(
  @Grab(group='com.github.xjtushilei', module='scriptspider', version='0.1.1')
)

Apache Ivy

<dependency org="com.github.xjtushilei" name="scriptspider" rev="0.1.1" />

Leiningen

[com.github.xjtushilei/scriptspider "0.1.1"]

Apache Buildr

'com.github.xjtushilei:scriptspider:jar:0.1.1'

Dependencies

compile

|-- ch.qos.logback:logback-classic:1.2.3

|-- ch.qos.logback:logback-access:1.2.3

|-- ch.qos.logback:logback-core:1.2.3

|-- org.slf4j:slf4j-api:1.7.25

|-- org.jsoup:jsoup:1.10.2

|-- redis.clients:jedis:2.9.0

|-- org.apache.httpcomponents:httpclient:4.5.3

|-- com.google.code.gson:gson:2.8.0