| 程序包 | 说明 |
|---|---|
| us.codecraft.webmagic |
Main class "Spider" and models.
|
| us.codecraft.webmagic.pipeline |
Pipeline is the persistent and offline process part of crawler.
|
| 限定符和类型 | 方法和说明 |
|---|---|
ResultItems |
Page.getResultItems() |
<T> ResultItems |
ResultItems.put(String key,
T value) |
ResultItems |
ResultItems.setRequest(Request request) |
ResultItems |
ResultItems.setSkip(boolean skip)
Set whether to skip the result.
|
| 限定符和类型 | 方法和说明 |
|---|---|
List<ResultItems> |
ResultItemsCollectorPipeline.getCollected() |
| 限定符和类型 | 方法和说明 |
|---|---|
void |
ResultItemsCollectorPipeline.process(ResultItems resultItems,
Task task) |
void |
Pipeline.process(ResultItems resultItems,
Task task)
Process extracted results.
|
void |
FilePipeline.process(ResultItems resultItems,
Task task) |
void |
ConsolePipeline.process(ResultItems resultItems,
Task task) |
Copyright © 2016. All rights reserved.