us.codecraft.webmagic.scheduler

接口 Scheduler

所有已知子接口:

MonitorableScheduler

所有已知实现类:

DuplicateRemovedScheduler, PriorityScheduler, QueueScheduler

public interface Scheduler

Scheduler is the part of url management.
You can implement interface Scheduler to do: manage urls to fetch remove duplicate urls

从以下版本开始:

0.1.0

作者:

code4crafter@gmail.com

方法概要

限定符和类型	方法和说明
Request	poll(Task task) get an url to crawl
void	push(Request request, Task task) add a url to fetch

方法详细资料

push

void push(Request request,
          Task task)

add a url to fetch

参数:

request - request

task - task

poll

Request poll(Task task)

get an url to crawl

参数:

task - the task of spider

返回:

the url to crawl