us.codecraft.webmagic.scheduler

类 PriorityScheduler

java.lang.Object

us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler

us.codecraft.webmagic.scheduler.PriorityScheduler

所有已实现的接口:

MonitorableScheduler, Scheduler

@ThreadSafe
public class PriorityScheduler
extends DuplicateRemovedScheduler
implements MonitorableScheduler

Priority scheduler. Request with higher priority will poll earlier.

从以下版本开始:

0.2.1

作者:

code4crafter@gmail.com

字段概要

字段

限定符和类型	字段和说明
static int	INITIAL_CAPACITY

从类继承的字段 us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler

logger

构造器概要

构造器

构造器和说明
PriorityScheduler()

方法概要

限定符和类型	方法和说明
int	getLeftRequestsCount(Task task)
int	getTotalRequestsCount(Task task)
Request	poll(Task task) get an url to crawl
void	pushWhenNoDuplicate(Request request, Task task)

从类继承的方法 us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler

getDuplicateRemover, push, setDuplicateRemover, shouldReserved

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 us.codecraft.webmagic.scheduler.Scheduler

push

字段详细资料

INITIAL_CAPACITY

public static final int INITIAL_CAPACITY

另请参阅:

常量字段值

构造器详细资料

PriorityScheduler

public PriorityScheduler()

方法详细资料

pushWhenNoDuplicate

public void pushWhenNoDuplicate(Request request,
                                Task task)

覆盖:

pushWhenNoDuplicate 在类中 DuplicateRemovedScheduler

poll

public Request poll(Task task)

从接口复制的说明: Scheduler

get an url to crawl

指定者:

poll 在接口中 Scheduler

参数:

task - the task of spider

返回:

the url to crawl

getLeftRequestsCount

public int getLeftRequestsCount(Task task)

指定者:

getLeftRequestsCount 在接口中 MonitorableScheduler

getTotalRequestsCount

public int getTotalRequestsCount(Task task)

指定者:

getTotalRequestsCount 在接口中 MonitorableScheduler