us.codecraft.webmagic.scheduler

类 FileCacheQueueScheduler

java.lang.Object

us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler

us.codecraft.webmagic.scheduler.FileCacheQueueScheduler

所有已实现的接口:

Closeable, AutoCloseable, MonitorableScheduler, Scheduler

public class FileCacheQueueScheduler
extends DuplicateRemovedScheduler
implements MonitorableScheduler, Closeable

Store urls and cursor in files so that a Spider can resume the status when shutdown.

从以下版本开始:

0.2.0

作者:

code4crafter@gmail.com

字段概要

从类继承的字段 us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler

logger

构造器概要

构造器

构造器和说明
FileCacheQueueScheduler(String filePath)

方法概要

限定符和类型	方法和说明
void	close()
int	getLeftRequestsCount(Task task)
int	getTotalRequestsCount(Task task)
Request	poll(Task task)
protected void	pushWhenNoDuplicate(Request request, Task task)

从类继承的方法 us.codecraft.webmagic.scheduler.DuplicateRemovedScheduler

getDuplicateRemover, push, setDuplicateRemover, shouldReserved

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 us.codecraft.webmagic.scheduler.Scheduler

push

构造器详细资料

FileCacheQueueScheduler

public FileCacheQueueScheduler(String filePath)

方法详细资料

close

public void close()
           throws IOException

指定者:

close 在接口中 Closeable

指定者:

close 在接口中 AutoCloseable

抛出:

IOException

pushWhenNoDuplicate

protected void pushWhenNoDuplicate(Request request,
                                   Task task)

覆盖:

pushWhenNoDuplicate 在类中 DuplicateRemovedScheduler

poll

public Request poll(Task task)

指定者:

poll 在接口中 Scheduler

getLeftRequestsCount

public int getLeftRequestsCount(Task task)

指定者:

getLeftRequestsCount 在接口中 MonitorableScheduler

getTotalRequestsCount

public int getTotalRequestsCount(Task task)

指定者:

getTotalRequestsCount 在接口中 MonitorableScheduler