us.codecraft.webmagic.scheduler.component

接口 DuplicateRemover

所有已知实现类:

BloomFilterDuplicateRemover, HashSetDuplicateRemover

public interface DuplicateRemover

Remove duplicate requests.

从以下版本开始:

0.5.1

作者:

code4crafer@gmail.com

方法概要

限定符和类型	方法和说明
int	getTotalRequestsCount(Task task) Get TotalRequestsCount for monitor.
boolean	isDuplicate(Request request, Task task) Check whether the request is duplicate.
void	resetDuplicateCheck(Task task) Reset duplicate check.

方法详细资料

isDuplicate

boolean isDuplicate(Request request,
                    Task task)

Check whether the request is duplicate.

参数:

request - request

task - task

返回:

true if is duplicate

resetDuplicateCheck

void resetDuplicateCheck(Task task)

Reset duplicate check.

参数:

task - task

getTotalRequestsCount

int getTotalRequestsCount(Task task)

Get TotalRequestsCount for monitor.

参数:

task - task

返回:

number of total request