程序包 us.codecraft.webmagic.scheduler.component

Component of scheduler.

请参阅: 说明

接口概要

接口	说明
DuplicateRemover	Remove duplicate requests.

类概要

类	说明
BloomFilterDuplicateRemover	BloomFilterDuplicateRemover for huge number of urls.
HashSetDuplicateRemover

程序包us.codecraft.webmagic.scheduler.component的说明

Component of scheduler.