| 程序包 | 说明 |
|---|---|
| us.codecraft.webmagic.scheduler |
Scheduler is the part of url management.
|
| us.codecraft.webmagic.scheduler.component |
Component of scheduler.
|
| 限定符和类型 | 方法和说明 |
|---|---|
DuplicateRemover |
DuplicateRemovedScheduler.getDuplicateRemover() |
| 限定符和类型 | 方法和说明 |
|---|---|
DuplicateRemovedScheduler |
DuplicateRemovedScheduler.setDuplicateRemover(DuplicateRemover duplicatedRemover) |
| 限定符和类型 | 类和说明 |
|---|---|
class |
BloomFilterDuplicateRemover
BloomFilterDuplicateRemover for huge number of urls.
|
class |
HashSetDuplicateRemover |
Copyright © 2016. All rights reserved.