| Package | Description |
|---|---|
| edu.uci.ics.crawler4j.crawler | |
| edu.uci.ics.crawler4j.fetcher | |
| edu.uci.ics.crawler4j.parser |
| Modifier and Type | Method and Description |
|---|---|
boolean |
WebCrawler.shouldVisit(Page referringPage,
WebURL url)
Classes that extends WebCrawler should overwrite this function to tell the
crawler whether the given url should be crawled or not.
|
void |
WebCrawler.visit(Page page)
Classes that extends WebCrawler should overwrite this function to process
the content of the fetched and parsed page.
|
| Modifier and Type | Method and Description |
|---|---|
boolean |
PageFetchResult.fetchContent(Page page) |
| Modifier and Type | Method and Description |
|---|---|
void |
Parser.parse(Page page,
String contextURL) |
Copyright © 2015. All rights reserved.