public interface URLExemptionFilter extends Pluggable, Configurable
db.ignore.external.links
.
This is useful when the crawl is focused to a domain but resources like images are hosted on CDN.Modifier and Type | Field and Description |
---|---|
static java.lang.String |
X_POINT_ID
The name of the extension point.
|
Modifier and Type | Method and Description |
---|---|
boolean |
filter(java.lang.String fromUrl,
java.lang.String toUrl)
Checks if toUrl is exempted when the ignore external is enabled
|
getConf, setConf
boolean filter(java.lang.String fromUrl, java.lang.String toUrl)
fromUrl
- : the source url which generated the outlinktoUrl
- : the destination url which needs to be checked for exemptionCopyright © 2018 The Apache Software Foundation