public class SubcollectionIndexingFilter extends Configured implements IndexingFilter
Modifier and Type | Field and Description |
---|---|
static java.lang.String |
fieldName
Doc field name
|
static java.lang.String |
metadataSource
Metadata source field name
|
X_POINT_ID
Constructor and Description |
---|
SubcollectionIndexingFilter() |
SubcollectionIndexingFilter(Configuration conf) |
Modifier and Type | Method and Description |
---|---|
NutchDocument |
filter(NutchDocument doc,
Parse parse,
Text url,
CrawlDatum datum,
Inlinks inlinks)
Adds fields or otherwise modifies the document that will be indexed for a
parse.
|
Configuration |
getConf() |
void |
setConf(Configuration conf) |
public static java.lang.String fieldName
public static java.lang.String metadataSource
public SubcollectionIndexingFilter()
public SubcollectionIndexingFilter(Configuration conf)
public void setConf(Configuration conf)
setConf
in interface Configurable
setConf
in class Configured
conf
- public Configuration getConf()
getConf
in interface Configurable
getConf
in class Configured
public NutchDocument filter(NutchDocument doc, Parse parse, Text url, CrawlDatum datum, Inlinks inlinks) throws IndexingException
IndexingFilter
filter
in interface IndexingFilter
doc
- document instance for collecting fieldsparse
- parse data instanceurl
- page urldatum
- crawl datum for the page (fetch datum from segment containing
fetch status and fetch time)inlinks
- page inlinksIndexingException
Copyright © 2018 The Apache Software Foundation