public class CleaningJob extends NutchTool implements org.apache.hadoop.util.Tool
Modifier and Type | Class and Description |
---|---|
static class |
CleaningJob.CleanMapper |
static class |
CleaningJob.CleanReducer |
Modifier and Type | Field and Description |
---|---|
static String |
ARG_COMMIT |
static org.slf4j.Logger |
LOG |
currentJob, currentJobNum, numJobs, results, status
Constructor and Description |
---|
CleaningJob() |
Modifier and Type | Method and Description |
---|---|
int |
delete(boolean commit) |
org.apache.hadoop.conf.Configuration |
getConf() |
Collection<WebPage.Field> |
getFields(org.apache.hadoop.mapreduce.Job job) |
static void |
main(String[] args) |
Map<String,Object> |
run(Map<String,Object> args)
Runs the tool, using a map of arguments.
|
int |
run(String[] args) |
void |
setConf(org.apache.hadoop.conf.Configuration conf) |
getProgress, getStatus, killJob, stopJob
public static final String ARG_COMMIT
public static final org.slf4j.Logger LOG
public org.apache.hadoop.conf.Configuration getConf()
getConf
in interface org.apache.hadoop.conf.Configurable
getConf
in class org.apache.hadoop.conf.Configured
public void setConf(org.apache.hadoop.conf.Configuration conf)
setConf
in interface org.apache.hadoop.conf.Configurable
setConf
in class org.apache.hadoop.conf.Configured
public Collection<WebPage.Field> getFields(org.apache.hadoop.mapreduce.Job job)
public Map<String,Object> run(Map<String,Object> args) throws Exception
NutchTool
public int run(String[] args) throws Exception
run
in interface org.apache.hadoop.util.Tool
Exception
Copyright © 2015 The Apache Software Foundation