|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.mahout.df.mapreduce.partial.Step0Job
public class Step0Job
preparation step of the partial mapreduce builder. Computes some stats that will be used by the builder.
Nested Class Summary | |
---|---|
static class |
Step0Job.Step0Output
Output of the step0's mappers |
Constructor Summary | |
---|---|
Step0Job(org.apache.hadoop.fs.Path base,
org.apache.hadoop.fs.Path dataPath,
org.apache.hadoop.fs.Path datasetPath)
|
Method Summary | |
---|---|
protected Step0Job.Step0Output[] |
parseOutput(org.apache.hadoop.mapreduce.JobContext job)
Extracts the output and processes it |
protected static Step0Job.Step0Output[] |
processOutput(java.util.List<java.lang.Integer> keys,
java.util.List<Step0Job.Step0Output> values)
Replaces the first id for each partition in Hadoop's order |
Step0Job.Step0Output[] |
run(org.apache.hadoop.conf.Configuration conf)
Computes the partitions' info in Hadoop's order |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public Step0Job(org.apache.hadoop.fs.Path base, org.apache.hadoop.fs.Path dataPath, org.apache.hadoop.fs.Path datasetPath)
base
- base directorydataPath
- data used in the first stepdatasetPath
- Method Detail |
---|
public Step0Job.Step0Output[] run(org.apache.hadoop.conf.Configuration conf) throws java.io.IOException, java.lang.ClassNotFoundException, java.lang.InterruptedException
conf
- configuration
java.io.IOException
java.lang.ClassNotFoundException
java.lang.InterruptedException
protected Step0Job.Step0Output[] parseOutput(org.apache.hadoop.mapreduce.JobContext job) throws java.io.IOException
java.io.IOException
protected static Step0Job.Step0Output[] processOutput(java.util.List<java.lang.Integer> keys, java.util.List<Step0Job.Step0Output> values)
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |