|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.mahout.df.mapred.partial.Step0Job
public class Step0Job
preparation step of the partial mapreduce builder. Computes some stats that will be used by the builder.
Nested Class Summary | |
---|---|
static class |
Step0Job.Step0Output
Output of the step0's mappers |
Constructor Summary | |
---|---|
Step0Job(org.apache.hadoop.fs.Path base,
org.apache.hadoop.fs.Path dataPath,
org.apache.hadoop.fs.Path datasetPath)
|
Method Summary | |
---|---|
protected Step0Job.Step0Output[] |
parseOutput(org.apache.hadoop.mapred.JobConf job)
Extracts the output and processes it |
protected static Step0Job.Step0Output[] |
processOutput(int[] keys,
Step0Job.Step0Output[] values)
Replaces the first id for each partition in Hadoop's order |
Step0Job.Step0Output[] |
run(org.apache.hadoop.conf.Configuration conf)
Computes the partitions' first ids in Hadoop's order |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public Step0Job(org.apache.hadoop.fs.Path base, org.apache.hadoop.fs.Path dataPath, org.apache.hadoop.fs.Path datasetPath)
base
- base directorydataPath
- data used in the first stepdatasetPath
- Method Detail |
---|
public Step0Job.Step0Output[] run(org.apache.hadoop.conf.Configuration conf) throws java.io.IOException
conf
- configuration
java.io.IOException
protected Step0Job.Step0Output[] parseOutput(org.apache.hadoop.mapred.JobConf job) throws java.io.IOException
job
-
java.io.IOException
protected static Step0Job.Step0Output[] processOutput(int[] keys, Step0Job.Step0Output[] values)
keys
- values
-
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |