public final class MapReduceGeneratorInputFormat extends MapReduceMRQLFileInputFormat
Modifier and Type | Class and Description |
---|---|
static class |
MapReduceGeneratorInputFormat.GeneratorRecordReader |
Constructor and Description |
---|
MapReduceGeneratorInputFormat() |
Modifier and Type | Method and Description |
---|---|
org.apache.hadoop.mapreduce.RecordReader<MRContainer,MRContainer> |
createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
org.apache.hadoop.mapreduce.TaskAttemptContext context)
record reader for map-reduce
|
Bag |
materialize(org.apache.hadoop.fs.Path path)
Insert all results from the generators stored in path into a Bag.
|
collect
addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, getSplits, isSplitable, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize
public org.apache.hadoop.mapreduce.RecordReader<MRContainer,MRContainer> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context) throws IOException
MapReduceMRQLFileInputFormat
createRecordReader
in class MapReduceMRQLFileInputFormat
IOException
public Bag materialize(org.apache.hadoop.fs.Path path) throws IOException
materialize
in interface MRQLFileInputFormat
materialize
in class MapReduceMRQLFileInputFormat
path
- the path directory that contains the generator data (offset,size)IOException
Copyright © 2013-2016 The Apache Software Foundation. All Rights Reserved.