public abstract class MapReduceMRQLFileInputFormat extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<MRContainer,MRContainer> implements MRQLFileInputFormat
Constructor and Description |
---|
MapReduceMRQLFileInputFormat() |
Modifier and Type | Method and Description |
---|---|
Bag |
collect(DataSet x,
boolean strip)
materialize the entire dataset into a Bag
|
abstract org.apache.hadoop.mapreduce.RecordReader<MRContainer,MRContainer> |
createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
org.apache.hadoop.mapreduce.TaskAttemptContext context)
record reader for map-reduce
|
abstract Bag |
materialize(org.apache.hadoop.fs.Path path)
materialize the input file into a memory Bag
|
addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, getSplits, isSplitable, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize
public abstract org.apache.hadoop.mapreduce.RecordReader<MRContainer,MRContainer> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context) throws IOException, InterruptedException
createRecordReader
in class org.apache.hadoop.mapreduce.InputFormat<MRContainer,MRContainer>
IOException
InterruptedException
public abstract Bag materialize(org.apache.hadoop.fs.Path path) throws IOException
materialize
in interface MRQLFileInputFormat
IOException
public final Bag collect(DataSet x, boolean strip) throws Exception
collect
in interface MRQLFileInputFormat
x
- the DataSet in HDFS to collect values fromstrip
- is not used in MapReduce modeException
Copyright © 2013–2014 The Apache Software Foundation. All rights reserved.