public abstract class BSPMRQLFileInputFormat extends org.apache.hama.bsp.FileInputFormat<MRContainer,MRContainer> implements MRQLFileInputFormat
Constructor and Description |
---|
BSPMRQLFileInputFormat() |
Modifier and Type | Method and Description |
---|---|
Bag |
collect(DataSet x,
boolean strip)
materialize the entire dataset into a Bag
|
abstract org.apache.hama.bsp.RecordReader<MRContainer,MRContainer> |
getRecordReader(org.apache.hama.bsp.InputSplit split,
org.apache.hama.bsp.BSPJob job)
record reader for map-reduce
|
Bag |
materialize(org.apache.hadoop.fs.Path file)
materialize the input file into a memory Bag
|
addInputPath, addInputPaths, computeGoalSize, computeSplitSize, computeTotalSize, getBlockIndex, getFormatMinSplitSize, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, getSplitHosts, getSplits, isSplitable, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize
public abstract org.apache.hama.bsp.RecordReader<MRContainer,MRContainer> getRecordReader(org.apache.hama.bsp.InputSplit split, org.apache.hama.bsp.BSPJob job) throws IOException
getRecordReader
in interface org.apache.hama.bsp.InputFormat<MRContainer,MRContainer>
getRecordReader
in class org.apache.hama.bsp.FileInputFormat<MRContainer,MRContainer>
IOException
public Bag materialize(org.apache.hadoop.fs.Path file) throws IOException
materialize
in interface MRQLFileInputFormat
IOException
public final Bag collect(DataSet x, boolean strip) throws Exception
collect
in interface MRQLFileInputFormat
x
- the DataSet in HDFS to collect values fromstrip
- true if you want to stripout the source id (used in BSP sources)Exception
Copyright © 2013 The Apache Software Foundation. All rights reserved.