public final class SparkGeneratorInputFormat extends SparkMRQLFileInputFormat
Modifier and Type | Class and Description |
---|---|
static class |
SparkGeneratorInputFormat.GeneratorRecordReader |
Constructor and Description |
---|
SparkGeneratorInputFormat() |
Modifier and Type | Method and Description |
---|---|
org.apache.hadoop.mapred.RecordReader<MRContainer,MRContainer> |
getRecordReader(org.apache.hadoop.mapred.InputSplit split,
org.apache.hadoop.mapred.JobConf job,
org.apache.hadoop.mapred.Reporter reporter)
record reader for spark
|
Bag |
materialize(org.apache.hadoop.fs.Path path)
Insert all results from the generators stored in path into a Bag.
|
collect
public org.apache.hadoop.mapred.RecordReader<MRContainer,MRContainer> getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter) throws IOException
SparkMRQLFileInputFormat
getRecordReader
in interface org.apache.hadoop.mapred.InputFormat<MRContainer,MRContainer>
getRecordReader
in class SparkMRQLFileInputFormat
IOException
public Bag materialize(org.apache.hadoop.fs.Path path) throws IOException
materialize
in interface MRQLFileInputFormat
materialize
in class SparkMRQLFileInputFormat
path
- the path directory that contains the generator data (offset,size)IOException
Copyright © 2013–2014 The Apache Software Foundation. All rights reserved.