public abstract class FlinkMRQLFileInputFormat extends Object implements MRQLFileInputFormat
Constructor and Description |
---|
FlinkMRQLFileInputFormat() |
Modifier and Type | Method and Description |
---|---|
Bag |
collect(DataSet x,
boolean strip)
materialize the entire dataset into a Bag
|
static String |
encode_data_sources()
encode the data source directory (to be serialized and distributed to clients)
|
abstract org.apache.flink.api.common.io.FileInputFormat<FData> |
inputFormat(String path)
the Flink input format for this input
|
Bag |
materialize(org.apache.hadoop.fs.Path path)
materialize the input file into a memory Bag
|
static void |
restore_data_sources(String data_sources)
restore the data source directory
|
public static String encode_data_sources()
public static void restore_data_sources(String data_sources)
public abstract org.apache.flink.api.common.io.FileInputFormat<FData> inputFormat(String path)
public Bag materialize(org.apache.hadoop.fs.Path path) throws IOException
materialize
in interface MRQLFileInputFormat
path
- the path directoryIOException
public final Bag collect(DataSet x, boolean strip) throws Exception
collect
in interface MRQLFileInputFormat
x
- the DataSet in HDFS to collect values fromstrip
- is not used in MapReduce modeException
Copyright © 2013-2016 The Apache Software Foundation. All Rights Reserved.