public final class FlinkDataSource extends DataSource implements Serializable
Modifier and Type | Class and Description |
---|---|
static class |
FlinkDataSource.reduce_mapper
Used in MRQL total aggregations in FlinkEvaluator.aggregate
|
static class |
FlinkDataSource.Reducer
Used in MRQL total aggregations in FlinkEvaluator.aggregate
|
static class |
FlinkDataSource.size_mapper |
org.apache.mrql.DataSource.DataSourceDirectory, org.apache.mrql.DataSource.ParserDirectory
Modifier and Type | Field and Description |
---|---|
org.apache.flink.api.java.DataSet<FData> |
data_set |
dataSourceDirectory, inputFormat, parserDirectory, path, separator, source_num, to_be_merged, tuple_container
Constructor and Description |
---|
FlinkDataSource(org.apache.flink.api.java.DataSet<FData> d,
String path,
boolean to_be_merged) |
Modifier and Type | Method and Description |
---|---|
Bag |
merge()
merge the splits of a flink data source that have already been sorted
|
long |
size(org.apache.hadoop.conf.Configuration conf)
not used
|
List<MRData> |
take(int num)
return the first num values
|
get, getCached, loadParsers, read, reduce
public org.apache.flink.api.java.DataSet<FData> data_set
public long size(org.apache.hadoop.conf.Configuration conf)
size
in class DataSource
public List<MRData> take(int num)
take
in class DataSource
public Bag merge()
Copyright © 2013-2016 The Apache Software Foundation. All Rights Reserved.