public class DataSet extends Object
Modifier and Type | Field and Description |
---|---|
long |
counter |
long |
records |
ArrayList<DataSource> |
source |
Constructor and Description |
---|
DataSet(DataSource s,
long counter,
long records)
Construct a DataSet that contains one DataSource
|
DataSet(long counter,
long records)
Construct a set of DataSources
|
Modifier and Type | Method and Description |
---|---|
void |
add(DataSource s)
add a DataSource to this DataSet
|
String |
merge()
return a single DataSource path by merging all the DataSource paths in this DataSet
|
void |
merge(DataSet ds)
merge this DataSet with the given DataSet
|
long |
size(org.apache.hadoop.conf.Configuration conf)
dataset size in bytes
|
String |
toString() |
public ArrayList<DataSource> source
public long counter
public long records
DataSet(DataSource s, long counter, long records)
s
- the given DataSourcecounter
- a Hadoop user-defined counter used by the `repeat' operatorrecords
- total number of dataset recordsDataSet(long counter, long records)
counter
- a Hadoop user-defined counter used by the `repeat' operatorrecords
- total number of dataset recordspublic void add(DataSource s)
public void merge(DataSet ds)
public long size(org.apache.hadoop.conf.Configuration conf)
public String merge()
Copyright © 2013 The Apache Software Foundation. All rights reserved.