org.apache.pig.piggybank.storage.hiverc
Class HiveRCDateSplitter
java.lang.Object
org.apache.pig.piggybank.storage.hiverc.HiveRCDateSplitter
public class HiveRCDateSplitter
- extends Object
Expects the location to be a directory with the format dir/daydate=yyyy-MM-dd/{dirs or files}
Only dateDir(s) within the date range [date1, date2] will be returned in the method splitDirectory
Method Summary |
List<org.apache.hadoop.fs.FileStatus> |
splitDirectory(org.apache.hadoop.mapreduce.JobContext job,
org.apache.hadoop.fs.Path dir)
|
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
HiveRCDateSplitter
public HiveRCDateSplitter(String dateRange)
- Parameters:
dateRange
- String must have format yyyy-MM-dd:yyyy-MM-dd, the left most date is the start of the range.
splitDirectory
public List<org.apache.hadoop.fs.FileStatus> splitDirectory(org.apache.hadoop.mapreduce.JobContext job,
org.apache.hadoop.fs.Path dir)
throws IOException
- Parameters:
job
- location
-
- Returns:
-
- Throws:
IOException
Copyright © ${year} The Apache Software Foundation