SUMMARY:
java.lang.Object
org.apache.hadoop.conf.Configured
org.apache.hadoop.tools.CopyListing
org.apache.hadoop.tools.SimpleCopyListing
org.apache.falcon.replication.FilteredCopyListing
public class FilteredCopyListing
- extends org.apache.hadoop.tools.SimpleCopyListing
An implementation of CopyListing that overrides the default behavior by suppressing file,
FileOutputCommitter.SUCCEEDED_FILE_NAME and copies that in the last so downstream apps
depending on data availability will work correctly.
FilteredCopyListing
protected FilteredCopyListing(Configuration configuration,
Credentials credentials)
shouldCopy
protected boolean shouldCopy(Path path,
org.apache.hadoop.tools.DistCpOptions options)
- Overrides:
shouldCopy
in class org.apache.hadoop.tools.SimpleCopyListing
getRegEx
public static Pattern getRegEx(String filePattern)
throws IOException
- Throws:
IOException
getBytesToCopy
public long getBytesToCopy()
- Overrides:
getBytesToCopy
in class org.apache.hadoop.tools.SimpleCopyListing
getNumberOfPaths
public long getNumberOfPaths()
- Overrides:
getNumberOfPaths
in class org.apache.hadoop.tools.SimpleCopyListing
Copyright © 2013-2014 Apache Software Foundation. All Rights Reserved.