|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use Path | |
---|---|
org.apache.hadoop.benchmarks.mapred | |
org.apache.hadoop.conf | Configuration of system parameters. |
org.apache.hadoop.dfs | A distributed implementation of FileSystem . |
org.apache.hadoop.filecache | |
org.apache.hadoop.fs | An abstract file system API. |
org.apache.hadoop.fs.s3 | A distributed implementation of FileSystem that uses Amazon S3. |
org.apache.hadoop.io | Generic i/o code for use when reading and writing data to the network, to databases, and to files. |
org.apache.hadoop.io.compress | |
org.apache.hadoop.mapred | A system for scalable, fault-tolerant, distributed computation over large data collections. |
org.apache.hadoop.streaming | |
org.apache.hadoop.util | Common utilities. |
Uses of Path in org.apache.hadoop.benchmarks.mapred |
---|
Methods in org.apache.hadoop.benchmarks.mapred that return Path | |
---|---|
Path |
MultiJobRunner.runJobsInSequence(JobConf[] jobs)
Runs a sequence of map reduce tasks, output of each reduce is input to next map. |
Uses of Path in org.apache.hadoop.conf |
---|
Methods in org.apache.hadoop.conf that return Path | |
---|---|
Path |
Configuration.getLocalPath(String dirsProp,
String path)
Returns a local file under a directory named in dirsProp with the given path. |
Methods in org.apache.hadoop.conf with parameters of type Path | |
---|---|
void |
Configuration.addDefaultResource(Path file)
Add a default resource. |
void |
Configuration.addFinalResource(Path file)
Add a final resource. |
Uses of Path in org.apache.hadoop.dfs |
---|
Methods in org.apache.hadoop.dfs that return Path | |
---|---|
Path |
DistributedFileSystem.getWorkingDirectory()
|
Path[] |
DistributedFileSystem.listPathsRaw(Path f)
|
Path |
DistributedFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Methods in org.apache.hadoop.dfs with parameters of type Path | |
---|---|
void |
DistributedFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Move completed local data to DFS destination |
void |
DistributedFileSystem.copyFromLocalFile(Path src,
Path dst)
|
void |
DistributedFileSystem.copyToLocalFile(Path src,
Path dst,
boolean copyCrc)
|
FSOutputStream |
DistributedFileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize)
|
FSOutputStream |
DistributedFileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize,
Progressable progress)
|
boolean |
DistributedFileSystem.deleteRaw(Path f)
Get rid of Path f, whether a true file or dir. |
boolean |
DistributedFileSystem.exists(Path f)
|
long |
DistributedFileSystem.getBlockSize(Path f)
|
long |
DistributedFileSystem.getContentLength(Path f)
|
String[][] |
DistributedFileSystem.getFileCacheHints(Path f,
long start,
long len)
|
long |
DistributedFileSystem.getLength(Path f)
|
short |
DistributedFileSystem.getReplication(Path f)
|
boolean |
DistributedFileSystem.isDirectory(Path f)
|
Path[] |
DistributedFileSystem.listPathsRaw(Path f)
|
void |
DistributedFileSystem.lock(Path f,
boolean shared)
Deprecated. |
boolean |
DistributedFileSystem.mkdirs(Path f)
|
void |
DistributedFileSystem.moveFromLocalFile(Path src,
Path dst)
|
FSInputStream |
DistributedFileSystem.openRaw(Path f)
|
void |
DistributedFileSystem.release(Path f)
Deprecated. |
boolean |
DistributedFileSystem.renameRaw(Path src,
Path dst)
Rename files/dirs |
void |
DistributedFileSystem.reportChecksumFailure(Path f,
FSInputStream in,
long inPos,
FSInputStream sums,
long sumsPos)
We need to find the blocks that didn't match. |
boolean |
DistributedFileSystem.setReplicationRaw(Path src,
short replication)
|
void |
DistributedFileSystem.setWorkingDirectory(Path dir)
|
Path |
DistributedFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Uses of Path in org.apache.hadoop.filecache |
---|
Methods in org.apache.hadoop.filecache that return Path | |
---|---|
static Path |
DistributedCache.getLocalCache(URI cache,
Configuration conf,
Path baseDir,
boolean isArchive,
String md5,
Path currentWorkDir)
|
static Path[] |
DistributedCache.getLocalCacheArchives(Configuration conf)
Return the path array of the localized caches |
static Path[] |
DistributedCache.getLocalCacheFiles(Configuration conf)
Return the path array of the localized files |
Methods in org.apache.hadoop.filecache with parameters of type Path | |
---|---|
static Path |
DistributedCache.getLocalCache(URI cache,
Configuration conf,
Path baseDir,
boolean isArchive,
String md5,
Path currentWorkDir)
|
Uses of Path in org.apache.hadoop.fs |
---|
Methods in org.apache.hadoop.fs that return Path | |
---|---|
static Path |
FileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file. |
Path[] |
InMemoryFileSystem.getFiles(PathFilter filter)
This API getClosedFiles could have been implemented over listPathsRaw but it is an overhead to maintain directory structures for this impl of the in-memory fs. |
Path |
Path.getParent()
Returns the parent of a path or null if at root. |
Path |
InMemoryFileSystem.getWorkingDirectory()
|
Path |
LocalFileSystem.getWorkingDirectory()
|
abstract Path |
FileSystem.getWorkingDirectory()
Get the current working directory for the given file system |
Path[] |
FileSystem.globPaths(Path filePattern)
Return all the files that match filePattern and are not checksum files. |
Path[] |
FileSystem.globPaths(Path filePattern,
PathFilter filter)
glob all the file names that matches filePattern and is accepted by filter. |
Path[] |
FileSystem.listPaths(Path f)
List files in a directory. |
Path[] |
FileSystem.listPaths(Path[] files)
Filter raw files in a list directories using the default checksum filter. |
Path[] |
FileSystem.listPaths(Path[] files,
PathFilter filter)
Filter raw files in a list directories using user-supplied path filter. |
Path[] |
FileSystem.listPaths(Path f,
PathFilter filter)
Filter raw files in a directory. |
Path[] |
InMemoryFileSystem.listPathsRaw(Path f)
Directory operations are not supported |
Path[] |
LocalFileSystem.listPathsRaw(Path f)
|
abstract Path[] |
FileSystem.listPathsRaw(Path f)
List files in a directory. |
Path |
FileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem. |
Path |
InMemoryFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Path |
LocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
abstract Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
Path |
Path.suffix(String suffix)
Adds a suffix to the final name in the path. |
Methods in org.apache.hadoop.fs with parameters of type Path | |
---|---|
boolean |
PathFilter.accept(Path path)
Tests whether or not the specified abstract pathname should be included in a pathname list. |
protected void |
FileSystem.checkPath(Path path)
Check that a Path belongs to this FileSystem. |
void |
InMemoryFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
void |
LocalFileSystem.completeLocalOutput(Path fsWorkingFile,
Path tmpLocalFile)
|
abstract void |
FileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target. |
static boolean |
FileUtil.copy(File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy local files to a FileSystem. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
File dst,
boolean deleteSource,
Configuration conf)
Copy FileSystem files to local files. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean copyCrc,
Configuration conf)
Copy files between FileSystems. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy files between FileSystems. |
void |
InMemoryFileSystem.copyFromLocalFile(Path src,
Path dst)
copy/move operations are not supported |
void |
LocalFileSystem.copyFromLocalFile(Path src,
Path dst)
|
abstract void |
FileSystem.copyFromLocalFile(Path src,
Path dst)
The src file is on the local disk. |
static boolean |
FileUtil.copyMerge(FileSystem srcFS,
Path srcDir,
FileSystem dstFS,
Path dstFile,
boolean deleteSource,
Configuration conf,
String addString)
Copy all files in a directory to one output file (merge). |
void |
FileSystem.copyToLocalFile(Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
void |
InMemoryFileSystem.copyToLocalFile(Path src,
Path dst,
boolean copyCrc)
|
void |
LocalFileSystem.copyToLocalFile(Path src,
Path dst,
boolean copyCrc)
|
abstract void |
FileSystem.copyToLocalFile(Path src,
Path dst,
boolean copyCrc)
The src file is under FS, and the dst is on the local disk. |
FSDataOutputStream |
FileSystem.create(Path f)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
short replication)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
short replication,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
boolean |
FileSystem.createNewFile(Path f)
Creates the given Path as a brand-new zero-length file. |
FSOutputStream |
InMemoryFileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize)
|
FSOutputStream |
LocalFileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize)
|
abstract FSOutputStream |
FileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize)
Opens an OutputStream at the indicated Path. |
FSOutputStream |
InMemoryFileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize,
Progressable progress)
|
FSOutputStream |
LocalFileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize,
Progressable progress)
|
abstract FSOutputStream |
FileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize,
Progressable progress)
Opens an OutputStream at the indicated Path with write-progress reporting. |
FSOutputStream |
InMemoryFileSystem.createRaw(Path f,
org.apache.hadoop.fs.InMemoryFileSystem.FileAttributes fAttr)
|
boolean |
FileSystem.delete(Path f)
Delete a file. |
boolean |
InMemoryFileSystem.deleteRaw(Path f)
|
boolean |
LocalFileSystem.deleteRaw(Path p)
|
abstract boolean |
FileSystem.deleteRaw(Path f)
Deletes Path |
boolean |
InMemoryFileSystem.exists(Path f)
|
boolean |
LocalFileSystem.exists(Path f)
|
abstract boolean |
FileSystem.exists(Path f)
Check if exists. |
long |
InMemoryFileSystem.getBlockSize(Path f)
|
long |
LocalFileSystem.getBlockSize(Path filename)
|
abstract long |
FileSystem.getBlockSize(Path f)
Get the size for a particular file. |
static Path |
FileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file. |
long |
FileSystem.getContentLength(Path f)
Return the number of bytes of the given path If f is a file, return the size of the file; If f is a directory, return the size of the directory tree |
String[][] |
InMemoryFileSystem.getFileCacheHints(Path f,
long start,
long len)
Return 1x1 'inmemory' cell if the file exists. |
String[][] |
LocalFileSystem.getFileCacheHints(Path f,
long start,
long len)
Return 1x1 'localhost' cell if the file exists. |
abstract String[][] |
FileSystem.getFileCacheHints(Path f,
long start,
long len)
Return a 2D array of size 1x1 or greater, containing hostnames where portions of the given file can be found. |
long |
InMemoryFileSystem.getLength(Path f)
|
long |
LocalFileSystem.getLength(Path f)
|
abstract long |
FileSystem.getLength(Path f)
The number of bytes in a file. |
short |
InMemoryFileSystem.getReplication(Path src)
Replication is not supported for the inmemory file system. |
short |
LocalFileSystem.getReplication(Path f)
Replication is not supported for the local file system. |
abstract short |
FileSystem.getReplication(Path src)
Get replication. |
Path[] |
FileSystem.globPaths(Path filePattern)
Return all the files that match filePattern and are not checksum files. |
Path[] |
FileSystem.globPaths(Path filePattern,
PathFilter filter)
glob all the file names that matches filePattern and is accepted by filter. |
static boolean |
FileSystem.isChecksumFile(Path file)
Return true iff file is a checksum file name. |
boolean |
InMemoryFileSystem.isDirectory(Path f)
Directory operations are not supported |
boolean |
LocalFileSystem.isDirectory(Path f)
|
abstract boolean |
FileSystem.isDirectory(Path f)
True iff the named path is a directory. |
boolean |
FileSystem.isFile(Path f)
True iff the named path is a regular file. |
Path[] |
FileSystem.listPaths(Path f)
List files in a directory. |
Path[] |
FileSystem.listPaths(Path[] files)
Filter raw files in a list directories using the default checksum filter. |
Path[] |
FileSystem.listPaths(Path[] files,
PathFilter filter)
Filter raw files in a list directories using user-supplied path filter. |
Path[] |
FileSystem.listPaths(Path f,
PathFilter filter)
Filter raw files in a directory. |
Path[] |
InMemoryFileSystem.listPathsRaw(Path f)
Directory operations are not supported |
Path[] |
LocalFileSystem.listPathsRaw(Path f)
|
abstract Path[] |
FileSystem.listPathsRaw(Path f)
List files in a directory. |
void |
InMemoryFileSystem.lock(Path f,
boolean shared)
lock operations are not supported |
void |
LocalFileSystem.lock(Path p,
boolean shared)
Deprecated. |
abstract void |
FileSystem.lock(Path f,
boolean shared)
Deprecated. FS does not support file locks anymore. |
Path |
FileSystem.makeQualified(Path path)
Make sure that a path specifies a FileSystem. |
boolean |
InMemoryFileSystem.mkdirs(Path f)
|
boolean |
LocalFileSystem.mkdirs(Path f)
Creates the specified directory hierarchy. |
abstract boolean |
FileSystem.mkdirs(Path f)
Make the given file and all non-existent parents into directories. |
void |
InMemoryFileSystem.moveFromLocalFile(Path src,
Path dst)
|
void |
LocalFileSystem.moveFromLocalFile(Path src,
Path dst)
|
abstract void |
FileSystem.moveFromLocalFile(Path src,
Path dst)
The src file is on the local disk. |
FSDataInputStream |
FileSystem.open(Path f)
Opens an FSDataInputStream at the indicated Path. |
FSDataInputStream |
FileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path. |
FSInputStream |
InMemoryFileSystem.openRaw(Path f)
|
FSInputStream |
LocalFileSystem.openRaw(Path f)
|
abstract FSInputStream |
FileSystem.openRaw(Path f)
Opens an InputStream for the indicated Path, whether local or via DFS. |
File |
LocalFileSystem.pathToFile(Path path)
Convert a path to a File. |
void |
InMemoryFileSystem.release(Path f)
|
void |
LocalFileSystem.release(Path p)
Deprecated. |
abstract void |
FileSystem.release(Path f)
Deprecated. FS does not support file locks anymore. |
boolean |
FileSystem.rename(Path src,
Path dst)
Renames Path src to Path dst. |
boolean |
InMemoryFileSystem.renameRaw(Path src,
Path dst)
|
boolean |
LocalFileSystem.renameRaw(Path src,
Path dst)
|
abstract boolean |
FileSystem.renameRaw(Path src,
Path dst)
Renames Path src to Path dst. |
void |
InMemoryFileSystem.reportChecksumFailure(Path p,
FSInputStream in,
long inPos,
FSInputStream sums,
long sumsPos)
|
void |
LocalFileSystem.reportChecksumFailure(Path p,
FSInputStream in,
long inPos,
FSInputStream sums,
long sumsPos)
Moves files to a bad file directory on the same device, so that their storage will not be reused. |
abstract void |
FileSystem.reportChecksumFailure(Path f,
FSInputStream in,
long inPos,
FSInputStream sums,
long sumsPos)
Report a checksum error to the file system. |
boolean |
InMemoryFileSystem.reserveSpaceWithCheckSum(Path f,
int size)
Register a path with its size. |
boolean |
FileSystem.setReplication(Path src,
short replication)
Set replication for an existing file. |
boolean |
InMemoryFileSystem.setReplicationRaw(Path src,
short replication)
|
boolean |
LocalFileSystem.setReplicationRaw(Path src,
short replication)
|
abstract boolean |
FileSystem.setReplicationRaw(Path src,
short replication)
Set replication for an existing file. |
void |
InMemoryFileSystem.setWorkingDirectory(Path new_dir)
|
void |
LocalFileSystem.setWorkingDirectory(Path newDir)
Set the working directory to the given directory. |
abstract void |
FileSystem.setWorkingDirectory(Path new_dir)
Set the current working directory for the given file system. |
Path |
InMemoryFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Path |
LocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
abstract Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
Constructors in org.apache.hadoop.fs with parameters of type Path | |
---|---|
FSDataInputStream(FileSystem fs,
Path file,
Configuration conf)
|
|
FSDataInputStream(FileSystem fs,
Path file,
int bufferSize,
Configuration conf)
|
|
FSDataOutputStream(FileSystem fs,
Path file,
boolean overwrite,
Configuration conf,
int bufferSize,
short replication,
long blockSize)
|
|
FSDataOutputStream(FileSystem fs,
Path file,
boolean overwrite,
Configuration conf,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
|
Path(Path parent,
Path child)
Resolve a child path against a parent path. |
|
Path(Path parent,
String child)
Resolve a child path against a parent path. |
|
Path(String parent,
Path child)
Resolve a child path against a parent path. |
Uses of Path in org.apache.hadoop.fs.s3 |
---|
Methods in org.apache.hadoop.fs.s3 that return Path | |
---|---|
Path |
S3FileSystem.getWorkingDirectory()
|
Path[] |
S3FileSystem.listPathsRaw(Path path)
|
Path |
S3FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Methods in org.apache.hadoop.fs.s3 with parameters of type Path | |
---|---|
void |
S3FileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
void |
S3FileSystem.copyFromLocalFile(Path src,
Path dst)
|
void |
S3FileSystem.copyToLocalFile(Path src,
Path dst,
boolean copyCrc)
|
FSOutputStream |
S3FileSystem.createRaw(Path file,
boolean overwrite,
short replication,
long blockSize)
|
FSOutputStream |
S3FileSystem.createRaw(Path file,
boolean overwrite,
short replication,
long blockSize,
Progressable progress)
|
boolean |
S3FileSystem.deleteRaw(Path path)
|
boolean |
S3FileSystem.exists(Path path)
|
long |
S3FileSystem.getBlockSize(Path path)
|
String[][] |
S3FileSystem.getFileCacheHints(Path f,
long start,
long len)
Return 1x1 'localhost' cell if the file exists. |
long |
S3FileSystem.getLength(Path path)
|
short |
S3FileSystem.getReplication(Path path)
Replication is not supported for S3 file systems since S3 handles it for us. |
boolean |
S3FileSystem.isDirectory(Path path)
|
boolean |
S3FileSystem.isFile(Path path)
|
Path[] |
S3FileSystem.listPathsRaw(Path path)
|
void |
S3FileSystem.lock(Path path,
boolean shared)
Deprecated. |
boolean |
S3FileSystem.mkdirs(Path path)
|
void |
S3FileSystem.moveFromLocalFile(Path src,
Path dst)
|
FSInputStream |
S3FileSystem.openRaw(Path path)
|
void |
S3FileSystem.release(Path path)
Deprecated. |
boolean |
S3FileSystem.renameRaw(Path src,
Path dst)
|
void |
S3FileSystem.reportChecksumFailure(Path f,
FSInputStream in,
long inPos,
FSInputStream sums,
long sumsPos)
|
boolean |
S3FileSystem.setReplicationRaw(Path path,
short replication)
Replication is not supported for S3 file systems since S3 handles it for us. |
void |
S3FileSystem.setWorkingDirectory(Path dir)
|
Path |
S3FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Uses of Path in org.apache.hadoop.io |
---|
Methods in org.apache.hadoop.io with parameters of type Path | |
---|---|
SequenceFile.Writer |
SequenceFile.Sorter.cloneFileAttributes(FileSystem ignoredFileSys,
Path inputFile,
Path outputFile,
Progressable prog)
Deprecated. call #cloneFileAttributes(Path,Path,Progressable) instead |
SequenceFile.Writer |
SequenceFile.Sorter.cloneFileAttributes(Path inputFile,
Path outputFile,
Progressable prog)
Clones the attributes (like compression of the input file and creates a corresponding Writer |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
Progressable progress)
Construct the preferred type of SequenceFile Writer. |
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class keyClass,
Class valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index. |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(List<SequenceFile.Sorter.SegmentDescriptor> segments,
Path tmpDir)
Merges the list of segments of type SegmentDescriptor |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
int factor,
Path tmpDir)
Merges the contents of files passed in Path[] |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
int factor,
Path tmpDir)
Merges the contents of files passed in Path[] |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
Path tmpDir)
Merges the contents of files passed in Path[] using a max factor value that is already set |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
boolean deleteInputs,
Path tmpDir)
Merges the contents of files passed in Path[] using a max factor value that is already set |
void |
SequenceFile.Sorter.merge(Path[] inFiles,
Path outFile)
Merge the provided files. |
void |
SequenceFile.Sorter.merge(Path[] inFiles,
Path outFile)
Merge the provided files. |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
Path tempDir,
boolean deleteInputs)
Merges the contents of files passed in Path[] |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.merge(Path[] inNames,
Path tempDir,
boolean deleteInputs)
Merges the contents of files passed in Path[] |
void |
SequenceFile.Sorter.sort(Path[] inFiles,
Path outFile,
boolean deleteInput)
Perform a file sort from a set of input files into an output file. |
void |
SequenceFile.Sorter.sort(Path[] inFiles,
Path outFile,
boolean deleteInput)
Perform a file sort from a set of input files into an output file. |
void |
SequenceFile.Sorter.sort(Path inFile,
Path outFile)
The backwards compatible interface to sort. |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.sortAndIterate(Path[] inFiles,
Path tempDir,
boolean deleteInput)
Perform a file sort from a set of input files and return an iterator. |
SequenceFile.Sorter.RawKeyValueIterator |
SequenceFile.Sorter.sortAndIterate(Path[] inFiles,
Path tempDir,
boolean deleteInput)
Perform a file sort from a set of input files and return an iterator. |
Constructors in org.apache.hadoop.io with parameters of type Path | |
---|---|
SequenceFile.Reader(FileSystem fs,
Path file,
Configuration conf)
Open the named file. |
|
SequenceFile.Sorter.SegmentDescriptor(long segmentOffset,
long segmentLength,
Path segmentPathName)
Constructs a segment |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Create the named file. |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
Progressable progress,
SequenceFile.Metadata metadata)
Create the named file with write-progress reporter. |
Uses of Path in org.apache.hadoop.io.compress |
---|
Methods in org.apache.hadoop.io.compress with parameters of type Path | |
---|---|
CompressionCodec |
CompressionCodecFactory.getCodec(Path file)
Find the relevant compression codec for the given file based on its filename suffix. |
Uses of Path in org.apache.hadoop.mapred |
---|
Methods in org.apache.hadoop.mapred that return Path | |
---|---|
Path[] |
JobConf.getInputPaths()
|
Path |
JobConf.getLocalPath(String pathString)
Constructs a local file name. |
Path |
JobConf.getOutputPath()
|
Path |
FileSplit.getPath()
The file containing this split's data. |
Path |
JobConf.getSystemDir()
|
Path |
PhasedFileSystem.getWorkingDirectory()
|
Path |
JobConf.getWorkingDirectory()
Get the current working directory for the default file system. |
protected Path[] |
SequenceFileInputFormat.listPaths(JobConf job)
|
protected Path[] |
InputFormatBase.listPaths(JobConf job)
List input directories. |
Path[] |
PhasedFileSystem.listPathsRaw(Path f)
|
Path |
PhasedFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Methods in org.apache.hadoop.mapred with parameters of type Path | |
---|---|
void |
PhasedFileSystem.abort(Path p)
Aborts a single file. |
void |
JobConf.addInputPath(Path dir)
|
void |
PhasedFileSystem.commit(Path fPath)
Commits a single file file to its final locations as passed in create* methods. |
void |
PhasedFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
void |
PhasedFileSystem.copyFromLocalFile(Path src,
Path dst)
|
void |
PhasedFileSystem.copyToLocalFile(Path src,
Path dst,
boolean copyCrc)
|
FSOutputStream |
PhasedFileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize)
|
FSOutputStream |
PhasedFileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize,
Progressable progress)
|
boolean |
PhasedFileSystem.deleteRaw(Path f)
|
boolean |
PhasedFileSystem.exists(Path f)
|
long |
PhasedFileSystem.getBlockSize(Path f)
|
String[][] |
PhasedFileSystem.getFileCacheHints(Path f,
long start,
long len)
|
long |
PhasedFileSystem.getLength(Path f)
|
static SequenceFile.Reader[] |
SequenceFileOutputFormat.getReaders(Configuration conf,
Path dir)
Open the output generated by this format. |
static MapFile.Reader[] |
MapFileOutputFormat.getReaders(FileSystem ignored,
Path dir,
Configuration conf)
Open the output generated by this format. |
short |
PhasedFileSystem.getReplication(Path src)
|
boolean |
PhasedFileSystem.isDirectory(Path f)
|
protected boolean |
TextInputFormat.isSplitable(FileSystem fs,
Path file)
|
protected boolean |
InputFormatBase.isSplitable(FileSystem fs,
Path filename)
Is the given filename splitable? Usually, true, but if the file is stream compressed, it will not be. |
Path[] |
PhasedFileSystem.listPathsRaw(Path f)
|
void |
PhasedFileSystem.lock(Path f,
boolean shared)
Deprecated. |
boolean |
PhasedFileSystem.mkdirs(Path f)
|
void |
PhasedFileSystem.moveFromLocalFile(Path src,
Path dst)
|
FSInputStream |
PhasedFileSystem.openRaw(Path f)
|
void |
PhasedFileSystem.release(Path f)
Deprecated. |
boolean |
PhasedFileSystem.renameRaw(Path src,
Path dst)
|
void |
PhasedFileSystem.reportChecksumFailure(Path f,
FSInputStream in,
long inPos,
FSInputStream sums,
long sumsPos)
|
void |
JobConf.setInputPath(Path dir)
|
void |
JobConf.setOutputPath(Path dir)
|
boolean |
PhasedFileSystem.setReplicationRaw(Path src,
short replication)
|
void |
PhasedFileSystem.setWorkingDirectory(Path new_dir)
|
void |
JobConf.setWorkingDirectory(Path dir)
Set the current working directory for the default file system |
Path |
PhasedFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Constructors in org.apache.hadoop.mapred with parameters of type Path | |
---|---|
FileSplit(Path file,
long start,
long length,
JobConf conf)
Constructs a split. |
|
JobConf(Path config)
Construct a map/reduce configuration. |
Uses of Path in org.apache.hadoop.streaming |
---|
Methods in org.apache.hadoop.streaming with parameters of type Path | |
---|---|
boolean[] |
MergerInputFormat.areValidInputDirectories(FileSystem fileSys,
Path[] inputDirs)
This implementation always returns true. |
Uses of Path in org.apache.hadoop.util |
---|
Methods in org.apache.hadoop.util that return Path | |
---|---|
static Path |
CopyFiles.CopyFilesMapper.makeRelative(Path root,
Path absPath)
Make a path relative with respect to a root path. |
static Path[] |
StringUtils.stringToPath(String[] str)
|
Methods in org.apache.hadoop.util with parameters of type Path | |
---|---|
static Path |
CopyFiles.CopyFilesMapper.makeRelative(Path root,
Path absPath)
Make a path relative with respect to a root path. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |