|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use Path | |
---|---|
org.apache.hadoop.conf | Configuration of system parameters. |
org.apache.hadoop.dfs | A distributed implementation of FileSystem . |
org.apache.hadoop.fs | An abstract file system API. |
org.apache.hadoop.io | Generic i/o code for use when reading and writing data to the network, to databases, and to files. |
org.apache.hadoop.mapred | A system for scalable, fault-tolerant, distributed computation over large data collections. |
Uses of Path in org.apache.hadoop.conf |
---|
Methods in org.apache.hadoop.conf that return Path | |
---|---|
Path |
Configuration.getLocalPath(String dirsProp,
String path)
Returns a local file under a directory named in dirsProp with the given path. |
Methods in org.apache.hadoop.conf with parameters of type Path | |
---|---|
void |
Configuration.addDefaultResource(Path file)
Add a default resource. |
void |
Configuration.addFinalResource(Path file)
Add a final resource. |
Uses of Path in org.apache.hadoop.dfs |
---|
Methods in org.apache.hadoop.dfs that return Path | |
---|---|
Path |
DistributedFileSystem.getWorkingDirectory()
|
Path[] |
DistributedFileSystem.listPathsRaw(Path f)
|
Path |
DistributedFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Methods in org.apache.hadoop.dfs with parameters of type Path | |
---|---|
void |
DistributedFileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Move completed local data to DFS destination |
void |
DistributedFileSystem.copyFromLocalFile(Path src,
Path dst)
|
void |
DistributedFileSystem.copyToLocalFile(Path src,
Path dst)
|
FSOutputStream |
DistributedFileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize)
|
FSOutputStream |
DistributedFileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize,
Progressable progress)
|
boolean |
DistributedFileSystem.deleteRaw(Path f)
Get rid of Path f, whether a true file or dir. |
boolean |
DistributedFileSystem.exists(Path f)
|
long |
DistributedFileSystem.getBlockSize(Path f)
|
String[][] |
DistributedFileSystem.getFileCacheHints(Path f,
long start,
long len)
|
long |
DistributedFileSystem.getLength(Path f)
|
short |
DistributedFileSystem.getReplication(Path f)
|
boolean |
DistributedFileSystem.isDirectory(Path f)
|
Path[] |
DistributedFileSystem.listPathsRaw(Path f)
|
void |
DistributedFileSystem.lock(Path f,
boolean shared)
|
boolean |
DistributedFileSystem.mkdirs(Path f)
|
void |
DistributedFileSystem.moveFromLocalFile(Path src,
Path dst)
|
FSInputStream |
DistributedFileSystem.openRaw(Path f)
|
void |
DistributedFileSystem.release(Path f)
|
boolean |
DistributedFileSystem.renameRaw(Path src,
Path dst)
Rename files/dirs |
void |
DistributedFileSystem.reportChecksumFailure(Path f,
FSInputStream in,
long start,
long length,
int crc)
|
void |
DFSShell.setReplication(short newRep,
Path src,
boolean recursive)
Set the replication for the path argument if it's a directory and recursive is true, set replication for all the subdirs and those files too |
boolean |
DistributedFileSystem.setReplicationRaw(Path src,
short replication)
|
void |
DistributedFileSystem.setWorkingDirectory(Path dir)
|
Path |
DistributedFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
Uses of Path in org.apache.hadoop.fs |
---|
Methods in org.apache.hadoop.fs that return Path | |
---|---|
static Path |
FileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file. |
Path |
Path.getParent()
Returns the parent of a path. |
Path |
LocalFileSystem.getWorkingDirectory()
|
abstract Path |
FileSystem.getWorkingDirectory()
Get the current working directory for the given file system |
Path[] |
FileSystem.listPaths(Path f)
List files in a directory. |
Path[] |
FileSystem.listPaths(Path f,
PathFilter filter)
Filter files in a directory. |
Path[] |
LocalFileSystem.listPathsRaw(Path f)
|
abstract Path[] |
FileSystem.listPathsRaw(Path f)
List files in a directory. |
Path |
LocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
abstract Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
Path |
Path.suffix(String suffix)
Adds a suffix to a the final name in the path. |
Methods in org.apache.hadoop.fs with parameters of type Path | |
---|---|
boolean |
PathFilter.accept(Path path)
Tests whether or not the specified abstract pathname should be included in a pathname list. |
void |
LocalFileSystem.completeLocalOutput(Path fsWorkingFile,
Path tmpLocalFile)
|
abstract void |
FileSystem.completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target. |
static boolean |
FileUtil.copy(File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy local files to a FileSystem. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
File dst,
boolean deleteSource,
Configuration conf)
Copy FileSystem files to local files. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy files between FileSystems. |
void |
LocalFileSystem.copyFromLocalFile(Path src,
Path dst)
|
abstract void |
FileSystem.copyFromLocalFile(Path src,
Path dst)
The src file is on the local disk. |
void |
LocalFileSystem.copyToLocalFile(Path src,
Path dst)
|
abstract void |
FileSystem.copyToLocalFile(Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
FSDataOutputStream |
FileSystem.create(Path f)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress reporting. |
FSDataOutputStream |
FileSystem.create(Path f,
short replication)
Opens an FSDataOutputStream at the indicated Path. |
FSDataOutputStream |
FileSystem.create(Path f,
short replication,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
boolean |
FileSystem.createNewFile(Path f)
Creates the given Path as a brand-new zero-length file. |
FSOutputStream |
LocalFileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize)
|
abstract FSOutputStream |
FileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize)
Opens an OutputStream at the indicated Path. |
FSOutputStream |
LocalFileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize,
Progressable progress)
|
abstract FSOutputStream |
FileSystem.createRaw(Path f,
boolean overwrite,
short replication,
long blockSize,
Progressable progress)
Opens an OutputStream at the indicated Path with write-progress reporting. |
boolean |
FileSystem.delete(Path f)
Delete a file. |
boolean |
LocalFileSystem.deleteRaw(Path p)
|
abstract boolean |
FileSystem.deleteRaw(Path f)
Deletes Path |
boolean |
LocalFileSystem.exists(Path f)
|
abstract boolean |
FileSystem.exists(Path f)
Check if exists. |
long |
LocalFileSystem.getBlockSize(Path filename)
|
abstract long |
FileSystem.getBlockSize(Path f)
Get the size for a particular file. |
static Path |
FileSystem.getChecksumFile(Path file)
Return the name of the checksum file associated with a file. |
String[][] |
LocalFileSystem.getFileCacheHints(Path f,
long start,
long len)
Return 1x1 'localhost' cell if the file exists. |
abstract String[][] |
FileSystem.getFileCacheHints(Path f,
long start,
long len)
Return a 2D array of size 1x1 or greater, containing hostnames where portions of the given file can be found. |
long |
LocalFileSystem.getLength(Path f)
|
abstract long |
FileSystem.getLength(Path f)
The number of bytes in a file. |
short |
LocalFileSystem.getReplication(Path f)
Replication is not supported for the local file system. |
abstract short |
FileSystem.getReplication(Path src)
Get replication. |
static boolean |
FileSystem.isChecksumFile(Path file)
Return true iff file is a checksum file name. |
boolean |
LocalFileSystem.isDirectory(Path f)
|
abstract boolean |
FileSystem.isDirectory(Path f)
True iff the named path is a directory. |
boolean |
FileSystem.isFile(Path f)
True iff the named path is a regular file. |
Path[] |
FileSystem.listPaths(Path f)
List files in a directory. |
Path[] |
FileSystem.listPaths(Path f,
PathFilter filter)
Filter files in a directory. |
Path[] |
LocalFileSystem.listPathsRaw(Path f)
|
abstract Path[] |
FileSystem.listPathsRaw(Path f)
List files in a directory. |
void |
LocalFileSystem.lock(Path p,
boolean shared)
|
abstract void |
FileSystem.lock(Path f,
boolean shared)
Obtain a lock on the given Path |
boolean |
LocalFileSystem.mkdirs(Path f)
Creates the specified directory hierarchy. |
abstract boolean |
FileSystem.mkdirs(Path f)
Make the given file and all non-existent parents into directories. |
void |
LocalFileSystem.moveFromLocalFile(Path src,
Path dst)
|
abstract void |
FileSystem.moveFromLocalFile(Path src,
Path dst)
The src file is on the local disk. |
FSDataInputStream |
FileSystem.open(Path f)
Opens an FSDataInputStream at the indicated Path. |
FSDataInputStream |
FileSystem.open(Path f,
int bufferSize)
Opens an FSDataInputStream at the indicated Path. |
FSInputStream |
LocalFileSystem.openRaw(Path f)
|
abstract FSInputStream |
FileSystem.openRaw(Path f)
Opens an InputStream for the indicated Path, whether local or via DFS. |
File |
LocalFileSystem.pathToFile(Path path)
Convert a path to a File. |
void |
LocalFileSystem.release(Path p)
|
abstract void |
FileSystem.release(Path f)
Release the lock |
boolean |
FileSystem.rename(Path src,
Path dst)
Renames Path src to Path dst. |
boolean |
LocalFileSystem.renameRaw(Path src,
Path dst)
|
abstract boolean |
FileSystem.renameRaw(Path src,
Path dst)
Renames Path src to Path dst. |
void |
LocalFileSystem.reportChecksumFailure(Path p,
FSInputStream in,
long start,
long length,
int crc)
Moves files to a bad file directory on the same device, so that their storage will not be reused. |
abstract void |
FileSystem.reportChecksumFailure(Path f,
FSInputStream in,
long start,
long length,
int crc)
Report a checksum error to the file system. |
boolean |
FileSystem.setReplication(Path src,
short replication)
Set replication for an existing file. |
boolean |
LocalFileSystem.setReplicationRaw(Path src,
short replication)
|
abstract boolean |
FileSystem.setReplicationRaw(Path src,
short replication)
Set replication for an existing file. |
void |
LocalFileSystem.setWorkingDirectory(Path newDir)
Set the working directory to the given directory. |
abstract void |
FileSystem.setWorkingDirectory(Path new_dir)
Set the current working directory for the given file system. |
Path |
LocalFileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
|
abstract Path |
FileSystem.startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
Constructors in org.apache.hadoop.fs with parameters of type Path | |
---|---|
FSDataInputStream(FileSystem fs,
Path file,
Configuration conf)
|
|
FSDataInputStream(FileSystem fs,
Path file,
int bufferSize,
Configuration conf)
|
|
FSDataOutputStream(FileSystem fs,
Path file,
boolean overwrite,
Configuration conf,
int bufferSize,
short replication,
long blockSize)
|
|
FSDataOutputStream(FileSystem fs,
Path file,
boolean overwrite,
Configuration conf,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
|
Path(Path parent,
Path child)
Resolve a child path against a parent path. |
|
Path(Path parent,
String child)
Resolve a child path against a parent path. |
|
Path(String parent,
Path child)
Resolve a child path against a parent path. |
Uses of Path in org.apache.hadoop.io |
---|
Methods in org.apache.hadoop.io with parameters of type Path | |
---|---|
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class keyClass,
Class valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index. |
void |
SequenceFile.Sorter.merge(Path[] inFiles,
Path outFile)
Merge the provided files. |
void |
SequenceFile.Sorter.merge(Path[] inFiles,
Path outFile)
Merge the provided files. |
void |
SequenceFile.Sorter.sort(Path[] inFiles,
Path outFile,
boolean deleteInput)
Perform a file sort from a set of input files into an output file. |
void |
SequenceFile.Sorter.sort(Path[] inFiles,
Path outFile,
boolean deleteInput)
Perform a file sort from a set of input files into an output file. |
void |
SequenceFile.Sorter.sort(Path inFile,
Path outFile)
The backwards compatible interface to sort. |
Constructors in org.apache.hadoop.io with parameters of type Path | |
---|---|
SequenceFile.Reader(FileSystem fs,
Path file,
Configuration conf)
Open the named file. |
|
SequenceFile.Writer(FileSystem fs,
Path name,
Class keyClass,
Class valClass)
Create the named file. |
|
SequenceFile.Writer(FileSystem fs,
Path name,
Class keyClass,
Class valClass,
boolean compress)
Create the named file. |
|
SequenceFile.Writer(FileSystem fs,
Path name,
Class keyClass,
Class valClass,
boolean compress,
Progressable progress)
Create the named file with write-progress reporter. |
|
SequenceFile.Writer(FileSystem fs,
Path name,
Class keyClass,
Class valClass,
Progressable progress)
Create the named file with write-progress reporter. |
Uses of Path in org.apache.hadoop.mapred |
---|
Methods in org.apache.hadoop.mapred that return Path | |
---|---|
Path[] |
JobConf.getInputPaths()
|
Path |
JobConf.getLocalPath(String pathString)
Constructs a local file name. |
Path |
JobConf.getOutputPath()
|
Path |
FileSplit.getPath()
The file containing this split's data. |
Path |
JobConf.getSystemDir()
|
Path |
JobConf.getWorkingDirectory()
Get the current working directory for the default file system. |
protected Path[] |
SequenceFileInputFormat.listPaths(FileSystem fs,
JobConf job)
|
protected Path[] |
InputFormatBase.listPaths(FileSystem fs,
JobConf job)
List input directories. |
Methods in org.apache.hadoop.mapred with parameters of type Path | |
---|---|
void |
JobConf.addInputPath(Path dir)
|
boolean[] |
InputFormatBase.areValidInputDirectories(FileSystem fileSys,
Path[] inputDirs)
|
boolean[] |
InputFormat.areValidInputDirectories(FileSystem fileSys,
Path[] inputDirs)
Are the input directories valid? This method is used to test the input directories when a job is submitted so that the framework can fail early with a useful error message when the input directory does not exist. |
static SequenceFile.Reader[] |
SequenceFileOutputFormat.getReaders(Configuration conf,
Path dir)
Open the output generated by this format. |
static MapFile.Reader[] |
MapFileOutputFormat.getReaders(FileSystem fs,
Path dir,
Configuration conf)
Open the output generated by this format. |
void |
JobConf.setInputPath(Path dir)
|
void |
JobConf.setOutputPath(Path dir)
|
void |
JobConf.setWorkingDirectory(Path dir)
Set the current working directory for the default file system |
Constructors in org.apache.hadoop.mapred with parameters of type Path | |
---|---|
FileSplit(Path file,
long start,
long length)
Constructs a split. |
|
JobConf(Path config)
Construct a map/reduce configuration. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |