Uses of Class
org.apache.hadoop.fs.FileSystem

Packages that use FileSystem
org.apache.hadoop.dfs A distributed implementation of FileSystem
org.apache.hadoop.fs An abstract file system API. 
org.apache.hadoop.io Generic i/o code for use when reading and writing data to the network, to databases, and to files. 
org.apache.hadoop.mapred A system for scalable, fault-tolerant, distributed computation over large data collections. 
 

Uses of FileSystem in org.apache.hadoop.dfs
 

Subclasses of FileSystem in org.apache.hadoop.dfs
 class DistributedFileSystem
          Implementation of the abstract FileSystem for the DFS system.
 

Uses of FileSystem in org.apache.hadoop.fs
 

Subclasses of FileSystem in org.apache.hadoop.fs
 class LocalFileSystem
          Implement the FileSystem API for the native filesystem.
 

Methods in org.apache.hadoop.fs that return FileSystem
static FileSystem FileSystem.get(Configuration conf)
          Returns the configured filesystem implementation.
static FileSystem FileSystem.getNamed(String name, Configuration conf)
          Returns a named filesystem.
static FileSystem FileSystem.parseArgs(String[] argv, int i, Configuration conf)
          Parse the cmd-line args, starting at i.
 

Methods in org.apache.hadoop.fs with parameters of type FileSystem
static boolean FileUtil.copy(File src, FileSystem dstFS, Path dst, boolean deleteSource, Configuration conf)
          Copy local files to a FileSystem.
static boolean FileUtil.copy(FileSystem srcFS, Path src, File dst, boolean deleteSource, Configuration conf)
          Copy FileSystem files to local files.
static boolean FileUtil.copy(FileSystem srcFS, Path src, FileSystem dstFS, Path dst, boolean deleteSource, Configuration conf)
          Copy files between FileSystems.
static boolean FileUtil.copyMerge(FileSystem srcFS, Path srcDir, FileSystem dstFS, Path dstFile, boolean deleteSource, Configuration conf, String addString)
          Copy all files in a directory to one output file (merge).
 

Constructors in org.apache.hadoop.fs with parameters of type FileSystem
FSDataInputStream(FileSystem fs, Path file, Configuration conf)
           
FSDataInputStream(FileSystem fs, Path file, int bufferSize, Configuration conf)
           
FSDataOutputStream(FileSystem fs, Path file, boolean overwrite, Configuration conf, int bufferSize, short replication, long blockSize)
           
FSDataOutputStream(FileSystem fs, Path file, boolean overwrite, Configuration conf, int bufferSize, short replication, long blockSize, Progressable progress)
           
 

Uses of FileSystem in org.apache.hadoop.io
 

Methods in org.apache.hadoop.io with parameters of type FileSystem
static SequenceFile.Writer SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType)
          Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec)
          Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec, Progressable progress)
          Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, Progressable progress)
          Construct the preferred type of SequenceFile Writer.
static void MapFile.delete(FileSystem fs, String name)
          Deletes the named map file.
static long MapFile.fix(FileSystem fs, Path dir, Class keyClass, Class valueClass, boolean dryrun, Configuration conf)
          This method attempts to fix a corrupt MapFile by re-creating its index.
static void MapFile.rename(FileSystem fs, String oldName, String newName)
          Renames an existing map directory.
 

Constructors in org.apache.hadoop.io with parameters of type FileSystem
ArrayFile.Reader(FileSystem fs, String file, Configuration conf)
          Construct an array reader for the named file.
ArrayFile.Writer(FileSystem fs, String file, Class valClass)
          Create the named file for values of the named class.
MapFile.Reader(FileSystem fs, String dirName, Configuration conf)
          Construct a map reader for the named map.
MapFile.Reader(FileSystem fs, String dirName, WritableComparator comparator, Configuration conf)
          Construct a map reader for the named map using the named comparator.
MapFile.Writer(FileSystem fs, String dirName, Class keyClass, Class valClass)
          Create the named map for keys of the named class.
MapFile.Writer(FileSystem fs, String dirName, Class keyClass, Class valClass, boolean compress)
          Create the named map for keys of the named class.
MapFile.Writer(FileSystem fs, String dirName, WritableComparator comparator, Class valClass)
          Create the named map using the named key comparator.
MapFile.Writer(FileSystem fs, String dirName, WritableComparator comparator, Class valClass, boolean compress)
          Create the named map using the named key comparator.
SequenceFile.Reader(FileSystem fs, Path file, Configuration conf)
          Open the named file.
SequenceFile.Reader(FileSystem fs, String file, Configuration conf)
          Deprecated. Call SequenceFile.Reader.SequenceFile.Reader(FileSystem,Path,Configuration).
SequenceFile.Sorter(FileSystem fs, Class keyClass, Class valClass, Configuration conf)
          Sort and merge files containing the named classes.
SequenceFile.Sorter(FileSystem fs, WritableComparator comparator, Class valClass, Configuration conf)
          Sort and merge using an arbitrary WritableComparator.
SequenceFile.Writer(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass)
          Create the named file.
SequenceFile.Writer(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, Progressable progress)
          Create the named file with write-progress reporter.
SequenceFile.Writer(FileSystem fs, Path name, Class keyClass, Class valClass)
          Deprecated. Call SequenceFile.Writer.SequenceFile.Writer(FileSystem,Configuration,Path,Class,Class).
SequenceFile.Writer(FileSystem fs, Path name, Class keyClass, Class valClass, boolean compress)
          Deprecated. Call SequenceFile.Writer.SequenceFile.Writer(FileSystem,Configuration,Path,Class,Class).
SequenceFile.Writer(FileSystem fs, Path name, Class keyClass, Class valClass, boolean compress, Progressable progress)
          Deprecated. Call SequenceFile.Writer.SequenceFile.Writer(FileSystem,Configuration,Path,Class,Class,Progressable).
SequenceFile.Writer(FileSystem fs, Path name, Class keyClass, Class valClass, Progressable progress)
          Deprecated. Call SequenceFile.Writer.SequenceFile.Writer(FileSystem,Configuration,Path,Class,Class,Progressable).
SequenceFile.Writer(FileSystem fs, String name, Class keyClass, Class valClass)
          Deprecated. Call SequenceFile.Writer.SequenceFile.Writer(FileSystem,Path,Class,Class).
SetFile.Reader(FileSystem fs, String dirName, Configuration conf)
          Construct a set reader for the named set.
SetFile.Reader(FileSystem fs, String dirName, WritableComparator comparator, Configuration conf)
          Construct a set reader for the named set using the named comparator.
SetFile.Writer(FileSystem fs, String dirName, Class keyClass)
          Create the named set for keys of the named class.
SetFile.Writer(FileSystem fs, String dirName, WritableComparator comparator)
          Create the named set using the named key comparator.
 

Uses of FileSystem in org.apache.hadoop.mapred
 

Methods in org.apache.hadoop.mapred that return FileSystem
 FileSystem JobClient.getFs()
          Get a filesystem handle.
 

Methods in org.apache.hadoop.mapred with parameters of type FileSystem
 boolean[] InputFormatBase.areValidInputDirectories(FileSystem fileSys, Path[] inputDirs)
           
 boolean[] InputFormat.areValidInputDirectories(FileSystem fileSys, Path[] inputDirs)
          Are the input directories valid? This method is used to test the input directories when a job is submitted so that the framework can fail early with a useful error message when the input directory does not exist.
 void OutputFormatBase.checkOutputSpecs(FileSystem fs, JobConf job)
           
 void OutputFormat.checkOutputSpecs(FileSystem fs, JobConf job)
          Check whether the output specification for a job is appropriate.
static MapFile.Reader[] MapFileOutputFormat.getReaders(FileSystem fs, File dir, Configuration conf)
          Deprecated. Call MapFileOutputFormat.getReaders(FileSystem, Path, Configuration).
static MapFile.Reader[] MapFileOutputFormat.getReaders(FileSystem fs, Path dir, Configuration conf)
          Open the output generated by this format.
 RecordReader TextInputFormat.getRecordReader(FileSystem fs, FileSplit split, JobConf job, Reporter reporter)
           
 RecordReader SequenceFileInputFormat.getRecordReader(FileSystem fs, FileSplit split, JobConf job, Reporter reporter)
           
 RecordReader SequenceFileInputFilter.getRecordReader(FileSystem fs, FileSplit split, JobConf job, Reporter reporter)
          Create a record reader for the given split
abstract  RecordReader InputFormatBase.getRecordReader(FileSystem fs, FileSplit split, JobConf job, Reporter reporter)
           
 RecordReader InputFormat.getRecordReader(FileSystem fs, FileSplit split, JobConf job, Reporter reporter)
          Construct a RecordReader for a FileSplit.
 RecordWriter TextOutputFormat.getRecordWriter(FileSystem fs, JobConf job, String name, Progressable progress)
           
 RecordWriter SequenceFileOutputFormat.getRecordWriter(FileSystem fs, JobConf job, String name, Progressable progress)
           
abstract  RecordWriter OutputFormatBase.getRecordWriter(FileSystem fs, JobConf job, String name, Progressable progress)
           
 RecordWriter MapFileOutputFormat.getRecordWriter(FileSystem fs, JobConf job, String name, Progressable progress)
           
 RecordWriter OutputFormat.getRecordWriter(FileSystem fs, JobConf job, String name, Progressable progress)
          Construct a RecordWriter with Progressable.
 FileSplit[] InputFormatBase.getSplits(FileSystem fs, JobConf job, int numSplits)
          Splits files returned by InputFormatBase.listPaths(FileSystem,JobConf) when they're too big.
 FileSplit[] InputFormat.getSplits(FileSystem fs, JobConf job, int numSplits)
          Splits a set of input files.
protected  boolean TextInputFormat.isSplitable(FileSystem fs, Path file)
           
protected  boolean InputFormatBase.isSplitable(FileSystem fs, Path filename)
          Is the given filename splitable? Usually, true, but if the file is stream compressed, it will not be.
protected  File[] InputFormatBase.listFiles(FileSystem fs, JobConf job)
          Deprecated. Call InputFormatBase.listFiles(FileSystem,JobConf) instead.
protected  Path[] SequenceFileInputFormat.listPaths(FileSystem fs, JobConf job)
           
protected  Path[] InputFormatBase.listPaths(FileSystem fs, JobConf job)
          List input directories.
 



Copyright © 2006 The Apache Software Foundation