Uses of Class
org.apache.hadoop.fs.FileSystem

Packages that use FileSystem
org.apache.hadoop.dfs A distributed implementation of FileSystem
org.apache.hadoop.fs An abstract file system API. 
org.apache.hadoop.io Generic i/o code for use when reading and writing data to the network, to databases, and to files. 
org.apache.hadoop.mapred A system for scalable, fault-tolerant, distributed computation over large data collections. 
 

Uses of FileSystem in org.apache.hadoop.dfs
 

Subclasses of FileSystem in org.apache.hadoop.dfs
 class DistributedFileSystem
          Implementation of the abstract FileSystem for the DFS system.
 

Uses of FileSystem in org.apache.hadoop.fs
 

Subclasses of FileSystem in org.apache.hadoop.fs
 class LocalFileSystem
          Implement the FileSystem API for the native filesystem.
 

Methods in org.apache.hadoop.fs that return FileSystem
static FileSystem FileSystem.get(Configuration conf)
          Returns the configured filesystem implementation.
static FileSystem FileSystem.getNamed(String name, Configuration conf)
          Returns a named filesystem.
static FileSystem FileSystem.parseArgs(String[] argv, int i, Configuration conf)
          Parse the cmd-line args, starting at i.
 

Methods in org.apache.hadoop.fs with parameters of type FileSystem
static boolean FileUtil.copy(File src, FileSystem dstFS, Path dst, boolean deleteSource, Configuration conf)
          Copy local files to a FileSystem.
static boolean FileUtil.copy(FileSystem srcFS, Path src, File dst, boolean deleteSource, Configuration conf)
          Copy FileSystem files to local files.
static boolean FileUtil.copy(FileSystem srcFS, Path src, FileSystem dstFS, Path dst, boolean deleteSource, Configuration conf)
          Copy files between FileSystems.
 

Constructors in org.apache.hadoop.fs with parameters of type FileSystem
FSDataInputStream(FileSystem fs, Path file, Configuration conf)
           
FSDataInputStream(FileSystem fs, Path file, int bufferSize, Configuration conf)
           
FSDataOutputStream(FileSystem fs, Path file, boolean overwrite, Configuration conf, int bufferSize, short replication, long blockSize)
           
FSDataOutputStream(FileSystem fs, Path file, boolean overwrite, Configuration conf, int bufferSize, short replication, long blockSize, Progressable progress)
           
 

Uses of FileSystem in org.apache.hadoop.io
 

Methods in org.apache.hadoop.io with parameters of type FileSystem
static void MapFile.delete(FileSystem fs, String name)
          Deletes the named map file.
static long MapFile.fix(FileSystem fs, Path dir, Class keyClass, Class valueClass, boolean dryrun, Configuration conf)
          This method attempts to fix a corrupt MapFile by re-creating its index.
static void MapFile.rename(FileSystem fs, String oldName, String newName)
          Renames an existing map directory.
 

Constructors in org.apache.hadoop.io with parameters of type FileSystem
ArrayFile.Reader(FileSystem fs, String file, Configuration conf)
          Construct an array reader for the named file.
ArrayFile.Writer(FileSystem fs, String file, Class valClass)
          Create the named file for values of the named class.
MapFile.Reader(FileSystem fs, String dirName, Configuration conf)
          Construct a map reader for the named map.
MapFile.Reader(FileSystem fs, String dirName, WritableComparator comparator, Configuration conf)
          Construct a map reader for the named map using the named comparator.
MapFile.Writer(FileSystem fs, String dirName, Class keyClass, Class valClass)
          Create the named map for keys of the named class.
MapFile.Writer(FileSystem fs, String dirName, Class keyClass, Class valClass, boolean compress)
          Create the named map for keys of the named class.
MapFile.Writer(FileSystem fs, String dirName, WritableComparator comparator, Class valClass)
          Create the named map using the named key comparator.
MapFile.Writer(FileSystem fs, String dirName, WritableComparator comparator, Class valClass, boolean compress)
          Create the named map using the named key comparator.
SequenceFile.Reader(FileSystem fs, Path file, Configuration conf)
          Open the named file.
SequenceFile.Reader(FileSystem fs, String file, Configuration conf)
          Deprecated. Call #Reader(FileSystem,Path,Configuration).
SequenceFile.Sorter(FileSystem fs, Class keyClass, Class valClass, Configuration conf)
          Sort and merge files containing the named classes.
SequenceFile.Sorter(FileSystem fs, WritableComparator comparator, Class valClass, Configuration conf)
          Sort and merge using an arbitrary WritableComparator.
SequenceFile.Writer(FileSystem fs, Path name, Class keyClass, Class valClass)
          Create the named file.
SequenceFile.Writer(FileSystem fs, Path name, Class keyClass, Class valClass, boolean compress)
          Create the named file.
SequenceFile.Writer(FileSystem fs, Path name, Class keyClass, Class valClass, boolean compress, Progressable progress)
          Create the named file with write-progress reporter.
SequenceFile.Writer(FileSystem fs, Path name, Class keyClass, Class valClass, Progressable progress)
          Create the named file with write-progress reporter.
SequenceFile.Writer(FileSystem fs, String name, Class keyClass, Class valClass)
          Deprecated. Call #Writer(FileSystem,Path,Class,Class).
SetFile.Reader(FileSystem fs, String dirName, Configuration conf)
          Construct a set reader for the named set.
SetFile.Reader(FileSystem fs, String dirName, WritableComparator comparator, Configuration conf)
          Construct a set reader for the named set using the named comparator.
SetFile.Writer(FileSystem fs, String dirName, Class keyClass)
          Create the named set for keys of the named class.
SetFile.Writer(FileSystem fs, String dirName, WritableComparator comparator)
          Create the named set using the named key comparator.
 

Uses of FileSystem in org.apache.hadoop.mapred
 

Methods in org.apache.hadoop.mapred that return FileSystem
 FileSystem JobClient.getFs()
          Get a filesystem handle.
 

Methods in org.apache.hadoop.mapred with parameters of type FileSystem
 boolean[] InputFormatBase.areValidInputDirectories(FileSystem fileSys, Path[] inputDirs)
           
 boolean[] InputFormat.areValidInputDirectories(FileSystem fileSys, Path[] inputDirs)
          Are the input directories valid? This method is used to test the input directories when a job is submitted so that the framework can fail early with a useful error message when the input directory does not exist.
 void OutputFormatBase.checkOutputSpecs(FileSystem fs, JobConf job)
           
 void OutputFormat.checkOutputSpecs(FileSystem fs, JobConf job)
          Check whether the output specification for a job is appropriate.
static MapFile.Reader[] MapFileOutputFormat.getReaders(FileSystem fs, File dir, Configuration conf)
          Deprecated. Call MapFileOutputFormat.getReaders(FileSystem, Path, Configuration).
static MapFile.Reader[] MapFileOutputFormat.getReaders(FileSystem fs, Path dir, Configuration conf)
          Open the output generated by this format.
 RecordReader TextInputFormat.getRecordReader(FileSystem fs, FileSplit split, JobConf job, Reporter reporter)
           
 RecordReader SequenceFileInputFormat.getRecordReader(FileSystem fs, FileSplit split, JobConf job, Reporter reporter)
           
abstract  RecordReader InputFormatBase.getRecordReader(FileSystem fs, FileSplit split, JobConf job, Reporter reporter)
           
 RecordReader InputFormat.getRecordReader(FileSystem fs, FileSplit split, JobConf job, Reporter reporter)
          Construct a RecordReader for a FileSplit.
 RecordWriter TextOutputFormat.getRecordWriter(FileSystem fs, JobConf job, String name, Progressable progress)
           
 RecordWriter SequenceFileOutputFormat.getRecordWriter(FileSystem fs, JobConf job, String name, Progressable progress)
           
abstract  RecordWriter OutputFormatBase.getRecordWriter(FileSystem fs, JobConf job, String name, Progressable progress)
           
 RecordWriter MapFileOutputFormat.getRecordWriter(FileSystem fs, JobConf job, String name, Progressable progress)
           
 RecordWriter OutputFormat.getRecordWriter(FileSystem fs, JobConf job, String name, Progressable progress)
          Construct a RecordWriter with Progressable.
 FileSplit[] InputFormatBase.getSplits(FileSystem fs, JobConf job, int numSplits)
          Splits files returned by {#listPaths(FileSystem,JobConf) when they're too big.
 FileSplit[] InputFormat.getSplits(FileSystem fs, JobConf job, int numSplits)
          Splits a set of input files.
protected  File[] InputFormatBase.listFiles(FileSystem fs, JobConf job)
          Deprecated. Call InputFormatBase.listFiles(FileSystem,JobConf) instead.
protected  Path[] SequenceFileInputFormat.listPaths(FileSystem fs, JobConf job)
           
protected  Path[] InputFormatBase.listPaths(FileSystem fs, JobConf job)
          List input directories.
 



Copyright © 2006 The Apache Software Foundation