|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use FileSystem | |
---|---|
org.apache.hadoop.dfs | A distributed implementation of FileSystem . |
org.apache.hadoop.fs | An abstract file system API. |
org.apache.hadoop.io | Generic i/o code for use when reading and writing data to the network, to databases, and to files. |
org.apache.hadoop.mapred | A system for scalable, fault-tolerant, distributed computation over large data collections. |
Uses of FileSystem in org.apache.hadoop.dfs |
---|
Subclasses of FileSystem in org.apache.hadoop.dfs | |
---|---|
class |
DistributedFileSystem
Implementation of the abstract FileSystem for the DFS system. |
Constructors in org.apache.hadoop.dfs with parameters of type FileSystem | |
---|---|
DFSShell(FileSystem fs)
|
Uses of FileSystem in org.apache.hadoop.fs |
---|
Subclasses of FileSystem in org.apache.hadoop.fs | |
---|---|
class |
LocalFileSystem
Implement the FileSystem API for the native filesystem. |
Methods in org.apache.hadoop.fs that return FileSystem | |
---|---|
static FileSystem |
FileSystem.get(Configuration conf)
Returns the configured filesystem implementation. |
static FileSystem |
FileSystem.getNamed(String name,
Configuration conf)
Returns a named filesystem. |
static FileSystem |
FileSystem.parseArgs(String[] argv,
int i,
Configuration conf)
Parse the cmd-line args, starting at i. |
Methods in org.apache.hadoop.fs with parameters of type FileSystem | |
---|---|
static boolean |
FileUtil.copy(File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy local files to a FileSystem. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
File dst,
boolean deleteSource,
Configuration conf)
Copy FileSystem files to local files. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy files between FileSystems. |
Constructors in org.apache.hadoop.fs with parameters of type FileSystem | |
---|---|
FSDataInputStream(FileSystem fs,
Path file,
Configuration conf)
|
|
FSDataInputStream(FileSystem fs,
Path file,
int bufferSize,
Configuration conf)
|
|
FSDataOutputStream(FileSystem fs,
Path file,
boolean overwrite,
Configuration conf,
int bufferSize,
short replication,
long blockSize)
|
Uses of FileSystem in org.apache.hadoop.io |
---|
Methods in org.apache.hadoop.io with parameters of type FileSystem | |
---|---|
static void |
MapFile.delete(FileSystem fs,
String name)
Deletes the named map file. |
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class keyClass,
Class valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index. |
static void |
MapFile.rename(FileSystem fs,
String oldName,
String newName)
Renames an existing map directory. |
Constructors in org.apache.hadoop.io with parameters of type FileSystem | |
---|---|
ArrayFile.Reader(FileSystem fs,
String file,
Configuration conf)
Construct an array reader for the named file. |
|
ArrayFile.Writer(FileSystem fs,
String file,
Class valClass)
Create the named file for values of the named class. |
|
MapFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Construct a map reader for the named map. |
|
MapFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Construct a map reader for the named map using the named comparator. |
|
MapFile.Writer(FileSystem fs,
String dirName,
Class keyClass,
Class valClass)
Create the named map for keys of the named class. |
|
MapFile.Writer(FileSystem fs,
String dirName,
Class keyClass,
Class valClass,
boolean compress)
Create the named map for keys of the named class. |
|
MapFile.Writer(FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass)
Create the named map using the named key comparator. |
|
MapFile.Writer(FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
boolean compress)
Create the named map using the named key comparator. |
|
SequenceFile.Reader(FileSystem fs,
Path file,
Configuration conf)
Open the named file. |
|
SequenceFile.Reader(FileSystem fs,
String file,
Configuration conf)
Deprecated. Call #Reader(FileSystem,Path,Configuration) . |
|
SequenceFile.Sorter(FileSystem fs,
Class keyClass,
Class valClass,
Configuration conf)
Sort and merge files containing the named classes. |
|
SequenceFile.Sorter(FileSystem fs,
WritableComparator comparator,
Class valClass,
Configuration conf)
Sort and merge using an arbitrary WritableComparator . |
|
SequenceFile.Writer(FileSystem fs,
Path name,
Class keyClass,
Class valClass)
Create the named file. |
|
SequenceFile.Writer(FileSystem fs,
Path name,
Class keyClass,
Class valClass,
boolean compress)
Create the named file. |
|
SequenceFile.Writer(FileSystem fs,
String name,
Class keyClass,
Class valClass)
Deprecated. Call #Writer(FileSystem,Path,Class,Class) . |
|
SetFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Construct a set reader for the named set. |
|
SetFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Construct a set reader for the named set using the named comparator. |
|
SetFile.Writer(FileSystem fs,
String dirName,
Class keyClass)
Create the named set for keys of the named class. |
|
SetFile.Writer(FileSystem fs,
String dirName,
WritableComparator comparator)
Create the named set using the named key comparator. |
Uses of FileSystem in org.apache.hadoop.mapred |
---|
Methods in org.apache.hadoop.mapred that return FileSystem | |
---|---|
FileSystem |
JobClient.getFs()
Get a filesystem handle. |
Methods in org.apache.hadoop.mapred with parameters of type FileSystem | |
---|---|
void |
OutputFormatBase.checkOutputSpecs(FileSystem fs,
JobConf job)
|
void |
OutputFormat.checkOutputSpecs(FileSystem fs,
JobConf job)
Check whether the output specification for a job is appropriate. |
static MapFile.Reader[] |
MapFileOutputFormat.getReaders(FileSystem fs,
File dir,
Configuration conf)
Deprecated. Call MapFileOutputFormat.getReaders(FileSystem, Path, Configuration) . |
static MapFile.Reader[] |
MapFileOutputFormat.getReaders(FileSystem fs,
Path dir,
Configuration conf)
Open the output generated by this format. |
RecordReader |
TextInputFormat.getRecordReader(FileSystem fs,
FileSplit split,
JobConf job,
Reporter reporter)
|
RecordReader |
SequenceFileInputFormat.getRecordReader(FileSystem fs,
FileSplit split,
JobConf job,
Reporter reporter)
|
abstract RecordReader |
InputFormatBase.getRecordReader(FileSystem fs,
FileSplit split,
JobConf job,
Reporter reporter)
|
RecordReader |
InputFormat.getRecordReader(FileSystem fs,
FileSplit split,
JobConf job,
Reporter reporter)
Construct a RecordReader for a FileSplit . |
RecordWriter |
TextOutputFormat.getRecordWriter(FileSystem fs,
JobConf job,
String name)
|
RecordWriter |
SequenceFileOutputFormat.getRecordWriter(FileSystem fs,
JobConf job,
String name)
|
abstract RecordWriter |
OutputFormatBase.getRecordWriter(FileSystem fs,
JobConf job,
String name)
|
RecordWriter |
MapFileOutputFormat.getRecordWriter(FileSystem fs,
JobConf job,
String name)
|
RecordWriter |
OutputFormat.getRecordWriter(FileSystem fs,
JobConf job,
String name)
Construct a RecordWriter . |
FileSplit[] |
InputFormatBase.getSplits(FileSystem fs,
JobConf job,
int numSplits)
Splits files returned by {#listPaths(FileSystem,JobConf) when they're too big. |
FileSplit[] |
InputFormat.getSplits(FileSystem fs,
JobConf job,
int numSplits)
Splits a set of input files. |
protected File[] |
InputFormatBase.listFiles(FileSystem fs,
JobConf job)
Deprecated. Call InputFormatBase.listFiles(FileSystem,JobConf) instead. |
protected Path[] |
SequenceFileInputFormat.listPaths(FileSystem fs,
JobConf job)
|
protected Path[] |
InputFormatBase.listPaths(FileSystem fs,
JobConf job)
List input directories. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |