|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use Configuration | |
---|---|
org.apache.hadoop.conf | Configuration of system parameters. |
org.apache.hadoop.dfs | A distributed implementation of FileSystem . |
org.apache.hadoop.fs | An abstract file system API. |
org.apache.hadoop.io | Generic i/o code for use when reading and writing data to the network, to databases, and to files. |
org.apache.hadoop.io.compress | |
org.apache.hadoop.ipc | Tools to help define network clients and servers. |
org.apache.hadoop.mapred | A system for scalable, fault-tolerant, distributed computation over large data collections. |
org.apache.hadoop.tools | |
org.apache.hadoop.util | Common utilities. |
Uses of Configuration in org.apache.hadoop.conf |
---|
Methods in org.apache.hadoop.conf that return Configuration | |
---|---|
Configuration |
Configured.getConf()
|
Configuration |
Configurable.getConf()
Return the configuration used by this object. |
Methods in org.apache.hadoop.conf with parameters of type Configuration | |
---|---|
void |
Configured.setConf(Configuration conf)
|
void |
Configurable.setConf(Configuration conf)
Set the configuration to be used by this object. |
Constructors in org.apache.hadoop.conf with parameters of type Configuration | |
---|---|
Configuration(Configuration other)
A new configuration with the same settings cloned from another. |
|
Configured(Configuration conf)
Construct a Configured. |
Uses of Configuration in org.apache.hadoop.dfs |
---|
Methods in org.apache.hadoop.dfs with parameters of type Configuration | |
---|---|
void |
DFSShell.copy(String srcf,
String dstf,
Configuration conf)
Copy an DFS file |
static void |
NameNode.format(Configuration conf)
Format a new filesystem. |
static void |
DataNode.run(Configuration conf)
Start datanode daemon. |
Constructors in org.apache.hadoop.dfs with parameters of type Configuration | |
---|---|
DFSck(Configuration conf,
int fixing,
boolean showFiles,
boolean showBlocks,
boolean showLocations)
Filesystem checker. |
|
DistributedFileSystem(InetSocketAddress namenode,
Configuration conf)
Construct a client for the filesystem at namenode . |
|
NameNode(Configuration conf)
Create a NameNode at the default location |
|
NameNode(File dir,
int port,
Configuration conf)
Create a NameNode at the specified location and start it. |
Uses of Configuration in org.apache.hadoop.fs |
---|
Methods in org.apache.hadoop.fs with parameters of type Configuration | |
---|---|
static boolean |
FileUtil.copy(File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy local files to a FileSystem. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
File dst,
boolean deleteSource,
Configuration conf)
Copy FileSystem files to local files. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy files between FileSystems. |
static boolean |
FileUtil.copyMerge(FileSystem srcFS,
Path srcDir,
FileSystem dstFS,
Path dstFile,
boolean deleteSource,
Configuration conf,
String addString)
Copy all files in a directory to one output file (merge). |
static boolean |
FileUtil.fullyDelete(File dir,
Configuration conf)
Deprecated. Call FileUtil.fullyDelete(File) . |
static FileSystem |
FileSystem.get(Configuration conf)
Returns the configured filesystem implementation. |
static FileSystem |
FileSystem.getNamed(String name,
Configuration conf)
Returns a named filesystem. |
static FileSystem |
FileSystem.parseArgs(String[] argv,
int i,
Configuration conf)
Parse the cmd-line args, starting at i. |
Constructors in org.apache.hadoop.fs with parameters of type Configuration | |
---|---|
DF(File path,
Configuration conf)
|
|
DF(String path,
Configuration conf)
Deprecated. |
|
FileSystem(Configuration conf)
|
|
FSDataInputStream(FileSystem fs,
Path file,
Configuration conf)
|
|
FSDataInputStream(FileSystem fs,
Path file,
int bufferSize,
Configuration conf)
|
|
FSDataInputStream(FSInputStream in,
Configuration conf)
Construct without checksums. |
|
FSDataOutputStream(FileSystem fs,
Path file,
boolean overwrite,
Configuration conf,
int bufferSize,
short replication,
long blockSize)
|
|
FSDataOutputStream(FileSystem fs,
Path file,
boolean overwrite,
Configuration conf,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
|
|
LocalFileSystem(Configuration conf)
Construct a local filesystem client. |
Uses of Configuration in org.apache.hadoop.io |
---|
Methods in org.apache.hadoop.io that return Configuration | |
---|---|
Configuration |
ObjectWritable.getConf()
|
Methods in org.apache.hadoop.io with parameters of type Configuration | |
---|---|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
Progressable progress)
Construct the preferred type of SequenceFile Writer. |
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class keyClass,
Class valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index. |
static Class |
WritableName.getClass(String name,
Configuration conf)
Return the class for a name. |
static SequenceFile.CompressionType |
SequenceFile.getCompressionType(Configuration job)
Get the compression type for the reduce outputs |
static Writable |
WritableFactories.newInstance(Class c,
Configuration conf)
Create a new instance of a class with a defined factory. |
static Object |
ObjectWritable.readObject(DataInput in,
Configuration conf)
Read a Writable , String , primitive type, or an array of
the preceding. |
static Object |
ObjectWritable.readObject(DataInput in,
ObjectWritable objectWritable,
Configuration conf)
Read a Writable , String , primitive type, or an array of
the preceding. |
static void |
SequenceFile.setCompressionType(Configuration job,
SequenceFile.CompressionType val)
Set the compression type for sequence files. |
void |
ObjectWritable.setConf(Configuration conf)
|
static void |
ObjectWritable.writeObject(DataOutput out,
Object instance,
Class declaredClass,
Configuration conf)
Write a Writable , String , primitive type, or an array of
the preceding. |
Constructors in org.apache.hadoop.io with parameters of type Configuration | |
---|---|
ArrayFile.Reader(FileSystem fs,
String file,
Configuration conf)
Construct an array reader for the named file. |
|
MapFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Construct a map reader for the named map. |
|
MapFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Construct a map reader for the named map using the named comparator. |
|
SequenceFile.Reader(FileSystem fs,
Path file,
Configuration conf)
Open the named file. |
|
SequenceFile.Reader(FileSystem fs,
String file,
Configuration conf)
Deprecated. Call SequenceFile.Reader.SequenceFile.Reader(FileSystem,Path,Configuration) . |
|
SequenceFile.Sorter(FileSystem fs,
Class keyClass,
Class valClass,
Configuration conf)
Sort and merge files containing the named classes. |
|
SequenceFile.Sorter(FileSystem fs,
WritableComparator comparator,
Class valClass,
Configuration conf)
Sort and merge using an arbitrary WritableComparator . |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Create the named file. |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
Progressable progress)
Create the named file with write-progress reporter. |
|
SetFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Construct a set reader for the named set. |
|
SetFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Construct a set reader for the named set using the named comparator. |
Uses of Configuration in org.apache.hadoop.io.compress |
---|
Methods in org.apache.hadoop.io.compress with parameters of type Configuration | |
---|---|
static List<Class> |
CompressionCodecFactory.getCodecClasses(Configuration conf)
Get the list of codecs listed in the configuration |
static void |
CompressionCodecFactory.setCodecClasses(Configuration conf,
List<Class> classes)
Sets a list of codec classes in the configuration. |
Constructors in org.apache.hadoop.io.compress with parameters of type Configuration | |
---|---|
CompressionCodecFactory(Configuration conf)
Find the codecs specified in the config value io.compression.codecs and register them. |
Uses of Configuration in org.apache.hadoop.ipc |
---|
Methods in org.apache.hadoop.ipc with parameters of type Configuration | |
---|---|
static Object[] |
RPC.call(Method method,
Object[][] params,
InetSocketAddress[] addrs,
Configuration conf)
Expert: Make multiple, parallel calls to a set of servers. |
static VersionedProtocol |
RPC.getProxy(Class protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
Construct a client-side proxy object that implements the named protocol, talking to a server at the named address. |
static RPC.Server |
RPC.getServer(Object instance,
int port,
Configuration conf)
Construct a server for a protocol implementation instance listening on a port. |
static RPC.Server |
RPC.getServer(Object instance,
int port,
int numHandlers,
boolean verbose,
Configuration conf)
Construct a server for a protocol implementation instance listening on a port. |
static VersionedProtocol |
RPC.waitForProxy(Class protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
|
Constructors in org.apache.hadoop.ipc with parameters of type Configuration | |
---|---|
Client(Class valueClass,
Configuration conf)
Construct an IPC client whose values are of the given Writable
class. |
|
RPC.Server(Object instance,
Configuration conf,
int port)
Construct an RPC server. |
|
RPC.Server(Object instance,
Configuration conf,
int port,
int numHandlers,
boolean verbose)
Construct an RPC server. |
|
Server(int port,
Class paramClass,
int handlerCount,
Configuration conf)
Constructs a server listening on the named port. |
Uses of Configuration in org.apache.hadoop.mapred |
---|
Subclasses of Configuration in org.apache.hadoop.mapred | |
---|---|
class |
JobConf
A map/reduce job configuration. |
Methods in org.apache.hadoop.mapred that return Configuration | |
---|---|
Configuration |
SequenceFileInputFilter.FilterBase.getConf()
|
Methods in org.apache.hadoop.mapred with parameters of type Configuration | |
---|---|
static InetSocketAddress |
JobTracker.getAddress(Configuration conf)
|
static SequenceFile.Reader[] |
SequenceFileOutputFormat.getReaders(Configuration conf,
File dir)
Deprecated. Call SequenceFileOutputFormat.getReaders(Configuration, Path) instead. |
static SequenceFile.Reader[] |
SequenceFileOutputFormat.getReaders(Configuration conf,
Path dir)
Open the output generated by this format. |
static MapFile.Reader[] |
MapFileOutputFormat.getReaders(FileSystem fs,
File dir,
Configuration conf)
Deprecated. Call MapFileOutputFormat.getReaders(FileSystem, Path, Configuration) . |
static MapFile.Reader[] |
MapFileOutputFormat.getReaders(FileSystem fs,
Path dir,
Configuration conf)
Open the output generated by this format. |
void |
SequenceFileInputFilter.RegexFilter.setConf(Configuration conf)
configure the Filter by checking the configuration |
void |
SequenceFileInputFilter.PercentFilter.setConf(Configuration conf)
configure the filter by checking the configuration |
void |
SequenceFileInputFilter.MD5Filter.setConf(Configuration conf)
configure the filter according to configuration |
static void |
SequenceFileInputFilter.setFilterClass(Configuration conf,
Class filterClass)
set the filter class |
static void |
SequenceFileInputFilter.PercentFilter.setFrequency(Configuration conf,
int frequency)
set the frequency and stores it in conf |
static void |
SequenceFileInputFilter.MD5Filter.setFrequency(Configuration conf,
int frequency)
set the filtering frequency in configuration |
static void |
SequenceFileInputFilter.RegexFilter.setPattern(Configuration conf,
String regex)
Define the filtering regex and stores it in conf |
static void |
JobTracker.startTracker(Configuration conf)
|
Constructors in org.apache.hadoop.mapred with parameters of type Configuration | |
---|---|
JobClient(Configuration conf)
|
|
JobClient(InetSocketAddress jobTrackAddr,
Configuration conf)
Build a job client, connect to the indicated job tracker. |
|
JobConf(Configuration conf)
Construct a map/reduce job configuration. |
|
JobConf(Configuration conf,
Class exampleClass)
Construct a map/reduce job configuration. |
|
SequenceFileRecordReader(Configuration conf,
FileSplit split)
|
Uses of Configuration in org.apache.hadoop.tools |
---|
Methods in org.apache.hadoop.tools that return Configuration | |
---|---|
Configuration |
Logalyzer.LogComparator.getConf()
|
Methods in org.apache.hadoop.tools with parameters of type Configuration | |
---|---|
void |
Logalyzer.LogComparator.setConf(Configuration conf)
|
Uses of Configuration in org.apache.hadoop.util |
---|
Fields in org.apache.hadoop.util declared as Configuration | |
---|---|
Configuration |
ToolBase.conf
|
Methods in org.apache.hadoop.util that return Configuration | |
---|---|
Configuration |
ToolBase.getConf()
|
Methods in org.apache.hadoop.util with parameters of type Configuration | |
---|---|
abstract void |
CopyFiles.CopyFilesMapper.cleanup(Configuration conf,
JobConf jobConf,
String srcPath,
String destPath)
Interface to cleanup *distcp* specific resources |
void |
CopyFiles.DFSCopyFilesMapper.cleanup(Configuration conf,
JobConf jobConf,
String srcPath,
String destPath)
|
void |
CopyFiles.HTTPCopyFilesMapper.cleanup(Configuration conf,
JobConf jobConf,
String srcPath,
String destPath)
|
static void |
CopyFiles.copy(Configuration conf,
String srcPath,
String destPath,
boolean srcAsList,
boolean ignoreReadFailures)
Driver to copy srcPath to destPath depending on required protocol. |
int |
ToolBase.doMain(Configuration conf,
String[] args)
Work as a main program: execute a command and handle exception if any |
static String |
LogFormatter.initFileHandler(Configuration conf,
String opName)
Deprecated. |
static Object |
ReflectionUtils.newInstance(Class theClass,
Configuration conf)
Create an object for the given class and initialize it from conf |
void |
CopyFiles.setConf(Configuration conf)
|
void |
ToolBase.setConf(Configuration conf)
|
abstract void |
CopyFiles.CopyFilesMapper.setup(Configuration conf,
JobConf jobConf,
String[] srcPaths,
String destPath,
boolean ignoreReadFailures)
Interface to initialize *distcp* specific map tasks. |
void |
CopyFiles.DFSCopyFilesMapper.setup(Configuration conf,
JobConf jobConf,
String[] srcPaths,
String destPath,
boolean ignoreReadFailures)
Initialize DFSCopyFileMapper specific job-configuration. |
void |
CopyFiles.HTTPCopyFilesMapper.setup(Configuration conf,
JobConf jobConf,
String[] srcPaths,
String destPath,
boolean ignoreReadFailures)
Initialize HTTPCopyFileMapper specific job. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |