|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use Configuration | |
---|---|
org.apache.hadoop.conf | Configuration of system parameters. |
org.apache.hadoop.contrib.failmon | |
org.apache.hadoop.fs | An abstract file system API. |
org.apache.hadoop.fs.ftp | |
org.apache.hadoop.fs.kfs | A client for the Kosmos filesystem (KFS) |
org.apache.hadoop.fs.permission | |
org.apache.hadoop.fs.s3 | A distributed, block-based implementation of FileSystem that uses Amazon S3
as a backing store. |
org.apache.hadoop.fs.s3native |
A distributed implementation of FileSystem for reading and writing files on
Amazon S3. |
org.apache.hadoop.fs.shell | |
org.apache.hadoop.http | |
org.apache.hadoop.io | Generic i/o code for use when reading and writing data to the network, to databases, and to files. |
org.apache.hadoop.io.compress | |
org.apache.hadoop.io.compress.bzip2 | |
org.apache.hadoop.io.compress.zlib | |
org.apache.hadoop.io.file.tfile | |
org.apache.hadoop.ipc | Tools to help define network clients and servers. |
org.apache.hadoop.net | Network-related classes. |
org.apache.hadoop.util | Common utilities. |
Uses of Configuration in org.apache.hadoop.conf |
---|
Methods in org.apache.hadoop.conf that return Configuration | |
---|---|
Configuration |
Configurable.getConf()
Return the configuration used by this object. |
Configuration |
Configured.getConf()
|
Methods in org.apache.hadoop.conf with parameters of type Configuration | |
---|---|
static void |
Configuration.dumpConfiguration(Configuration config,
Writer out)
Writes out all the parameters and their properties (final and resource) to the given Writer
The format of the output would be
{ "properties" : [ {key1,value1,key1.isFinal,key1.resource}, {key2,value2,
key2.isFinal,key2.resource}... |
void |
Configurable.setConf(Configuration conf)
Set the configuration to be used by this object. |
void |
Configured.setConf(Configuration conf)
|
Constructors in org.apache.hadoop.conf with parameters of type Configuration | |
---|---|
Configuration(Configuration other)
A new configuration with the same settings cloned from another. |
|
Configured(Configuration conf)
Construct a Configured. |
Uses of Configuration in org.apache.hadoop.contrib.failmon |
---|
Constructors in org.apache.hadoop.contrib.failmon with parameters of type Configuration | |
---|---|
Executor(Configuration conf)
Create an instance of the class and read the configuration file to determine the set of jobs that will be run and the maximum interval for which the thread can sleep before it wakes up to execute a monitoring job on the node. |
Uses of Configuration in org.apache.hadoop.fs |
---|
Methods in org.apache.hadoop.fs that return Configuration | |
---|---|
Configuration |
FilterFileSystem.getConf()
|
Methods in org.apache.hadoop.fs with parameters of type Configuration | |
---|---|
static boolean |
FileUtil.copy(File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy local files to a FileSystem. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path[] srcs,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
|
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
File dst,
boolean deleteSource,
Configuration conf)
Copy FileSystem files to local files. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
Copy files between FileSystems. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy files between FileSystems. |
static boolean |
FileUtil.copyMerge(FileSystem srcFS,
Path srcDir,
FileSystem dstFS,
Path dstFile,
boolean deleteSource,
Configuration conf,
String addString)
Copy all files in a directory to one output file (merge). |
static AbstractFileSystem |
AbstractFileSystem.createFileSystem(URI uri,
Configuration conf)
Create a file system instance for the specified uri using the conf. |
static FileSystem |
FileSystem.get(Configuration conf)
Returns the configured filesystem implementation. |
static FileSystem |
FileSystem.get(URI uri,
Configuration conf)
Returns the FileSystem for this URI's scheme and authority. |
static AbstractFileSystem |
AbstractFileSystem.get(URI uri,
Configuration conf)
The main factory method for creating a file system. |
static FileSystem |
FileSystem.get(URI uri,
Configuration conf,
String user)
Get a filesystem instance based on the uri, the passed configuration and the user |
static URI |
FileSystem.getDefaultUri(Configuration conf)
Get the default filesystem URI from a configuration. |
static FileContext |
FileContext.getFileContext(AbstractFileSystem defFS,
Configuration aConf)
Create a FileContext with specified FS as default using the specified config. |
static FileContext |
FileContext.getFileContext(Configuration aConf)
Create a FileContext using the passed config. |
static FileContext |
FileContext.getFileContext(URI defaultFsUri,
Configuration aConf)
Create a FileContext for specified default URI using the specified config. |
FileSystem |
Path.getFileSystem(Configuration conf)
Return the FileSystem that owns this Path. |
static LocalFileSystem |
FileSystem.getLocal(Configuration conf)
Get the local file system. |
static FileContext |
FileContext.getLocalFSFileContext(Configuration aConf)
|
static FileSystem |
FileSystem.getNamed(String name,
Configuration conf)
Deprecated. call #get(URI,Configuration) instead. |
void |
FilterFileSystem.initialize(URI name,
Configuration conf)
Called after a new FileSystem instance is constructed. |
void |
FileSystem.initialize(URI name,
Configuration conf)
Called after a new FileSystem instance is constructed. |
void |
RawLocalFileSystem.initialize(URI uri,
Configuration conf)
|
static FileSystem |
FileSystem.newInstance(Configuration conf)
Returns a unique configured filesystem implementation. |
static FileSystem |
FileSystem.newInstance(URI uri,
Configuration conf)
Returns the FileSystem for this URI's scheme and authority. |
static FileSystem |
FileSystem.newInstance(URI uri,
Configuration conf,
String user)
Returns the FileSystem for this URI's scheme and authority and the passed user. |
static LocalFileSystem |
FileSystem.newInstanceLocal(Configuration conf)
Get a unique local file system object |
void |
ChecksumFileSystem.setConf(Configuration conf)
|
static void |
FileSystem.setDefaultUri(Configuration conf,
String uri)
Set the default filesystem URI in a configuration. |
static void |
FileSystem.setDefaultUri(Configuration conf,
URI uri)
Set the default filesystem URI in a configuration. |
Constructors in org.apache.hadoop.fs with parameters of type Configuration | |
---|---|
Trash(Configuration conf)
Construct a trash can accessor. |
|
Trash(FileSystem fs,
Configuration conf)
Construct a trash can accessor for the FileSystem provided. |
Uses of Configuration in org.apache.hadoop.fs.ftp |
---|
Methods in org.apache.hadoop.fs.ftp with parameters of type Configuration | |
---|---|
void |
FTPFileSystem.initialize(URI uri,
Configuration conf)
|
Uses of Configuration in org.apache.hadoop.fs.kfs |
---|
Methods in org.apache.hadoop.fs.kfs with parameters of type Configuration | |
---|---|
void |
KosmosFileSystem.initialize(URI uri,
Configuration conf)
|
Uses of Configuration in org.apache.hadoop.fs.permission |
---|
Methods in org.apache.hadoop.fs.permission with parameters of type Configuration | |
---|---|
static FsPermission |
FsPermission.getUMask(Configuration conf)
Get the user file creation mask (umask) UMASK_LABEL config param has umask value that is either symbolic
or octal. |
static void |
FsPermission.setUMask(Configuration conf,
FsPermission umask)
Set the user file creation mask (umask) |
Uses of Configuration in org.apache.hadoop.fs.s3 |
---|
Methods in org.apache.hadoop.fs.s3 with parameters of type Configuration | |
---|---|
void |
S3FileSystem.initialize(URI uri,
Configuration conf)
|
Uses of Configuration in org.apache.hadoop.fs.s3native |
---|
Methods in org.apache.hadoop.fs.s3native with parameters of type Configuration | |
---|---|
void |
NativeS3FileSystem.initialize(URI uri,
Configuration conf)
|
Uses of Configuration in org.apache.hadoop.fs.shell |
---|
Constructors in org.apache.hadoop.fs.shell with parameters of type Configuration | |
---|---|
Command(Configuration conf)
Constructor |
|
Count(String[] cmd,
int pos,
Configuration conf)
Constructor |
Uses of Configuration in org.apache.hadoop.http |
---|
Methods in org.apache.hadoop.http with parameters of type Configuration | |
---|---|
abstract void |
FilterInitializer.initFilter(FilterContainer container,
Configuration conf)
Initialize a Filter to a FilterContainer. |
Uses of Configuration in org.apache.hadoop.io |
---|
Methods in org.apache.hadoop.io that return Configuration | |
---|---|
Configuration |
AbstractMapWritable.getConf()
|
Configuration |
ObjectWritable.getConf()
|
Configuration |
GenericWritable.getConf()
|
Configuration |
EnumSetWritable.getConf()
Return the configuration used by this object. |
Methods in org.apache.hadoop.io with parameters of type Configuration | ||
---|---|---|
static
|
WritableUtils.clone(T orig,
Configuration conf)
Make a copy of a writable object using serialization to a buffer. |
|
static void |
IOUtils.copyBytes(InputStream in,
OutputStream out,
Configuration conf)
Copies from one stream to another. |
|
static void |
IOUtils.copyBytes(InputStream in,
OutputStream out,
Configuration conf,
boolean close)
Copies from one stream to another. |
|
protected SequenceFile.Reader |
MapFile.Reader.createDataFileReader(Path dataFile,
Configuration conf,
SequenceFile.Reader.Option... options)
Override this method to specialize the type of SequenceFile.Reader returned. |
|
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
|
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
|
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
SequenceFile.Writer.Option... opts)
Create a new Writer with the given options. |
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
|
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
Progressable progress)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
|
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class<? extends Writable> keyClass,
Class<? extends Writable> valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index. |
|
static SequenceFile.CompressionType |
SequenceFile.getDefaultCompressionType(Configuration job)
Get the compression type for the reduce outputs |
|
static
|
DefaultStringifier.load(Configuration conf,
String keyName,
Class<K> itemClass)
Restores the object from the configuration. |
|
static
|
DefaultStringifier.loadArray(Configuration conf,
String keyName,
Class<K> itemClass)
Restores the array of objects from the configuration. |
|
static Class<?> |
ObjectWritable.loadClass(Configuration conf,
String className)
Find and load the class with given name className by first finding it in the specified conf. |
|
static Writable |
WritableFactories.newInstance(Class<? extends Writable> c,
Configuration conf)
Create a new instance of a class with a defined factory. |
|
protected void |
MapFile.Reader.open(Path dir,
WritableComparator comparator,
Configuration conf,
SequenceFile.Reader.Option... options)
|
|
static Object |
ObjectWritable.readObject(DataInput in,
Configuration conf)
Read a Writable , String , primitive type, or an array of
the preceding. |
|
static Object |
ObjectWritable.readObject(DataInput in,
ObjectWritable objectWritable,
Configuration conf)
Read a Writable , String , primitive type, or an array of
the preceding. |
|
void |
AbstractMapWritable.setConf(Configuration conf)
|
|
void |
ObjectWritable.setConf(Configuration conf)
|
|
void |
GenericWritable.setConf(Configuration conf)
|
|
void |
EnumSetWritable.setConf(Configuration conf)
Set the configuration to be used by this object. |
|
static void |
SequenceFile.setDefaultCompressionType(Configuration job,
SequenceFile.CompressionType val)
Set the default compression type for sequence files. |
|
static void |
MapFile.Writer.setIndexInterval(Configuration conf,
int interval)
Sets the index interval and stores it in conf |
|
static
|
DefaultStringifier.store(Configuration conf,
K item,
String keyName)
Stores the item in the configuration with the given keyName. |
|
static
|
DefaultStringifier.storeArray(Configuration conf,
K[] items,
String keyName)
Stores the array of items in the configuration with the given keyName. |
|
static void |
ObjectWritable.writeObject(DataOutput out,
Object instance,
Class declaredClass,
Configuration conf)
Write a Writable , String , primitive type, or an array of
the preceding. |
|
static void |
ObjectWritable.writeObject(DataOutput out,
Object instance,
Class declaredClass,
Configuration conf,
boolean allowCompactArrays)
Write a Writable , String , primitive type, or an array of
the preceding. |
Constructors in org.apache.hadoop.io with parameters of type Configuration | |
---|---|
ArrayFile.Reader(FileSystem fs,
String file,
Configuration conf)
Construct an array reader for the named file. |
|
ArrayFile.Writer(Configuration conf,
FileSystem fs,
String file,
Class<? extends Writable> valClass)
Create the named file for values of the named class. |
|
ArrayFile.Writer(Configuration conf,
FileSystem fs,
String file,
Class<? extends Writable> valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Create the named file for values of the named class. |
|
BloomMapFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Deprecated. |
|
BloomMapFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Deprecated. |
|
BloomMapFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf,
boolean open)
Deprecated. |
|
BloomMapFile.Reader(Path dir,
Configuration conf,
SequenceFile.Reader.Option... options)
|
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass)
Deprecated. |
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class<? extends Writable> valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Deprecated. |
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass,
SequenceFile.CompressionType compress)
Deprecated. |
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Deprecated. |
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass)
Deprecated. |
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress)
Deprecated. |
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Deprecated. |
|
BloomMapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Deprecated. |
|
BloomMapFile.Writer(Configuration conf,
Path dir,
SequenceFile.Writer.Option... options)
|
|
DefaultStringifier(Configuration conf,
Class<T> c)
|
|
MapFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Deprecated. |
|
MapFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Deprecated. |
|
MapFile.Reader(Path dir,
Configuration conf,
SequenceFile.Reader.Option... opts)
|
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass)
Deprecated. Use Writer(Configuration, Path, Option...) instead. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass,
SequenceFile.CompressionType compress)
Deprecated. Use Writer(Configuration, Path, Option...) instead. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Deprecated. Use Writer(Configuration, Path, Option...) instead. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Deprecated. Use Writer(Configuration, Path, Option...) instead. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass)
Deprecated. Use Writer(Configuration, Path, Option...) instead. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress)
Deprecated. Use Writer(Configuration, Path, Option...) instead. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Deprecated. Use Writer(Configuration, Path, Option...) instead. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Deprecated. Use Writer(Configuration, Path, Option...)} instead. |
|
MapFile.Writer(Configuration conf,
Path dirName,
SequenceFile.Writer.Option... opts)
|
|
SequenceFile.Reader(Configuration conf,
SequenceFile.Reader.Option... opts)
|
|
SequenceFile.Reader(FileSystem fs,
Path file,
Configuration conf)
Deprecated. Use Reader(Configuration, Option...) instead. |
|
SequenceFile.Reader(FSDataInputStream in,
int buffersize,
long start,
long length,
Configuration conf)
Deprecated. Use Reader(Configuration, Reader.Option...) instead. |
|
SequenceFile.Sorter(FileSystem fs,
Class<? extends WritableComparable> keyClass,
Class valClass,
Configuration conf)
Sort and merge files containing the named classes. |
|
SequenceFile.Sorter(FileSystem fs,
RawComparator comparator,
Class keyClass,
Class valClass,
Configuration conf)
Sort and merge using an arbitrary RawComparator . |
|
SequenceFile.Sorter(FileSystem fs,
RawComparator comparator,
Class keyClass,
Class valClass,
Configuration conf,
SequenceFile.Metadata metadata)
Sort and merge using an arbitrary RawComparator . |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
Progressable progress,
SequenceFile.Metadata metadata)
Deprecated. Use SequenceFile.createWriter(Configuration, Writer.Option...)
instead. |
|
SetFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Construct a set reader for the named set. |
|
SetFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Construct a set reader for the named set using the named comparator. |
|
SetFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class<? extends WritableComparable> keyClass,
SequenceFile.CompressionType compress)
Create a set naming the element class and compression type. |
|
SetFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
SequenceFile.CompressionType compress)
Create a set naming the element comparator and compression type. |
Uses of Configuration in org.apache.hadoop.io.compress |
---|
Methods in org.apache.hadoop.io.compress that return Configuration | |
---|---|
Configuration |
DefaultCodec.getConf()
|
Methods in org.apache.hadoop.io.compress with parameters of type Configuration | |
---|---|
static List<Class<? extends CompressionCodec>> |
CompressionCodecFactory.getCodecClasses(Configuration conf)
Get the list of codecs listed in the configuration |
static Compressor |
CodecPool.getCompressor(CompressionCodec codec,
Configuration conf)
Get a Compressor for the given CompressionCodec from the
pool or a new one. |
void |
Compressor.reinit(Configuration conf)
Prepare the compressor to be used in a new stream with settings defined in the given Configuration |
static void |
CompressionCodecFactory.setCodecClasses(Configuration conf,
List<Class> classes)
Sets a list of codec classes in the configuration. |
void |
DefaultCodec.setConf(Configuration conf)
|
Constructors in org.apache.hadoop.io.compress with parameters of type Configuration | |
---|---|
CompressionCodecFactory(Configuration conf)
Find the codecs specified in the config value io.compression.codecs and register them. |
Uses of Configuration in org.apache.hadoop.io.compress.bzip2 |
---|
Methods in org.apache.hadoop.io.compress.bzip2 with parameters of type Configuration | |
---|---|
void |
BZip2DummyCompressor.reinit(Configuration conf)
|
Uses of Configuration in org.apache.hadoop.io.compress.zlib |
---|
Methods in org.apache.hadoop.io.compress.zlib with parameters of type Configuration | |
---|---|
static ZlibCompressor.CompressionLevel |
ZlibFactory.getCompressionLevel(Configuration conf)
|
static ZlibCompressor.CompressionStrategy |
ZlibFactory.getCompressionStrategy(Configuration conf)
|
static Compressor |
ZlibFactory.getZlibCompressor(Configuration conf)
Return the appropriate implementation of the zlib compressor. |
static Class<? extends Compressor> |
ZlibFactory.getZlibCompressorType(Configuration conf)
Return the appropriate type of the zlib compressor. |
static Decompressor |
ZlibFactory.getZlibDecompressor(Configuration conf)
Return the appropriate implementation of the zlib decompressor. |
static Class<? extends Decompressor> |
ZlibFactory.getZlibDecompressorType(Configuration conf)
Return the appropriate type of the zlib decompressor. |
static boolean |
ZlibFactory.isNativeZlibLoaded(Configuration conf)
Check if native-zlib code is loaded & initialized correctly and can be loaded for this job. |
void |
BuiltInZlibDeflater.reinit(Configuration conf)
reinit the compressor with the given configuration. |
void |
ZlibCompressor.reinit(Configuration conf)
Prepare the compressor to be used in a new stream with settings defined in the given Configuration. |
static void |
ZlibFactory.setCompressionLevel(Configuration conf,
ZlibCompressor.CompressionLevel level)
|
static void |
ZlibFactory.setCompressionStrategy(Configuration conf,
ZlibCompressor.CompressionStrategy strategy)
|
Constructors in org.apache.hadoop.io.compress.zlib with parameters of type Configuration | |
---|---|
ZlibCompressor(Configuration conf)
Creates a new compressor, taking settings from the configuration. |
Uses of Configuration in org.apache.hadoop.io.file.tfile |
---|
Constructors in org.apache.hadoop.io.file.tfile with parameters of type Configuration | |
---|---|
TFile.Reader(FSDataInputStream fsdis,
long fileLength,
Configuration conf)
Constructor |
|
TFile.Writer(FSDataOutputStream fsdos,
int minBlockSize,
String compressName,
String comparator,
Configuration conf)
Constructor |
Uses of Configuration in org.apache.hadoop.ipc |
---|
Methods in org.apache.hadoop.ipc with parameters of type Configuration | |
---|---|
static Object[] |
RPC.call(Method method,
Object[][] params,
InetSocketAddress[] addrs,
Configuration conf)
Deprecated. Use RPC.call(Method, Object[][], InetSocketAddress[], UserGroupInformation, Configuration) instead |
Object[] |
RpcEngine.call(Method method,
Object[][] params,
InetSocketAddress[] addrs,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf)
Expert: Make multiple, parallel calls to a set of servers. |
Object[] |
WritableRpcEngine.call(Method method,
Object[][] params,
InetSocketAddress[] addrs,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf)
Expert: Make multiple, parallel calls to a set of servers. |
static Object[] |
RPC.call(Method method,
Object[][] params,
InetSocketAddress[] addrs,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf)
Expert: Make multiple, parallel calls to a set of servers. |
Object[] |
AvroRpcEngine.call(Method method,
Object[][] params,
InetSocketAddress[] addrs,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf)
|
Writable[] |
Client.call(Writable[] params,
InetSocketAddress[] addresses,
Class<?> protocol,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf)
Makes a set of calls in parallel. |
Writable |
Client.call(Writable param,
InetSocketAddress addr,
Class<?> protocol,
org.apache.hadoop.security.UserGroupInformation ticket,
int rpcTimeout,
Configuration conf)
Make a call, passing param , to the IPC server running at
address which is servicing the protocol protocol,
with the ticket credentials, rpcTimeout as
timeout and conf as conf for this connection, returning the
value. |
static Object |
RPC.getProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
Construct a client-side proxy object with the default SocketFactory |
static Object |
RPC.getProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
SocketFactory factory)
Construct a client-side proxy object that implements the named protocol, talking to a server at the named address. |
static Object |
RPC.getProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf,
SocketFactory factory)
Construct a client-side proxy object that implements the named protocol, talking to a server at the named address. |
Object |
RpcEngine.getProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf,
SocketFactory factory,
int rpcTimeout)
Construct a client-side proxy object. |
Object |
WritableRpcEngine.getProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf,
SocketFactory factory,
int rpcTimeout)
Construct a client-side proxy object that implements the named protocol, talking to a server at the named address. |
static Object |
RPC.getProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf,
SocketFactory factory,
int rpcTimeout)
Construct a client-side proxy that implements the named protocol, talking to a server at the named address. |
Object |
AvroRpcEngine.getProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
org.apache.hadoop.security.UserGroupInformation ticket,
Configuration conf,
SocketFactory factory,
int rpcTimeout)
Construct a client-side proxy object that implements the named protocol, talking to a server at the named address. |
RPC.Server |
RpcEngine.getServer(Class<?> protocol,
Object instance,
String bindAddress,
int port,
int numHandlers,
boolean verbose,
Configuration conf,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager)
Construct a server for a protocol implementation instance. |
WritableRpcEngine.Server |
WritableRpcEngine.getServer(Class<?> protocol,
Object instance,
String bindAddress,
int port,
int numHandlers,
boolean verbose,
Configuration conf,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager)
Construct a server for a protocol implementation instance listening on a port and address. |
static RPC.Server |
RPC.getServer(Class<?> protocol,
Object instance,
String bindAddress,
int port,
int numHandlers,
boolean verbose,
Configuration conf,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager)
Construct a server for a protocol implementation instance. |
RPC.Server |
AvroRpcEngine.getServer(Class<?> iface,
Object impl,
String bindAddress,
int port,
int numHandlers,
boolean verbose,
Configuration conf,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager)
Construct a server for a protocol implementation instance listening on a port and address. |
static RPC.Server |
RPC.getServer(Class protocol,
Object instance,
String bindAddress,
int port,
Configuration conf)
Construct a server for a protocol implementation instance. |
static RPC.Server |
RPC.getServer(Class protocol,
Object instance,
String bindAddress,
int port,
int numHandlers,
boolean verbose,
Configuration conf)
Deprecated. secretManager should be passed. |
static RPC.Server |
RPC.getServer(Object instance,
String bindAddress,
int port,
Configuration conf)
Deprecated. protocol interface should be passed. |
static RPC.Server |
RPC.getServer(Object instance,
String bindAddress,
int port,
int numHandlers,
boolean verbose,
Configuration conf)
Deprecated. protocol interface should be passed. |
static int |
Client.getTimeout(Configuration conf)
The time after which a RPC will timeout. |
void |
Server.refreshServiceAcl(Configuration conf,
org.apache.hadoop.security.authorize.PolicyProvider provider)
Refresh the service authorization ACL for the service handled by this server. |
static void |
Client.setPingInterval(Configuration conf,
int pingInterval)
set the ping interval value in configuration |
static void |
RPC.setProtocolEngine(Configuration conf,
Class protocol,
Class engine)
Set a protocol to use a non-default RpcEngine. |
static Object |
RPC.waitForProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
|
static Object |
RPC.waitForProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
int rpcTimeout,
long timeout)
Get a proxy connection to a remote server |
static Object |
RPC.waitForProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
long connTimeout)
Get a proxy connection to a remote server |
Constructors in org.apache.hadoop.ipc with parameters of type Configuration | |
---|---|
Client(Class<? extends Writable> valueClass,
Configuration conf)
Construct an IPC client with the default SocketFactory |
|
Client(Class<? extends Writable> valueClass,
Configuration conf,
SocketFactory factory)
Construct an IPC client whose values are of the given Writable
class. |
|
RPC.Server(String bindAddress,
int port,
Class<? extends Writable> paramClass,
int handlerCount,
Configuration conf,
String serverName,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager)
|
|
Server(String bindAddress,
int port,
Class<? extends Writable> paramClass,
int handlerCount,
Configuration conf)
|
|
Server(String bindAddress,
int port,
Class<? extends Writable> paramClass,
int handlerCount,
Configuration conf,
String serverName,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager)
Constructs a server listening on the named port and address. |
|
WritableRpcEngine.Server(Object instance,
Configuration conf,
String bindAddress,
int port)
Construct an RPC server. |
|
WritableRpcEngine.Server(Object instance,
Configuration conf,
String bindAddress,
int port,
int numHandlers,
boolean verbose,
org.apache.hadoop.security.token.SecretManager<? extends org.apache.hadoop.security.token.TokenIdentifier> secretManager)
Construct an RPC server. |
Uses of Configuration in org.apache.hadoop.net |
---|
Methods in org.apache.hadoop.net that return Configuration | |
---|---|
Configuration |
SocksSocketFactory.getConf()
|
Configuration |
ScriptBasedMapping.getConf()
|
Methods in org.apache.hadoop.net with parameters of type Configuration | |
---|---|
void |
SocksSocketFactory.setConf(Configuration conf)
|
void |
ScriptBasedMapping.setConf(Configuration conf)
|
Constructors in org.apache.hadoop.net with parameters of type Configuration | |
---|---|
ScriptBasedMapping(Configuration conf)
|
Uses of Configuration in org.apache.hadoop.util |
---|
Methods in org.apache.hadoop.util with parameters of type Configuration | ||
---|---|---|
static
|
ReflectionUtils.copy(Configuration conf,
T src,
T dst)
Make a copy of the writable object using serialization to a buffer |
|
static
|
ReflectionUtils.newInstance(Class<T> theClass,
Configuration conf)
Create an object for the given class and initialize it from conf |
|
static int |
ToolRunner.run(Configuration conf,
Tool tool,
String[] args)
Runs the given Tool by Tool.run(String[]) , after
parsing with the given generic arguments. |
|
static void |
ReflectionUtils.setConf(Object theObject,
Configuration conf)
Check and set 'configuration' if necessary. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |