|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use Configuration | |
---|---|
org.apache.hadoop.conf | Configuration of system parameters. |
org.apache.hadoop.dfs | A distributed implementation of FileSystem . |
org.apache.hadoop.dfs.datanode.metrics | |
org.apache.hadoop.filecache | |
org.apache.hadoop.fs | An abstract file system API. |
org.apache.hadoop.fs.kfs | A client for the Kosmos filesystem (KFS) |
org.apache.hadoop.fs.permission | |
org.apache.hadoop.fs.s3 | A distributed implementation of FileSystem that uses Amazon S3. |
org.apache.hadoop.hbase | Provides Hbase, the Hadoop simple database. |
org.apache.hadoop.hbase.hql | |
org.apache.hadoop.hbase.io | |
org.apache.hadoop.hbase.ipc | |
org.apache.hadoop.hbase.mapred | |
org.apache.hadoop.io | Generic i/o code for use when reading and writing data to the network, to databases, and to files. |
org.apache.hadoop.io.compress | |
org.apache.hadoop.io.compress.zlib | |
org.apache.hadoop.ipc | Tools to help define network clients and servers. |
org.apache.hadoop.mapred | A software framework for easily writing applications which process vast amounts of data (multi-terabyte data-sets) parallelly on large clusters (thousands of nodes) built of commodity hardware in a reliable, fault-tolerant manner. |
org.apache.hadoop.mapred.join | Given a set of sorted datasets keyed with the same class and yielding equal partitions, it is possible to effect a join of those datasets prior to the map. |
org.apache.hadoop.net | Network-related classes. |
org.apache.hadoop.security | |
org.apache.hadoop.streaming | Hadoop Streaming is a utility which allows users to create and run Map-Reduce jobs with any executables (e.g. |
org.apache.hadoop.tools | |
org.apache.hadoop.util | Common utilities. |
Uses of Configuration in org.apache.hadoop.conf |
---|
Methods in org.apache.hadoop.conf that return Configuration | |
---|---|
Configuration |
Configured.getConf()
|
Configuration |
Configurable.getConf()
Return the configuration used by this object. |
Methods in org.apache.hadoop.conf with parameters of type Configuration | |
---|---|
void |
Configured.setConf(Configuration conf)
|
void |
Configurable.setConf(Configuration conf)
Set the configuration to be used by this object. |
Constructors in org.apache.hadoop.conf with parameters of type Configuration | |
---|---|
Configuration(Configuration other)
A new configuration with the same settings cloned from another. |
|
Configured(Configuration conf)
Construct a Configured. |
Uses of Configuration in org.apache.hadoop.dfs |
---|
Fields in org.apache.hadoop.dfs declared as Configuration | |
---|---|
static Configuration |
JspHelper.conf
|
Methods in org.apache.hadoop.dfs that return Configuration | |
---|---|
Configuration |
Balancer.getConf()
return this balancer's configuration |
Methods in org.apache.hadoop.dfs with parameters of type Configuration | |
---|---|
static void |
NameNode.format(Configuration conf)
Format a new filesystem. |
void |
HftpFileSystem.initialize(URI name,
Configuration conf)
|
void |
DistributedFileSystem.initialize(URI uri,
Configuration conf)
|
static DataNode |
DataNode.run(Configuration conf)
Start datanode daemon. |
void |
Balancer.setConf(Configuration conf)
set this balancer's configuration |
Constructors in org.apache.hadoop.dfs with parameters of type Configuration | |
---|---|
ChecksumDistributedFileSystem(InetSocketAddress namenode,
Configuration conf)
Deprecated. |
|
DFSAdmin(Configuration conf)
Construct a DFSAdmin object. |
|
DFSck(Configuration conf)
Filesystem checker. |
|
DistributedFileSystem(InetSocketAddress namenode,
Configuration conf)
Deprecated. |
|
NameNode(Configuration conf)
Start NameNode. |
|
NameNode(String bindAddress,
Configuration conf)
Create a NameNode at the specified location and start it. |
|
NamenodeFsck(Configuration conf,
NameNode nn,
Map<String,String[]> pmap,
javax.servlet.http.HttpServletResponse response)
Filesystem checker. |
|
SecondaryNameNode(Configuration conf)
Create a connection to the primary namenode. |
Uses of Configuration in org.apache.hadoop.dfs.datanode.metrics |
---|
Constructors in org.apache.hadoop.dfs.datanode.metrics with parameters of type Configuration | |
---|---|
DataNodeMetrics(Configuration conf,
String storageId)
|
Uses of Configuration in org.apache.hadoop.filecache |
---|
Methods in org.apache.hadoop.filecache with parameters of type Configuration | |
---|---|
static void |
DistributedCache.addArchiveToClassPath(Path archive,
Configuration conf)
Add an archive path to the current set of classpath entries. |
static void |
DistributedCache.addCacheArchive(URI uri,
Configuration conf)
Add a archives to be localized to the conf |
static void |
DistributedCache.addCacheFile(URI uri,
Configuration conf)
Add a file to be localized to the conf |
static void |
DistributedCache.addFileToClassPath(Path file,
Configuration conf)
Add an file path to the current set of classpath entries It adds the file to cache as well. |
static void |
DistributedCache.createAllSymlink(Configuration conf,
File jobCacheDir,
File workDir)
This method create symlinks for all files in a given dir in another directory |
static void |
DistributedCache.createSymlink(Configuration conf)
This method allows you to create symlinks in the current working directory of the task to all the cache files/archives |
static Path[] |
DistributedCache.getArchiveClassPaths(Configuration conf)
Get the archive entries in classpath as an array of Path |
static String[] |
DistributedCache.getArchiveTimestamps(Configuration conf)
Get the timestamps of the archives |
static URI[] |
DistributedCache.getCacheArchives(Configuration conf)
Get cache archives set in the Configuration |
static URI[] |
DistributedCache.getCacheFiles(Configuration conf)
Get cache files set in the Configuration |
static Path[] |
DistributedCache.getFileClassPaths(Configuration conf)
Get the file entries in classpath as an array of Path |
static String[] |
DistributedCache.getFileTimestamps(Configuration conf)
Get the timestamps of the files |
static Path |
DistributedCache.getLocalCache(URI cache,
Configuration conf,
Path baseDir,
boolean isArchive,
long confFileStamp,
Path currentWorkDir)
Get the locally cached file or archive; it could either be previously cached (and valid) or copy it from the FileSystem now. |
static Path |
DistributedCache.getLocalCache(URI cache,
Configuration conf,
Path baseDir,
FileStatus fileStatus,
boolean isArchive,
long confFileStamp,
Path currentWorkDir)
Get the locally cached file or archive; it could either be previously cached (and valid) or copy it from the FileSystem now. |
static Path[] |
DistributedCache.getLocalCacheArchives(Configuration conf)
Return the path array of the localized caches |
static Path[] |
DistributedCache.getLocalCacheFiles(Configuration conf)
Return the path array of the localized files |
static boolean |
DistributedCache.getSymlink(Configuration conf)
This method checks to see if symlinks are to be create for the localized cache files in the current working directory |
static long |
DistributedCache.getTimestamp(Configuration conf,
URI cache)
Returns mtime of a given cache file on hdfs. |
static String |
DistributedCache.makeRelative(URI cache,
Configuration conf)
|
static void |
DistributedCache.purgeCache(Configuration conf)
Clear the entire contents of the cache and delete the backing files. |
static void |
DistributedCache.releaseCache(URI cache,
Configuration conf)
This is the opposite of getlocalcache. |
static void |
DistributedCache.setArchiveTimestamps(Configuration conf,
String timestamps)
This is to check the timestamp of the archives to be localized |
static void |
DistributedCache.setCacheArchives(URI[] archives,
Configuration conf)
Set the configuration with the given set of archives |
static void |
DistributedCache.setCacheFiles(URI[] files,
Configuration conf)
Set the configuration with the given set of files |
static void |
DistributedCache.setFileTimestamps(Configuration conf,
String timestamps)
This is to check the timestamp of the files to be localized |
static void |
DistributedCache.setLocalArchives(Configuration conf,
String str)
Set the conf to contain the location for localized archives |
static void |
DistributedCache.setLocalFiles(Configuration conf,
String str)
Set the conf to contain the location for localized files |
Uses of Configuration in org.apache.hadoop.fs |
---|
Methods in org.apache.hadoop.fs that return Configuration | |
---|---|
Configuration |
FilterFileSystem.getConf()
|
Methods in org.apache.hadoop.fs with parameters of type Configuration | |
---|---|
static boolean |
FileUtil.copy(File src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy local files to a FileSystem. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
File dst,
boolean deleteSource,
Configuration conf)
Copy FileSystem files to local files. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
boolean overwrite,
Configuration conf)
Copy files between FileSystems. |
static boolean |
FileUtil.copy(FileSystem srcFS,
Path src,
FileSystem dstFS,
Path dst,
boolean deleteSource,
Configuration conf)
Copy files between FileSystems. |
static boolean |
FileUtil.copyMerge(FileSystem srcFS,
Path srcDir,
FileSystem dstFS,
Path dstFile,
boolean deleteSource,
Configuration conf,
String addString)
Copy all files in a directory to one output file (merge). |
File |
LocalDirAllocator.createTmpFileForWrite(String pathStr,
long size,
Configuration conf)
Creates a temporary file in the local FS. |
static FileSystem |
FileSystem.get(Configuration conf)
Returns the configured filesystem implementation. |
static FileSystem |
FileSystem.get(URI uri,
Configuration conf)
Returns the FileSystem for this URI's scheme and authority. |
FileSystem |
Path.getFileSystem(Configuration conf)
Return the FileSystem that owns this Path. |
static LocalFileSystem |
FileSystem.getLocal(Configuration conf)
Get the local file syste |
Path |
LocalDirAllocator.getLocalPathForWrite(String pathStr,
Configuration conf)
Get a path from the local FS. |
Path |
LocalDirAllocator.getLocalPathForWrite(String pathStr,
long size,
Configuration conf)
Get a path from the local FS. |
Path |
LocalDirAllocator.getLocalPathToRead(String pathStr,
Configuration conf)
Get a path from the local FS for reading. |
static FileSystem |
FileSystem.getNamed(String name,
Configuration conf)
Deprecated. call #get(URI,Configuration) instead. |
boolean |
LocalDirAllocator.ifExists(String pathStr,
Configuration conf)
We search through all the configured dirs for the file's existence and return true when we find |
void |
RawLocalFileSystem.initialize(URI uri,
Configuration conf)
|
void |
FilterFileSystem.initialize(URI name,
Configuration conf)
Called after a new FileSystem instance is constructed. |
abstract void |
FileSystem.initialize(URI name,
Configuration conf)
Called after a new FileSystem instance is constructed. |
static FileSystem |
FileSystem.parseArgs(String[] argv,
int i,
Configuration conf)
Parse the cmd-line args, starting at i. |
void |
ChecksumFileSystem.setConf(Configuration conf)
|
Constructors in org.apache.hadoop.fs with parameters of type Configuration | |
---|---|
DF(File path,
Configuration conf)
|
|
DU(File path,
Configuration conf)
|
|
FsShell(Configuration conf)
|
|
InMemoryFileSystem(URI uri,
Configuration conf)
|
|
Trash(Configuration conf)
Construct a trash can accessor. |
Uses of Configuration in org.apache.hadoop.fs.kfs |
---|
Methods in org.apache.hadoop.fs.kfs with parameters of type Configuration | |
---|---|
void |
KosmosFileSystem.initialize(URI uri,
Configuration conf)
|
Uses of Configuration in org.apache.hadoop.fs.permission |
---|
Methods in org.apache.hadoop.fs.permission with parameters of type Configuration | |
---|---|
static FsPermission |
FsPermission.getUMask(Configuration conf)
Get the user file creation mask (umask) |
static void |
FsPermission.setUMask(Configuration conf,
FsPermission umask)
Set the user file creation mask (umask) |
Uses of Configuration in org.apache.hadoop.fs.s3 |
---|
Methods in org.apache.hadoop.fs.s3 with parameters of type Configuration | |
---|---|
void |
S3FileSystem.initialize(URI uri,
Configuration conf)
|
void |
FileSystemStore.initialize(URI uri,
Configuration conf)
|
Uses of Configuration in org.apache.hadoop.hbase |
---|
Subclasses of Configuration in org.apache.hadoop.hbase | |
---|---|
class |
HBaseConfiguration
Adds HBase configuration files to a Configuration |
Methods in org.apache.hadoop.hbase with parameters of type Configuration | |
---|---|
static boolean |
LocalHBaseCluster.isLocal(Configuration c)
|
Constructors in org.apache.hadoop.hbase with parameters of type Configuration | |
---|---|
HBaseConfiguration(Configuration c)
Create a clone of passed configuration. |
|
HLog(FileSystem fs,
Path dir,
Configuration conf,
LogRollListener listener)
Create an edit log at the given dir location. |
Uses of Configuration in org.apache.hadoop.hbase.hql |
---|
Constructors in org.apache.hadoop.hbase.hql with parameters of type Configuration | |
---|---|
TableFormatterFactory(Writer out,
Configuration c)
|
Uses of Configuration in org.apache.hadoop.hbase.io |
---|
Methods in org.apache.hadoop.hbase.io that return Configuration | |
---|---|
Configuration |
HbaseMapWritable.getConf()
|
Configuration |
HbaseObjectWritable.getConf()
|
Methods in org.apache.hadoop.hbase.io with parameters of type Configuration | |
---|---|
static Object |
HbaseObjectWritable.readObject(DataInput in,
Configuration conf)
Read a Writable , String , primitive type, or an array of
the preceding. |
static Object |
HbaseObjectWritable.readObject(DataInput in,
HbaseObjectWritable objectWritable,
Configuration conf)
Read a Writable , String , primitive type, or an array of
the preceding. |
void |
HbaseMapWritable.setConf(Configuration conf)
|
void |
HbaseObjectWritable.setConf(Configuration conf)
|
static void |
HbaseObjectWritable.writeObject(DataOutput out,
Object instance,
Class declaredClass,
Configuration conf)
Write a Writable , String , primitive type, or an array of
the preceding. |
Uses of Configuration in org.apache.hadoop.hbase.ipc |
---|
Methods in org.apache.hadoop.hbase.ipc with parameters of type Configuration | |
---|---|
static Object[] |
HbaseRPC.call(Method method,
Object[][] params,
InetSocketAddress[] addrs,
Configuration conf)
Expert: Make multiple, parallel calls to a set of servers. |
static VersionedProtocol |
HbaseRPC.getProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
Construct a client-side proxy object with the default SocketFactory |
static VersionedProtocol |
HbaseRPC.getProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
SocketFactory factory)
Construct a client-side proxy object that implements the named protocol, talking to a server at the named address. |
static VersionedProtocol |
HbaseRPC.getProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
SocketFactory factory)
Construct a client-side proxy object that implements the named protocol, talking to a server at the named address. |
static HbaseRPC.Server |
HbaseRPC.getServer(Object instance,
String bindAddress,
int port,
Configuration conf)
Construct a server for a protocol implementation instance listening on a port and address. |
static HbaseRPC.Server |
HbaseRPC.getServer(Object instance,
String bindAddress,
int port,
int numHandlers,
boolean verbose,
Configuration conf)
Construct a server for a protocol implementation instance listening on a port and address. |
static VersionedProtocol |
HbaseRPC.waitForProxy(Class protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
|
Constructors in org.apache.hadoop.hbase.ipc with parameters of type Configuration | |
---|---|
HbaseRPC.Server(Object instance,
Configuration conf,
String bindAddress,
int port)
Construct an RPC server. |
|
HbaseRPC.Server(Object instance,
Configuration conf,
String bindAddress,
int port,
int numHandlers,
boolean verbose)
Construct an RPC server. |
Uses of Configuration in org.apache.hadoop.hbase.mapred |
---|
Subclasses of Configuration in org.apache.hadoop.hbase.mapred | |
---|---|
class |
IndexConfiguration
Configuration parameters for building a Lucene index |
Methods in org.apache.hadoop.hbase.mapred with parameters of type Configuration | |
---|---|
JobConf |
BuildTableIndex.createJob(Configuration conf,
int numMapTasks,
int numReduceTasks,
String indexDir,
String tableName,
String columnNames)
|
Uses of Configuration in org.apache.hadoop.io |
---|
Methods in org.apache.hadoop.io that return Configuration | |
---|---|
Configuration |
ObjectWritable.getConf()
|
Configuration |
GenericWritable.getConf()
|
Configuration |
AbstractMapWritable.getConf()
|
Methods in org.apache.hadoop.io with parameters of type Configuration | |
---|---|
static Writable |
WritableUtils.clone(Writable orig,
Configuration conf)
Make a copy of a writable object using serialization to a buffer. |
static void |
IOUtils.copyBytes(InputStream in,
OutputStream out,
Configuration conf)
Copies from one stream to another. |
static void |
IOUtils.copyBytes(InputStream in,
OutputStream out,
Configuration conf,
boolean close)
Copies from one stream to another. |
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Construct the preferred type of 'raw' SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(Configuration conf,
FSDataOutputStream out,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
SequenceFile.Metadata metadata)
Construct the preferred type of 'raw' SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
CompressionCodec codec,
Progressable progress,
SequenceFile.Metadata metadata)
Construct the preferred type of SequenceFile Writer. |
static SequenceFile.Writer |
SequenceFile.createWriter(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compressionType,
Progressable progress)
Construct the preferred type of SequenceFile Writer. |
static long |
MapFile.fix(FileSystem fs,
Path dir,
Class keyClass,
Class valueClass,
boolean dryrun,
Configuration conf)
This method attempts to fix a corrupt MapFile by re-creating its index. |
static Class |
WritableName.getClass(String name,
Configuration conf)
Return the class for a name. |
static SequenceFile.CompressionType |
SequenceFile.getCompressionType(Configuration job)
Get the compression type for the reduce outputs |
static Writable |
WritableFactories.newInstance(Class c,
Configuration conf)
Create a new instance of a class with a defined factory. |
static Object |
ObjectWritable.readObject(DataInput in,
Configuration conf)
Read a Writable , String , primitive type, or an array of
the preceding. |
static Object |
ObjectWritable.readObject(DataInput in,
ObjectWritable objectWritable,
Configuration conf)
Read a Writable , String , primitive type, or an array of
the preceding. |
static void |
SequenceFile.setCompressionType(Configuration job,
SequenceFile.CompressionType val)
Set the compression type for sequence files. |
void |
ObjectWritable.setConf(Configuration conf)
|
void |
GenericWritable.setConf(Configuration conf)
|
void |
AbstractMapWritable.setConf(Configuration conf)
|
static void |
ObjectWritable.writeObject(DataOutput out,
Object instance,
Class declaredClass,
Configuration conf)
Write a Writable , String , primitive type, or an array of
the preceding. |
Constructors in org.apache.hadoop.io with parameters of type Configuration | |
---|---|
ArrayFile.Reader(FileSystem fs,
String file,
Configuration conf)
Construct an array reader for the named file. |
|
ArrayFile.Writer(Configuration conf,
FileSystem fs,
String file,
Class valClass)
Create the named file for values of the named class. |
|
ArrayFile.Writer(Configuration conf,
FileSystem fs,
String file,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Create the named file for values of the named class. |
|
MapFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Construct a map reader for the named map. |
|
MapFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Construct a map reader for the named map using the named comparator. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class keyClass,
Class valClass)
Create the named map for keys of the named class. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compress)
Create the named map for keys of the named class. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Create the named map for keys of the named class. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class keyClass,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Create the named map for keys of the named class. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass)
Create the named map using the named key comparator. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress)
Create the named map using the named key comparator. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
CompressionCodec codec,
Progressable progress)
Create the named map using the named key comparator. |
|
MapFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
Class valClass,
SequenceFile.CompressionType compress,
Progressable progress)
Create the named map using the named key comparator. |
|
SequenceFile.Reader(FileSystem fs,
Path file,
Configuration conf)
Open the named file. |
|
SequenceFile.Sorter(FileSystem fs,
Class keyClass,
Class valClass,
Configuration conf)
Sort and merge files containing the named classes. |
|
SequenceFile.Sorter(FileSystem fs,
WritableComparator comparator,
Class valClass,
Configuration conf)
Sort and merge using an arbitrary WritableComparator . |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass)
Create the named file. |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
int bufferSize,
short replication,
long blockSize,
Progressable progress,
SequenceFile.Metadata metadata)
Create the named file with write-progress reporter. |
|
SequenceFile.Writer(FileSystem fs,
Configuration conf,
Path name,
Class keyClass,
Class valClass,
Progressable progress,
SequenceFile.Metadata metadata)
Create the named file with write-progress reporter. |
|
SetFile.Reader(FileSystem fs,
String dirName,
Configuration conf)
Construct a set reader for the named set. |
|
SetFile.Reader(FileSystem fs,
String dirName,
WritableComparator comparator,
Configuration conf)
Construct a set reader for the named set using the named comparator. |
|
SetFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
Class keyClass,
SequenceFile.CompressionType compress)
Deprecated. Create a set naming the element class and compression type. |
|
SetFile.Writer(Configuration conf,
FileSystem fs,
String dirName,
WritableComparator comparator,
SequenceFile.CompressionType compress)
Deprecated. Create a set naming the element comparator and compression type. |
Uses of Configuration in org.apache.hadoop.io.compress |
---|
Methods in org.apache.hadoop.io.compress that return Configuration | |
---|---|
Configuration |
LzoCodec.getConf()
|
Configuration |
DefaultCodec.getConf()
|
Methods in org.apache.hadoop.io.compress with parameters of type Configuration | |
---|---|
static List<Class> |
CompressionCodecFactory.getCodecClasses(Configuration conf)
Get the list of codecs listed in the configuration |
static boolean |
LzoCodec.isNativeLzoLoaded(Configuration conf)
Check if native-lzo library is loaded & initialized. |
static void |
CompressionCodecFactory.setCodecClasses(Configuration conf,
List<Class> classes)
Sets a list of codec classes in the configuration. |
void |
LzoCodec.setConf(Configuration conf)
|
void |
DefaultCodec.setConf(Configuration conf)
|
Constructors in org.apache.hadoop.io.compress with parameters of type Configuration | |
---|---|
CompressionCodecFactory(Configuration conf)
Find the codecs specified in the config value io.compression.codecs and register them. |
Uses of Configuration in org.apache.hadoop.io.compress.zlib |
---|
Methods in org.apache.hadoop.io.compress.zlib with parameters of type Configuration | |
---|---|
static Compressor |
ZlibFactory.getZlibCompressor(Configuration conf)
Return the appropriate implementation of the zlib compressor. |
static Class |
ZlibFactory.getZlibCompressorType(Configuration conf)
Return the appropriate type of the zlib compressor. |
static Decompressor |
ZlibFactory.getZlibDecompressor(Configuration conf)
Return the appropriate implementation of the zlib decompressor. |
static Class |
ZlibFactory.getZlibDecompressorType(Configuration conf)
Return the appropriate type of the zlib decompressor. |
static boolean |
ZlibFactory.isNativeZlibLoaded(Configuration conf)
Check if native-zlib code is loaded & initialized correctly and can be loaded for this job. |
Uses of Configuration in org.apache.hadoop.ipc |
---|
Methods in org.apache.hadoop.ipc with parameters of type Configuration | |
---|---|
static Object[] |
RPC.call(Method method,
Object[][] params,
InetSocketAddress[] addrs,
Configuration conf)
Expert: Make multiple, parallel calls to a set of servers. |
static VersionedProtocol |
RPC.getProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
Construct a client-side proxy object with the default SocketFactory |
static VersionedProtocol |
RPC.getProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf,
SocketFactory factory)
Construct a client-side proxy object that implements the named protocol, talking to a server at the named address. |
static VersionedProtocol |
RPC.getProxy(Class<?> protocol,
long clientVersion,
InetSocketAddress addr,
UserGroupInformation ticket,
Configuration conf,
SocketFactory factory)
Construct a client-side proxy object that implements the named protocol, talking to a server at the named address. |
static RPC.Server |
RPC.getServer(Object instance,
String bindAddress,
int port,
Configuration conf)
Construct a server for a protocol implementation instance listening on a port and address. |
static RPC.Server |
RPC.getServer(Object instance,
String bindAddress,
int port,
int numHandlers,
boolean verbose,
Configuration conf)
Construct a server for a protocol implementation instance listening on a port and address. |
static VersionedProtocol |
RPC.waitForProxy(Class protocol,
long clientVersion,
InetSocketAddress addr,
Configuration conf)
|
Constructors in org.apache.hadoop.ipc with parameters of type Configuration | |
---|---|
Client(Class<?> valueClass,
Configuration conf)
Construct an IPC client with the default SocketFactory |
|
Client(Class valueClass,
Configuration conf,
SocketFactory factory)
Construct an IPC client whose values are of the given Writable
class. |
|
RPC.Server(Object instance,
Configuration conf,
String bindAddress,
int port)
Construct an RPC server. |
|
RPC.Server(Object instance,
Configuration conf,
String bindAddress,
int port,
int numHandlers,
boolean verbose)
Construct an RPC server. |
|
Server(String bindAddress,
int port,
Class paramClass,
int handlerCount,
Configuration conf)
|
|
Server(String bindAddress,
int port,
Class paramClass,
int handlerCount,
Configuration conf,
String serverName)
Constructs a server listening on the named port and address. |
Uses of Configuration in org.apache.hadoop.mapred |
---|
Subclasses of Configuration in org.apache.hadoop.mapred | |
---|---|
class |
JobConf
A map/reduce job configuration. |
Fields in org.apache.hadoop.mapred declared as Configuration | |
---|---|
protected Configuration |
SequenceFileRecordReader.conf
|
Methods in org.apache.hadoop.mapred that return Configuration | |
---|---|
Configuration |
SequenceFileInputFilter.FilterBase.getConf()
|
Methods in org.apache.hadoop.mapred with parameters of type Configuration | |
---|---|
static InetSocketAddress |
JobTracker.getAddress(Configuration conf)
|
static SequenceFile.Reader[] |
SequenceFileOutputFormat.getReaders(Configuration conf,
Path dir)
Open the output generated by this format. |
static MapFile.Reader[] |
MapFileOutputFormat.getReaders(FileSystem ignored,
Path dir,
Configuration conf)
Open the output generated by this format. |
void |
SequenceFileInputFilter.RegexFilter.setConf(Configuration conf)
configure the Filter by checking the configuration |
void |
SequenceFileInputFilter.PercentFilter.setConf(Configuration conf)
configure the filter by checking the configuration |
void |
SequenceFileInputFilter.MD5Filter.setConf(Configuration conf)
configure the filter according to configuration |
static void |
SequenceFileInputFilter.setFilterClass(Configuration conf,
Class filterClass)
set the filter class |
static void |
SequenceFileInputFilter.PercentFilter.setFrequency(Configuration conf,
int frequency)
set the frequency and stores it in conf |
static void |
SequenceFileInputFilter.MD5Filter.setFrequency(Configuration conf,
int frequency)
set the filtering frequency in configuration |
static void |
SequenceFileInputFilter.RegexFilter.setPattern(Configuration conf,
String regex)
Define the filtering regex and stores it in conf |
Constructors in org.apache.hadoop.mapred with parameters of type Configuration | |
---|---|
JobClient(InetSocketAddress jobTrackAddr,
Configuration conf)
Build a job client, connect to the indicated job tracker. |
|
JobConf(Configuration conf)
Construct a map/reduce job configuration. |
|
JobConf(Configuration conf,
Class exampleClass)
Construct a map/reduce job configuration. |
|
KeyValueLineRecordReader(Configuration job,
FileSplit split)
|
|
LineRecordReader(Configuration job,
FileSplit split)
|
|
LineRecordReader(InputStream in,
long offset,
long endOffset,
Configuration job)
|
|
SequenceFileAsTextRecordReader(Configuration conf,
FileSplit split)
|
|
SequenceFileRecordReader(Configuration conf,
FileSplit split)
|
Uses of Configuration in org.apache.hadoop.mapred.join |
---|
Methods in org.apache.hadoop.mapred.join that return Configuration | |
---|---|
Configuration |
CompositeRecordReader.getConf()
Return the configuration used by this object. |
Methods in org.apache.hadoop.mapred.join with parameters of type Configuration | |
---|---|
void |
CompositeRecordReader.setConf(Configuration conf)
Set the configuration to be used by this object. |
Uses of Configuration in org.apache.hadoop.net |
---|
Methods in org.apache.hadoop.net that return Configuration | |
---|---|
Configuration |
SocksSocketFactory.getConf()
|
Methods in org.apache.hadoop.net with parameters of type Configuration | |
---|---|
static SocketFactory |
NetUtils.getDefaultSocketFactory(Configuration conf)
Get the default socket factory as specified by the configuration parameter hadoop.rpc.socket.factory.default |
static String |
NetUtils.getServerAddress(Configuration conf,
String oldBindAddressName,
String oldPortName,
String newBindAddressName)
Deprecated. |
static SocketFactory |
NetUtils.getSocketFactory(Configuration conf,
Class<?> clazz)
Get the socket factory for the given class according to its configuration parameter hadoop.rpc.socket.factory.class.<ClassName>. |
static SocketFactory |
NetUtils.getSocketFactoryFromProperty(Configuration conf,
String propValue)
Get the socket factory corresponding to the given proxy URI. |
void |
SocksSocketFactory.setConf(Configuration conf)
|
Uses of Configuration in org.apache.hadoop.security |
---|
Methods in org.apache.hadoop.security with parameters of type Configuration | |
---|---|
static UnixUserGroupInformation |
UnixUserGroupInformation.login(Configuration conf)
Get a user's name & its group names from the given configuration; If it is not defined in the configuration, get the current user's information from Unix. |
static UnixUserGroupInformation |
UnixUserGroupInformation.readFromConf(Configuration conf,
String attr)
Read a UGI from the given conf
The object is expected to store with the property name attr
as a comma separated string that starts
with the user name followed by group names. |
static void |
UnixUserGroupInformation.saveToConf(Configuration conf,
String attr,
UnixUserGroupInformation ugi)
Store the given ugi as a comma separated string in
conf as a property attr
The String starts with the user name followed by the default group names,
and other group names. |
Uses of Configuration in org.apache.hadoop.streaming |
---|
Fields in org.apache.hadoop.streaming declared as Configuration | |
---|---|
protected Configuration |
StreamJob.config_
|
Constructors in org.apache.hadoop.streaming with parameters of type Configuration | |
---|---|
StreamLineRecordReader(Configuration job,
FileSplit split)
Deprecated. |
|
StreamSequenceRecordReader(Configuration conf,
FileSplit split)
Deprecated. |
Uses of Configuration in org.apache.hadoop.tools |
---|
Methods in org.apache.hadoop.tools that return Configuration | |
---|---|
Configuration |
Logalyzer.LogComparator.getConf()
|
Methods in org.apache.hadoop.tools with parameters of type Configuration | |
---|---|
void |
Logalyzer.LogComparator.setConf(Configuration conf)
|
Uses of Configuration in org.apache.hadoop.util |
---|
Fields in org.apache.hadoop.util declared as Configuration | |
---|---|
Configuration |
ToolBase.conf
Deprecated. |
Methods in org.apache.hadoop.util that return Configuration | |
---|---|
Configuration |
ToolBase.getConf()
Deprecated. |
Configuration |
CopyFiles.getConf()
|
Methods in org.apache.hadoop.util with parameters of type Configuration | |
---|---|
static void |
CopyFiles.copy(Configuration conf,
List<Path> srcPaths,
Path destPath,
Path logPath,
EnumSet<org.apache.hadoop.util.CopyFiles.cpOpts> flags)
Driver to copy srcPath to destPath depending on required protocol. |
static void |
CopyFiles.copy(Configuration conf,
String srcPath,
String destPath,
Path logPath,
boolean srcAsList,
boolean ignoreReadFailures)
Deprecated. |
int |
ToolBase.doMain(Configuration conf,
String[] args)
Deprecated. Work as a main program: execute a command and handle exception if any |
static Object |
ReflectionUtils.newInstance(Class<?> theClass,
Configuration conf)
Create an object for the given class and initialize it from conf |
static int |
ToolRunner.run(Configuration conf,
Tool tool,
String[] args)
Runs the given Tool by Tool.run(String[]) , after
parsing with the given generic arguments. |
void |
ToolBase.setConf(Configuration conf)
Deprecated. |
void |
CopyFiles.setConf(Configuration conf)
|
static void |
ReflectionUtils.setConf(Object theObject,
Configuration conf)
Check and set 'configuration' if necessary. |
Constructors in org.apache.hadoop.util with parameters of type Configuration | |
---|---|
CopyFiles(Configuration conf)
|
|
GenericOptionsParser(Configuration conf,
org.apache.commons.cli.Options options,
String[] args)
Create a GenericOptionsParser to parse given options as well
as generic Hadoop options. |
|
GenericOptionsParser(Configuration conf,
String[] args)
Create a GenericOptionsParser |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |