Uses of Class
org.apache.hadoop.conf.Configuration

Packages that use Configuration
org.apache.hadoop.conf Configuration of system parameters. 
org.apache.hadoop.dfs A distributed implementation of FileSystem
org.apache.hadoop.filecache   
org.apache.hadoop.fs An abstract file system API. 
org.apache.hadoop.io Generic i/o code for use when reading and writing data to the network, to databases, and to files. 
org.apache.hadoop.io.compress   
org.apache.hadoop.ipc Tools to help define network clients and servers. 
org.apache.hadoop.mapred A system for scalable, fault-tolerant, distributed computation over large data collections. 
org.apache.hadoop.tools   
org.apache.hadoop.util Common utilities. 
 

Uses of Configuration in org.apache.hadoop.conf
 

Methods in org.apache.hadoop.conf that return Configuration
 Configuration Configured.getConf()
           
 Configuration Configurable.getConf()
          Return the configuration used by this object.
 

Methods in org.apache.hadoop.conf with parameters of type Configuration
 void Configured.setConf(Configuration conf)
           
 void Configurable.setConf(Configuration conf)
          Set the configuration to be used by this object.
 

Constructors in org.apache.hadoop.conf with parameters of type Configuration
Configuration(Configuration other)
          A new configuration with the same settings cloned from another.
Configured(Configuration conf)
          Construct a Configured.
 

Uses of Configuration in org.apache.hadoop.dfs
 

Methods in org.apache.hadoop.dfs with parameters of type Configuration
 void DFSShell.copy(String srcf, String dstf, Configuration conf)
          Copy DFS files that match the file pattern srcf to a destination dfs file.
static void NameNode.format(Configuration conf)
          Format a new filesystem.
static void DataNode.run(Configuration conf)
          Start datanode daemon.
 

Constructors in org.apache.hadoop.dfs with parameters of type Configuration
DFSck(Configuration conf)
          Filesystem checker.
DistributedFileSystem(InetSocketAddress namenode, Configuration conf)
          Construct a client for the filesystem at namenode.
NameNode(Configuration conf)
          Create a NameNode at the default location
NameNode(File[] dirs, String bindAddress, int port, Configuration conf)
          Create a NameNode at the specified location and start it.
NamenodeFsck(Configuration conf, NameNode nn, Map<String,String[]> pmap, javax.servlet.http.HttpServletResponse response)
          Filesystem checker.
 

Uses of Configuration in org.apache.hadoop.filecache
 

Methods in org.apache.hadoop.filecache with parameters of type Configuration
static void DistributedCache.addCacheArchive(URI uri, Configuration conf)
          Add a archives to be localized to the conf
static void DistributedCache.addCacheFile(URI uri, Configuration conf)
          Add a file to be localized to the conf
static byte[] DistributedCache.createMD5(URI cache, Configuration conf)
          Returns md5 of the checksum file for a given dfs file.
static void DistributedCache.createSymlink(Configuration conf)
          This method allows you to create symlinks in the current working directory of the task to all the cache files/archives
static String[] DistributedCache.getArchiveMd5(Configuration conf)
          Get the md5 checksums of the archives
static URI[] DistributedCache.getCacheArchives(Configuration conf)
          Get cache archives set in the Configuration
static URI[] DistributedCache.getCacheFiles(Configuration conf)
          Get cache files set in the Configuration
static String[] DistributedCache.getFileMd5(Configuration conf)
          Get the md5 checksums of the files
static Path DistributedCache.getLocalCache(URI cache, Configuration conf, Path baseDir, boolean isArchive, String md5, Path currentWorkDir)
           
static Path[] DistributedCache.getLocalCacheArchives(Configuration conf)
          Return the path array of the localized caches
static Path[] DistributedCache.getLocalCacheFiles(Configuration conf)
          Return the path array of the localized files
static boolean DistributedCache.getSymlink(Configuration conf)
          This method checks to see if symlinks are to be create for the localized cache files in the current working directory
static void DistributedCache.releaseCache(URI cache, Configuration conf)
          This is the opposite of getlocalcache.
static void DistributedCache.setArchiveMd5(Configuration conf, String md5)
          This is to check the md5 of the archives to be localized
static void DistributedCache.setCacheArchives(URI[] archives, Configuration conf)
          Set the configuration with the given set of archives
static void DistributedCache.setCacheFiles(URI[] files, Configuration conf)
          Set the configuration with the given set of files
static void DistributedCache.setFileMd5(Configuration conf, String md5)
          This is to check the md5 of the files to be localized
static void DistributedCache.setLocalArchives(Configuration conf, String str)
          Set the conf to contain the location for localized archives
static void DistributedCache.setLocalFiles(Configuration conf, String str)
          Set the conf to contain the location for localized files
 

Uses of Configuration in org.apache.hadoop.fs
 

Methods in org.apache.hadoop.fs with parameters of type Configuration
static boolean FileUtil.copy(File src, FileSystem dstFS, Path dst, boolean deleteSource, Configuration conf)
          Copy local files to a FileSystem.
static boolean FileUtil.copy(FileSystem srcFS, Path src, File dst, boolean deleteSource, Configuration conf)
          Copy FileSystem files to local files.
static boolean FileUtil.copy(FileSystem srcFS, Path src, FileSystem dstFS, Path dst, boolean deleteSource, Configuration conf)
          Copy files between FileSystems.
static boolean FileUtil.copyMerge(FileSystem srcFS, Path srcDir, FileSystem dstFS, Path dstFile, boolean deleteSource, Configuration conf, String addString)
          Copy all files in a directory to one output file (merge).
static FileSystem FileSystem.get(Configuration conf)
          Returns the configured filesystem implementation.
static FileSystem FileSystem.getNamed(String name, Configuration conf)
          Returns a named filesystem.
static FileSystem FileSystem.parseArgs(String[] argv, int i, Configuration conf)
          Parse the cmd-line args, starting at i.
 

Constructors in org.apache.hadoop.fs with parameters of type Configuration
DF(File path, Configuration conf)
           
FileSystem(Configuration conf)
           
FSDataInputStream(FileSystem fs, Path file, Configuration conf)
           
FSDataInputStream(FileSystem fs, Path file, int bufferSize, Configuration conf)
           
FSDataInputStream(FSInputStream in, Configuration conf)
          Construct without checksums.
FSDataOutputStream(FileSystem fs, Path file, boolean overwrite, Configuration conf, int bufferSize, short replication, long blockSize)
           
FSDataOutputStream(FileSystem fs, Path file, boolean overwrite, Configuration conf, int bufferSize, short replication, long blockSize, Progressable progress)
           
LocalFileSystem(Configuration conf)
          Construct a local filesystem client.
 

Uses of Configuration in org.apache.hadoop.io
 

Methods in org.apache.hadoop.io that return Configuration
 Configuration ObjectWritable.getConf()
           
 

Methods in org.apache.hadoop.io with parameters of type Configuration
static SequenceFile.Writer SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass)
          Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType)
          Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec)
          Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, CompressionCodec codec, Progressable progress)
          Construct the preferred type of SequenceFile Writer.
static SequenceFile.Writer SequenceFile.createWriter(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, SequenceFile.CompressionType compressionType, Progressable progress)
          Construct the preferred type of SequenceFile Writer.
static long MapFile.fix(FileSystem fs, Path dir, Class keyClass, Class valueClass, boolean dryrun, Configuration conf)
          This method attempts to fix a corrupt MapFile by re-creating its index.
static Class WritableName.getClass(String name, Configuration conf)
          Return the class for a name.
static SequenceFile.CompressionType SequenceFile.getCompressionType(Configuration job)
          Get the compression type for the reduce outputs
static Writable WritableFactories.newInstance(Class c, Configuration conf)
          Create a new instance of a class with a defined factory.
static Object ObjectWritable.readObject(DataInput in, Configuration conf)
          Read a Writable, String, primitive type, or an array of the preceding.
static Object ObjectWritable.readObject(DataInput in, ObjectWritable objectWritable, Configuration conf)
          Read a Writable, String, primitive type, or an array of the preceding.
static void SequenceFile.setCompressionType(Configuration job, SequenceFile.CompressionType val)
          Set the compression type for sequence files.
 void ObjectWritable.setConf(Configuration conf)
           
static void ObjectWritable.writeObject(DataOutput out, Object instance, Class declaredClass, Configuration conf)
          Write a Writable, String, primitive type, or an array of the preceding.
 

Constructors in org.apache.hadoop.io with parameters of type Configuration
ArrayFile.Reader(FileSystem fs, String file, Configuration conf)
          Construct an array reader for the named file.
ArrayFile.Writer(Configuration conf, FileSystem fs, String file, Class valClass)
          Create the named file for values of the named class.
ArrayFile.Writer(Configuration conf, FileSystem fs, String file, Class valClass, SequenceFile.CompressionType compress, Progressable progress)
          Create the named file for values of the named class.
MapFile.Reader(FileSystem fs, String dirName, Configuration conf)
          Construct a map reader for the named map.
MapFile.Reader(FileSystem fs, String dirName, WritableComparator comparator, Configuration conf)
          Construct a map reader for the named map using the named comparator.
MapFile.Writer(Configuration conf, FileSystem fs, String dirName, Class keyClass, Class valClass)
          Create the named map for keys of the named class.
MapFile.Writer(Configuration conf, FileSystem fs, String dirName, Class keyClass, Class valClass, SequenceFile.CompressionType compress)
          Create the named map for keys of the named class.
MapFile.Writer(Configuration conf, FileSystem fs, String dirName, Class keyClass, Class valClass, SequenceFile.CompressionType compress, Progressable progress)
          Create the named map for keys of the named class.
MapFile.Writer(Configuration conf, FileSystem fs, String dirName, WritableComparator comparator, Class valClass)
          Create the named map using the named key comparator.
MapFile.Writer(Configuration conf, FileSystem fs, String dirName, WritableComparator comparator, Class valClass, SequenceFile.CompressionType compress)
          Create the named map using the named key comparator.
MapFile.Writer(Configuration conf, FileSystem fs, String dirName, WritableComparator comparator, Class valClass, SequenceFile.CompressionType compress, Progressable progress)
          Create the named map using the named key comparator.
SequenceFile.Reader(FileSystem fs, Path file, Configuration conf)
          Open the named file.
SequenceFile.Sorter(FileSystem fs, Class keyClass, Class valClass, Configuration conf)
          Sort and merge files containing the named classes.
SequenceFile.Sorter(FileSystem fs, WritableComparator comparator, Class valClass, Configuration conf)
          Sort and merge using an arbitrary WritableComparator.
SequenceFile.Writer(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass)
          Create the named file.
SequenceFile.Writer(FileSystem fs, Configuration conf, Path name, Class keyClass, Class valClass, Progressable progress)
          Create the named file with write-progress reporter.
SetFile.Reader(FileSystem fs, String dirName, Configuration conf)
          Construct a set reader for the named set.
SetFile.Reader(FileSystem fs, String dirName, WritableComparator comparator, Configuration conf)
          Construct a set reader for the named set using the named comparator.
SetFile.Writer(Configuration conf, FileSystem fs, String dirName, Class keyClass, SequenceFile.CompressionType compress)
          Create a set naming the element class and compression type.
SetFile.Writer(Configuration conf, FileSystem fs, String dirName, WritableComparator comparator, SequenceFile.CompressionType compress)
          Create a set naming the element comparator and compression type.
 

Uses of Configuration in org.apache.hadoop.io.compress
 

Methods in org.apache.hadoop.io.compress that return Configuration
 Configuration DefaultCodec.getConf()
           
 

Methods in org.apache.hadoop.io.compress with parameters of type Configuration
static List<Class> CompressionCodecFactory.getCodecClasses(Configuration conf)
          Get the list of codecs listed in the configuration
static void CompressionCodecFactory.setCodecClasses(Configuration conf, List<Class> classes)
          Sets a list of codec classes in the configuration.
 void DefaultCodec.setConf(Configuration conf)
           
 

Constructors in org.apache.hadoop.io.compress with parameters of type Configuration
CompressionCodecFactory(Configuration conf)
          Find the codecs specified in the config value io.compression.codecs and register them.
 

Uses of Configuration in org.apache.hadoop.ipc
 

Methods in org.apache.hadoop.ipc with parameters of type Configuration
static Object[] RPC.call(Method method, Object[][] params, InetSocketAddress[] addrs, Configuration conf)
          Expert: Make multiple, parallel calls to a set of servers.
static VersionedProtocol RPC.getProxy(Class protocol, long clientVersion, InetSocketAddress addr, Configuration conf)
          Construct a client-side proxy object that implements the named protocol, talking to a server at the named address.
static RPC.Server RPC.getServer(Object instance, String bindAddress, int port, Configuration conf)
          Construct a server for a protocol implementation instance listening on a port and address.
static RPC.Server RPC.getServer(Object instance, String bindAddress, int port, int numHandlers, boolean verbose, Configuration conf)
          Construct a server for a protocol implementation instance listening on a port and address.
static VersionedProtocol RPC.waitForProxy(Class protocol, long clientVersion, InetSocketAddress addr, Configuration conf)
           
 

Constructors in org.apache.hadoop.ipc with parameters of type Configuration
Client(Class valueClass, Configuration conf)
          Construct an IPC client whose values are of the given Writable class.
RPC.Server(Object instance, Configuration conf, String bindAddress, int port)
          Construct an RPC server.
RPC.Server(Object instance, Configuration conf, String bindAddress, int port, int numHandlers, boolean verbose)
          Construct an RPC server.
Server(String bindAddress, int port, Class paramClass, int handlerCount, Configuration conf)
          Constructs a server listening on the named port and address.
 

Uses of Configuration in org.apache.hadoop.mapred
 

Subclasses of Configuration in org.apache.hadoop.mapred
 class JobConf
          A map/reduce job configuration.
 

Methods in org.apache.hadoop.mapred that return Configuration
 Configuration SequenceFileInputFilter.FilterBase.getConf()
           
 

Methods in org.apache.hadoop.mapred with parameters of type Configuration
static InetSocketAddress JobTracker.getAddress(Configuration conf)
           
static SequenceFile.Reader[] SequenceFileOutputFormat.getReaders(Configuration conf, Path dir)
          Open the output generated by this format.
static MapFile.Reader[] MapFileOutputFormat.getReaders(FileSystem fs, Path dir, Configuration conf)
          Open the output generated by this format.
 void SequenceFileInputFilter.RegexFilter.setConf(Configuration conf)
          configure the Filter by checking the configuration
 void SequenceFileInputFilter.PercentFilter.setConf(Configuration conf)
          configure the filter by checking the configuration
 void SequenceFileInputFilter.MD5Filter.setConf(Configuration conf)
          configure the filter according to configuration
static void SequenceFileInputFilter.setFilterClass(Configuration conf, Class filterClass)
          set the filter class
static void SequenceFileInputFilter.PercentFilter.setFrequency(Configuration conf, int frequency)
          set the frequency and stores it in conf
static void SequenceFileInputFilter.MD5Filter.setFrequency(Configuration conf, int frequency)
          set the filtering frequency in configuration
static void SequenceFileInputFilter.RegexFilter.setPattern(Configuration conf, String regex)
          Define the filtering regex and stores it in conf
static void JobTracker.startTracker(Configuration conf)
           
 

Constructors in org.apache.hadoop.mapred with parameters of type Configuration
JobClient(Configuration conf)
           
JobClient(InetSocketAddress jobTrackAddr, Configuration conf)
          Build a job client, connect to the indicated job tracker.
JobConf(Configuration conf)
          Construct a map/reduce job configuration.
JobConf(Configuration conf, Class exampleClass)
          Construct a map/reduce job configuration.
PhasedFileSystem(Configuration conf)
          This Constructor should not be used in this or any derived class.
SequenceFileRecordReader(Configuration conf, FileSplit split)
           
 

Uses of Configuration in org.apache.hadoop.tools
 

Methods in org.apache.hadoop.tools that return Configuration
 Configuration Logalyzer.LogComparator.getConf()
           
 

Methods in org.apache.hadoop.tools with parameters of type Configuration
 void Logalyzer.LogComparator.setConf(Configuration conf)
           
 

Uses of Configuration in org.apache.hadoop.util
 

Fields in org.apache.hadoop.util declared as Configuration
 Configuration ToolBase.conf
           
 

Methods in org.apache.hadoop.util that return Configuration
 Configuration ToolBase.getConf()
           
 

Methods in org.apache.hadoop.util with parameters of type Configuration
abstract  void CopyFiles.CopyFilesMapper.cleanup(Configuration conf, JobConf jobConf, String srcPath, String destPath)
          Interface to cleanup *distcp* specific resources
 void CopyFiles.DFSCopyFilesMapper.cleanup(Configuration conf, JobConf jobConf, String srcPath, String destPath)
           
 void CopyFiles.HTTPCopyFilesMapper.cleanup(Configuration conf, JobConf jobConf, String srcPath, String destPath)
           
static void CopyFiles.copy(Configuration conf, String srcPath, String destPath, boolean srcAsList, boolean ignoreReadFailures)
          Driver to copy srcPath to destPath depending on required protocol.
 int ToolBase.doMain(Configuration conf, String[] args)
          Work as a main program: execute a command and handle exception if any
static Object ReflectionUtils.newInstance(Class theClass, Configuration conf)
          Create an object for the given class and initialize it from conf
 void CopyFiles.setConf(Configuration conf)
           
 void ToolBase.setConf(Configuration conf)
           
static void ReflectionUtils.setConf(Object theObject, Configuration conf)
          Check and set 'configuration' if necessary.
abstract  void CopyFiles.CopyFilesMapper.setup(Configuration conf, JobConf jobConf, String[] srcPaths, String destPath, boolean ignoreReadFailures)
          Interface to initialize *distcp* specific map tasks.
 void CopyFiles.DFSCopyFilesMapper.setup(Configuration conf, JobConf jobConf, String[] srcPaths, String destPath, boolean ignoreReadFailures)
          Initialize DFSCopyFileMapper specific job-configuration.
 void CopyFiles.HTTPCopyFilesMapper.setup(Configuration conf, JobConf jobConf, String[] srcPaths, String destPath, boolean ignoreReadFailures)
          Initialize HTTPCopyFileMapper specific job.
 



Copyright © 2006 The Apache Software Foundation