org.apache.pig.backend.hadoop.executionengine.util
Class MapRedUtil
java.lang.Object
org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil
public class MapRedUtil
- extends Object
A class of utility static methods to be used in the hadoop map reduce backend
Method Summary |
static StoreConfig |
getStoreConfig(org.apache.hadoop.mapred.JobConf conf)
This method is to be called from an
OutputFormat.getRecordWriter(FileSystem ignored, JobConf job,
String name, Progressable progress)
method to obtain a reference to the StoreConfig object. |
static StoreFunc |
getStoreFunc(org.apache.hadoop.mapred.JobConf conf)
This method is to be called from an
OutputFormat.getRecordWriter(FileSystem ignored, JobConf job,
String name, Progressable progress)
method to obtain a reference to the StoreFunc object to be used by
that OutputFormat to perform the write() operation |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
MapRedUtil
public MapRedUtil()
getStoreFunc
public static StoreFunc getStoreFunc(org.apache.hadoop.mapred.JobConf conf)
throws ExecException
- This method is to be called from an
OutputFormat.getRecordWriter(FileSystem ignored, JobConf job,
String name, Progressable progress)
method to obtain a reference to the StoreFunc
object to be used by
that OutputFormat to perform the write() operation
- Parameters:
conf
- the JobConf object
- Returns:
- the StoreFunc reference
- Throws:
ExecException
getStoreConfig
public static StoreConfig getStoreConfig(org.apache.hadoop.mapred.JobConf conf)
throws IOException
- This method is to be called from an
OutputFormat.getRecordWriter(FileSystem ignored, JobConf job,
String name, Progressable progress)
method to obtain a reference to the StoreConfig
object. The StoreConfig
object will contain metadata information like schema and location to be used by
that OutputFormat to perform the write() operation
- Parameters:
conf
- the JobConf object
- Returns:
- StoreConfig object containing metadata information useful for
an OutputFormat to write the data
- Throws:
IOException
Copyright © ${year} The Apache Software Foundation