|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hcatalog.mapreduce.HCatInputStorageDriver
public abstract class HCatInputStorageDriver
The abstract class to be implemented by underlying storage drivers to enable data access from HCat through HCatInputFormat.
Constructor Summary | |
---|---|
HCatInputStorageDriver()
|
Method Summary | |
---|---|
abstract HCatRecord |
convertToHCatRecord(org.apache.hadoop.io.WritableComparable baseKey,
org.apache.hadoop.io.Writable baseValue)
Converts to HCatRecord format usable by HCatInputFormat to convert to required valuetype. |
abstract org.apache.hadoop.mapreduce.InputFormat<? extends org.apache.hadoop.io.WritableComparable,? extends org.apache.hadoop.io.Writable> |
getInputFormat(java.util.Properties hcatProperties)
Returns the InputFormat to use with this Storage Driver. |
void |
initialize(org.apache.hadoop.mapreduce.JobContext context,
java.util.Properties storageDriverArgs)
|
void |
setInputPath(org.apache.hadoop.mapreduce.JobContext jobContext,
java.lang.String location)
Set the data location for the input. |
abstract void |
setOriginalSchema(org.apache.hadoop.mapreduce.JobContext jobContext,
HCatSchema hcatSchema)
Set the schema of the data as originally published in HCat. |
abstract void |
setOutputSchema(org.apache.hadoop.mapreduce.JobContext jobContext,
HCatSchema hcatSchema)
Set the consolidated schema for the HCatRecord data returned by the storage driver. |
abstract void |
setPartitionValues(org.apache.hadoop.mapreduce.JobContext jobContext,
java.util.Map<java.lang.String,java.lang.String> partitionValues)
Sets the partition key values for the current partition. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public HCatInputStorageDriver()
Method Detail |
---|
public void initialize(org.apache.hadoop.mapreduce.JobContext context, java.util.Properties storageDriverArgs) throws java.io.IOException
java.io.IOException
public abstract org.apache.hadoop.mapreduce.InputFormat<? extends org.apache.hadoop.io.WritableComparable,? extends org.apache.hadoop.io.Writable> getInputFormat(java.util.Properties hcatProperties)
hcatProperties
- the properties containing parameters required for initialization of InputFormat
public abstract HCatRecord convertToHCatRecord(org.apache.hadoop.io.WritableComparable baseKey, org.apache.hadoop.io.Writable baseValue) throws java.io.IOException
baseValue
- the underlying value to convert to HCatRecord
java.io.IOException
public void setInputPath(org.apache.hadoop.mapreduce.JobContext jobContext, java.lang.String location) throws java.io.IOException
jobContext
- the job context objectlocation
- the data location
java.io.IOException
- Signals that an I/O exception has occurred.
Default implementation for FileInputFormat based Input Formats. Override
this for other input formats.public abstract void setOriginalSchema(org.apache.hadoop.mapreduce.JobContext jobContext, HCatSchema hcatSchema) throws java.io.IOException
jobContext
- the job context objecthcatSchema
- the schema published in HCat for this data
java.io.IOException
- Signals that an I/O exception has occurred.public abstract void setOutputSchema(org.apache.hadoop.mapreduce.JobContext jobContext, HCatSchema hcatSchema) throws java.io.IOException
jobContext
- the job context objecthcatSchema
- the schema to use as the consolidated schema
java.io.IOException
- Signals that an I/O exception has occurred.public abstract void setPartitionValues(org.apache.hadoop.mapreduce.JobContext jobContext, java.util.Map<java.lang.String,java.lang.String> partitionValues) throws java.io.IOException
jobContext
- the job context objectpartitionValues
- the partition values having a map with partition key name as key and the HCatKeyValue as value
java.io.IOException
- Signals that an I/O exception has occurred.
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |