|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hcatalog.mapreduce.HCatInputStorageDriver
org.apache.hcatalog.rcfile.RCFileInputDriver
public class RCFileInputDriver
Constructor Summary | |
---|---|
RCFileInputDriver()
|
Method Summary | |
---|---|
HCatRecord |
convertToHCatRecord(org.apache.hadoop.io.WritableComparable ignored,
org.apache.hadoop.io.Writable bytesRefArray)
Converts to HCatRecord format usable by HCatInputFormat to convert to required valuetype. |
org.apache.hadoop.mapreduce.InputFormat<? extends org.apache.hadoop.io.WritableComparable,? extends org.apache.hadoop.io.Writable> |
getInputFormat(java.util.Properties hcatProperties)
Returns the InputFormat to use with this Storage Driver. |
void |
initialize(org.apache.hadoop.mapreduce.JobContext context,
java.util.Properties hcatProperties)
|
void |
setInputPath(org.apache.hadoop.mapreduce.JobContext jobContext,
java.lang.String location)
Set the data location for the input. |
void |
setOriginalSchema(org.apache.hadoop.mapreduce.JobContext jobContext,
HCatSchema dataSchema)
Set the schema of the data as originally published in HCat. |
void |
setOutputSchema(org.apache.hadoop.mapreduce.JobContext jobContext,
HCatSchema desiredSchema)
Set the consolidated schema for the HCatRecord data returned by the storage driver. |
void |
setPartitionValues(org.apache.hadoop.mapreduce.JobContext jobContext,
java.util.Map<java.lang.String,java.lang.String> partitionValues)
Sets the partition key values for the current partition. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public RCFileInputDriver()
Method Detail |
---|
public org.apache.hadoop.mapreduce.InputFormat<? extends org.apache.hadoop.io.WritableComparable,? extends org.apache.hadoop.io.Writable> getInputFormat(java.util.Properties hcatProperties)
HCatInputStorageDriver
getInputFormat
in class HCatInputStorageDriver
hcatProperties
- the properties containing parameters required for initialization of InputFormat
public void setInputPath(org.apache.hadoop.mapreduce.JobContext jobContext, java.lang.String location) throws java.io.IOException
HCatInputStorageDriver
setInputPath
in class HCatInputStorageDriver
jobContext
- the job context objectlocation
- the data location
java.io.IOException
- Signals that an I/O exception has occurred.
Default implementation for FileInputFormat based Input Formats. Override
this for other input formats.public void setOriginalSchema(org.apache.hadoop.mapreduce.JobContext jobContext, HCatSchema dataSchema) throws java.io.IOException
HCatInputStorageDriver
setOriginalSchema
in class HCatInputStorageDriver
jobContext
- the job context objectdataSchema
- the schema published in HCat for this data
java.io.IOException
- Signals that an I/O exception has occurred.public void setOutputSchema(org.apache.hadoop.mapreduce.JobContext jobContext, HCatSchema desiredSchema) throws java.io.IOException
HCatInputStorageDriver
setOutputSchema
in class HCatInputStorageDriver
jobContext
- the job context objectdesiredSchema
- the schema to use as the consolidated schema
java.io.IOException
- Signals that an I/O exception has occurred.public void setPartitionValues(org.apache.hadoop.mapreduce.JobContext jobContext, java.util.Map<java.lang.String,java.lang.String> partitionValues) throws java.io.IOException
HCatInputStorageDriver
setPartitionValues
in class HCatInputStorageDriver
jobContext
- the job context objectpartitionValues
- the partition values having a map with partition key name as key and the HCatKeyValue as value
java.io.IOException
- Signals that an I/O exception has occurred.public HCatRecord convertToHCatRecord(org.apache.hadoop.io.WritableComparable ignored, org.apache.hadoop.io.Writable bytesRefArray) throws java.io.IOException
HCatInputStorageDriver
convertToHCatRecord
in class HCatInputStorageDriver
bytesRefArray
- the underlying value to convert to HCatRecord
java.io.IOException
public void initialize(org.apache.hadoop.mapreduce.JobContext context, java.util.Properties hcatProperties) throws java.io.IOException
initialize
in class HCatInputStorageDriver
java.io.IOException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |