org.apache.hadoop.hive.ql.exec
Class HashTableSinkOperator

java.lang.Object
  extended by org.apache.hadoop.hive.ql.exec.Operator<T>
      extended by org.apache.hadoop.hive.ql.exec.TerminalOperator<HashTableSinkDesc>
          extended by org.apache.hadoop.hive.ql.exec.HashTableSinkOperator
All Implemented Interfaces:
Serializable, Cloneable, Node

public class HashTableSinkOperator
extends TerminalOperator<HashTableSinkDesc>
implements Serializable

See Also:
Serialized Form

Nested Class Summary
static class HashTableSinkOperator.HashTableSinkObjectCtx
           
 
Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator
Operator.OperatorFunc, Operator.ProgressCounter, Operator.State
 
Field Summary
protected  Byte alias
           
protected  SessionState.LogHelper console
           
protected  RowContainer<ArrayList<Object>> emptyList
           
protected  int[][] filterMap
           
protected  Map<Byte,List<ObjectInspector>> joinFilterObjectInspectors
          The ObjectInspectors for join filters.
protected  Map<Byte,List<ExprNodeEvaluator>> joinFilters
          The filters for join
protected  Map<Byte,List<ExprNodeEvaluator>> joinKeys
          The expressions for join inputs's join keys.
protected  Map<Byte,List<ObjectInspector>> joinKeysObjectInspectors
          The ObjectInspectors for the join inputs's join keys.
protected  Map<Byte,List<ObjectInspector>> joinKeysStandardObjectInspectors
          The standard ObjectInspectors for the join inputs's join keys.
protected  Map<Byte,List<ExprNodeEvaluator>> joinValues
          The expressions for join outputs.
protected  Map<Byte,List<ObjectInspector>> joinValuesObjectInspectors
          The ObjectInspectors for the join inputs.
protected  Map<Byte,List<ObjectInspector>> joinValuesStandardObjectInspectors
          The standard ObjectInspectors for the join inputs.
protected  Map<Byte,HashMapWrapper<AbstractMapJoinKey,MapJoinObjectValue>> mapJoinTables
           
protected  boolean noOuterJoin
           
protected  int numAliases
           
protected  Byte[] order
           
protected  int posBigTableAlias
           
protected  int posBigTableTag
           
protected  Map<Byte,List<ObjectInspector>> rowContainerStandardObjectInspectors
           
protected  Map<Byte,TableDesc> spillTableDesc
           
protected  int totalSz
           
 
Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator
beginTime, childOperators, childOperatorsArray, childOperatorsTag, colExprMap, conf, counterNames, counterNameToEnum, counters, done, fatalErrorCntr, groupKeyObject, id, inputObjInspectors, inputRows, isLogInfoEnabled, numInputRowsCntr, numOutputRowsCntr, operatorId, out, outputObjInspector, outputRows, parentOperators, reporter, state, statsMap, timeTakenCntr, totalTime
 
Constructor Summary
HashTableSinkOperator()
           
HashTableSinkOperator(MapJoinOperator mjop)
           
 
Method Summary
 void closeOp(boolean abort)
          Operator specific close routine.
 String getName()
          Implements the getName function for the Node Interface.
static String getOperatorName()
           
protected static HashMap<Byte,List<ObjectInspector>> getStandardObjectInspectors(Map<Byte,List<ObjectInspector>> aliasToObjectInspectors)
           
 OperatorType getType()
          Return the type of the specific operator among the types in OperatorType.
protected  void initializeOp(org.apache.hadoop.conf.Configuration hconf)
          Operator specific initialization.
 void processOp(Object row, int tag)
          Process the row.
 
Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator
allInitializedParentsAreClosed, areAllParentsInitialized, assignCounterNameToEnum, augmentPlan, checkFatalErrors, cleanUpInputFileChanged, cleanUpInputFileChangedOp, clone, close, columnNamesRowResolvedCanBeObtained, dump, dump, endGroup, fatalErrorMessage, forward, getAdditionalCounters, getChildOperators, getChildren, getColumnExprMap, getConf, getCounterNames, getCounterNameToEnum, getCounters, getDone, getExecContext, getGroupKeyObject, getIdentifier, getInputObjInspectors, getOperatorId, getParentOperators, getSchema, getStats, getWrappedCounterName, incrCounter, initEvaluators, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initializeChildren, initializeCounters, initializeLocalWork, initOperatorId, isUseBucketizedHiveInputFormat, jobClose, jobCloseOp, logStats, passExecContext, preorderMap, process, removeChild, removeChildAndAdoptItsChildren, removeChildren, removeParent, replaceChild, replaceParent, reset, resetId, resetLastEnumUsed, resetStats, setAlias, setChildOperators, setColumnExprMap, setConf, setCounterNames, setCounterNameToEnum, setDone, setExecContext, setGroupKeyObject, setId, setInputObjInspectors, setOperatorId, setOutputCollector, setParentOperators, setReporter, setSchema, setUseBucketizedHiveInputFormat, startGroup, supportSkewJoinOptimization, supportUnionRemoveOptimization, updateCounters
 
Methods inherited from class java.lang.Object
equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

joinKeys

protected transient Map<Byte,List<ExprNodeEvaluator>> joinKeys
The expressions for join inputs's join keys.


joinKeysObjectInspectors

protected transient Map<Byte,List<ObjectInspector>> joinKeysObjectInspectors
The ObjectInspectors for the join inputs's join keys.


joinKeysStandardObjectInspectors

protected transient Map<Byte,List<ObjectInspector>> joinKeysStandardObjectInspectors
The standard ObjectInspectors for the join inputs's join keys.


posBigTableTag

protected transient int posBigTableTag

posBigTableAlias

protected transient int posBigTableAlias

emptyList

protected transient RowContainer<ArrayList<Object>> emptyList

totalSz

protected transient int totalSz

joinFilters

protected transient Map<Byte,List<ExprNodeEvaluator>> joinFilters
The filters for join


filterMap

protected transient int[][] filterMap

numAliases

protected transient int numAliases

joinValues

protected transient Map<Byte,List<ExprNodeEvaluator>> joinValues
The expressions for join outputs.


joinValuesObjectInspectors

protected transient Map<Byte,List<ObjectInspector>> joinValuesObjectInspectors
The ObjectInspectors for the join inputs.


joinFilterObjectInspectors

protected transient Map<Byte,List<ObjectInspector>> joinFilterObjectInspectors
The ObjectInspectors for join filters.


joinValuesStandardObjectInspectors

protected transient Map<Byte,List<ObjectInspector>> joinValuesStandardObjectInspectors
The standard ObjectInspectors for the join inputs.


rowContainerStandardObjectInspectors

protected transient Map<Byte,List<ObjectInspector>> rowContainerStandardObjectInspectors

order

protected transient Byte[] order

alias

protected transient Byte alias

spillTableDesc

protected transient Map<Byte,TableDesc> spillTableDesc

mapJoinTables

protected transient Map<Byte,HashMapWrapper<AbstractMapJoinKey,MapJoinObjectValue>> mapJoinTables

noOuterJoin

protected transient boolean noOuterJoin

console

protected transient SessionState.LogHelper console
Constructor Detail

HashTableSinkOperator

public HashTableSinkOperator()

HashTableSinkOperator

public HashTableSinkOperator(MapJoinOperator mjop)
Method Detail

initializeOp

protected void initializeOp(org.apache.hadoop.conf.Configuration hconf)
                     throws HiveException
Description copied from class: Operator
Operator specific initialization.

Overrides:
initializeOp in class Operator<HashTableSinkDesc>
Throws:
HiveException

getStandardObjectInspectors

protected static HashMap<Byte,List<ObjectInspector>> getStandardObjectInspectors(Map<Byte,List<ObjectInspector>> aliasToObjectInspectors)

processOp

public void processOp(Object row,
                      int tag)
               throws HiveException
Description copied from class: Operator
Process the row.

Specified by:
processOp in class Operator<HashTableSinkDesc>
Parameters:
row - The object representing the row.
tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.
Throws:
HiveException

closeOp

public void closeOp(boolean abort)
             throws HiveException
Description copied from class: Operator
Operator specific close routine. Operators which inherents this class should overwrite this funtion for their specific cleanup routine.

Overrides:
closeOp in class Operator<HashTableSinkDesc>
Throws:
HiveException

getName

public String getName()
Implements the getName function for the Node Interface.

Specified by:
getName in interface Node
Overrides:
getName in class Operator<HashTableSinkDesc>
Returns:
the name of the operator

getOperatorName

public static String getOperatorName()

getType

public OperatorType getType()
Description copied from class: Operator
Return the type of the specific operator among the types in OperatorType.

Specified by:
getType in class Operator<HashTableSinkDesc>
Returns:
OperatorType.*


Copyright © 2011 The Apache Software Foundation