org.apache.hadoop.hive.ql.exec
Class ReduceSinkOperator

java.lang.Object
  extended by org.apache.hadoop.hive.ql.exec.Operator<T>
      extended by org.apache.hadoop.hive.ql.exec.TerminalOperator<ReduceSinkDesc>
          extended by org.apache.hadoop.hive.ql.exec.ReduceSinkOperator
All Implemented Interfaces:
Serializable, Node

public class ReduceSinkOperator
extends TerminalOperator<ReduceSinkDesc>
implements Serializable

Reduce Sink Operator sends output to the reduce stage.

See Also:
Serialized Form

Nested Class Summary
 
Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator
Operator.OperatorFunc, Operator.ProgressCounter, Operator.State
 
Field Summary
protected  ExprNodeEvaluator[] keyEval
          The evaluators for the key columns.
protected  ExprNodeEvaluator[] partitionEval
          The evaluators for the partition columns (CLUSTER BY or DISTRIBUTE BY in Hive language).
protected  ExprNodeEvaluator[] valueEval
          The evaluators for the value columns.
 
Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator
alias, beginTime, childOperators, childOperatorsArray, childOperatorsTag, colExprMap, conf, counterNames, counterNameToEnum, counters, done, fatalErrorCntr, groupKeyObject, id, inputObjInspectors, inputRows, LOG, numInputRowsCntr, numOutputRowsCntr, operatorId, out, outputObjInspector, outputRows, parentOperators, reporter, state, statsMap, timeTakenCntr, totalTime
 
Constructor Summary
ReduceSinkOperator()
           
 
Method Summary
 String getName()
          Implements the getName function for the Node Interface.
 int getType()
          Should be overridden to return the type of the specific operator among the types in OperatorType.
protected  void initializeOp(org.apache.hadoop.conf.Configuration hconf)
          Operator specific initialization.
 void processOp(Object row, int tag)
          Process the row.
 
Methods inherited from class org.apache.hadoop.hive.ql.exec.Operator
allInitializedParentsAreClosed, areAllParentsInitialized, assignCounterNameToEnum, augmentPlan, checkFatalErrors, close, closeOp, dump, dump, endGroup, fatalErrorMessage, forward, getChildOperators, getChildren, getColumnExprMap, getConf, getCounterNames, getCounterNameToEnum, getCounters, getDone, getExecContext, getGroupKeyObject, getIdentifier, getOperatorId, getParentOperators, getSchema, getStats, incrCounter, initEvaluators, initEvaluatorsAndReturnStruct, initialize, initializeChildren, initializeCounters, initializeLocalWork, initOperatorId, jobClose, logStats, passExecContext, preorderMap, process, removeChild, replaceChild, replaceParent, resetId, resetLastEnumUsed, resetStats, setAlias, setChildOperators, setColumnExprMap, setConf, setCounterNames, setCounterNameToEnum, setDone, setExecContext, setGroupKeyObject, setId, setOperatorId, setOutputCollector, setParentOperators, setReporter, setSchema, startGroup, updateCounters
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

keyEval

protected transient ExprNodeEvaluator[] keyEval
The evaluators for the key columns. Key columns decide the sort order on the reducer side. Key columns are passed to the reducer in the "key".


valueEval

protected transient ExprNodeEvaluator[] valueEval
The evaluators for the value columns. Value columns are passed to reducer in the "value".


partitionEval

protected transient ExprNodeEvaluator[] partitionEval
The evaluators for the partition columns (CLUSTER BY or DISTRIBUTE BY in Hive language). Partition columns decide the reducer that the current row goes to. Partition columns are not passed to reducer.

Constructor Detail

ReduceSinkOperator

public ReduceSinkOperator()
Method Detail

initializeOp

protected void initializeOp(org.apache.hadoop.conf.Configuration hconf)
                     throws HiveException
Description copied from class: Operator
Operator specific initialization.

Overrides:
initializeOp in class Operator<ReduceSinkDesc>
Throws:
HiveException

processOp

public void processOp(Object row,
                      int tag)
               throws HiveException
Description copied from class: Operator
Process the row.

Specified by:
processOp in class Operator<ReduceSinkDesc>
Parameters:
row - The object representing the row.
tag - The tag of the row usually means which parent this row comes from. Rows with the same tag should have exactly the same rowInspector all the time.
Throws:
HiveException

getName

public String getName()
Description copied from class: Operator
Implements the getName function for the Node Interface.

Specified by:
getName in interface Node
Overrides:
getName in class Operator<ReduceSinkDesc>
Returns:
the name of the operator

getType

public int getType()
Description copied from class: Operator
Should be overridden to return the type of the specific operator among the types in OperatorType.

Overrides:
getType in class Operator<ReduceSinkDesc>
Returns:
OperatorType.* or -1 if not overridden


Copyright © 2010 The Apache Software Foundation