|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Uses of VisitorException in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer |
---|
Subclasses of VisitorException in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer | |
---|---|
class |
MRCompilerException
|
Methods in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer that throw VisitorException | |
---|---|
MROperPlan |
MRCompiler.compile()
The front-end method that the user calls to compile the plan. |
MROperPlan |
MapReduceLauncher.compile(PhysicalPlan php,
PigContext pc)
|
abstract void |
Launcher.explain(PhysicalPlan pp,
PigContext pc,
PrintStream ps,
String format,
boolean verbose)
Explain how a pig job will be executed on the underlying infrastructure. |
void |
MapReduceLauncher.explain(PhysicalPlan php,
PigContext pc,
PrintStream ps,
String format,
boolean verbose)
|
abstract PigStats |
Launcher.launchPig(PhysicalPlan php,
String grpName,
PigContext pc)
Method to launch pig for hadoop either for a cluster's job tracker or for a local job runner. |
PigStats |
MapReduceLauncher.launchPig(PhysicalPlan php,
String grpName,
PigContext pc)
|
void |
SampleOptimizer.visit()
|
void |
NativeMapReduceOper.visit(MROpPlanVisitor v)
|
void |
MapReduceOper.visit(MROpPlanVisitor v)
|
void |
PhyPlanSetter.visitAdd(Add add)
|
void |
PhyPlanSetter.visitAnd(POAnd and)
|
void |
PhyPlanSetter.visitCollectedGroup(POCollectedGroup mg)
|
void |
MRCompiler.visitCollectedGroup(POCollectedGroup op)
|
void |
PhyPlanSetter.visitCombinerPackage(POCombinerPackage pkg)
|
void |
PhyPlanSetter.visitComparisonFunc(POUserComparisonFunc compFunc)
|
void |
PhyPlanSetter.visitConstant(ConstantExpression cnst)
|
void |
MRCompiler.visitCross(POCross op)
|
void |
PhyPlanSetter.visitDemux(PODemux demux)
|
void |
PhyPlanSetter.visitDistinct(PODistinct distinct)
|
void |
MRCompiler.visitDistinct(PODistinct op)
|
void |
PhyPlanSetter.visitDivide(Divide dv)
|
void |
PhyPlanSetter.visitEqualTo(EqualToExpr eq)
|
void |
PhyPlanSetter.visitFilter(POFilter fl)
|
void |
MRCompiler.visitFilter(POFilter op)
|
void |
PhyPlanSetter.visitFRJoin(POFRJoin join)
|
void |
MRCompiler.visitFRJoin(POFRJoin op)
This is an operator which will have multiple inputs(= to number of join inputs) But it prunes off all inputs but the fragment input and creates separate MR jobs for each of the replicated inputs and uses these as the replicated files that are configured in the POFRJoin operator. |
void |
PhyPlanSetter.visitGlobalRearrange(POGlobalRearrange gr)
|
void |
MRCompiler.visitGlobalRearrange(POGlobalRearrange op)
|
void |
PhyPlanSetter.visitGreaterThan(GreaterThanExpr grt)
|
void |
PhyPlanSetter.visitGTOrEqual(GTOrEqualToExpr gte)
|
void |
PhyPlanSetter.visitIsNull(POIsNull isNull)
|
void |
PhyPlanSetter.visitJoinPackage(POJoinPackage joinPackage)
|
void |
PhyPlanSetter.visitLessThan(LessThanExpr lt)
|
void |
PhyPlanSetter.visitLimit(POLimit lim)
|
void |
MRCompiler.visitLimit(POLimit op)
|
void |
PhyPlanSetter.visitLoad(POLoad ld)
|
void |
MRCompiler.visitLoad(POLoad op)
|
void |
PhyPlanSetter.visitLocalRearrange(POLocalRearrange lr)
|
void |
MRCompiler.visitLocalRearrange(POLocalRearrange op)
|
void |
PhyPlanSetter.visitLTOrEqual(LTOrEqualToExpr lte)
|
void |
PhyPlanSetter.visitMergeCoGroup(POMergeCogroup mergeCoGrp)
|
void |
MRCompiler.visitMergeCoGroup(POMergeCogroup poCoGrp)
Leftmost relation is referred as base relation (this is the one fed into mappers.) First, close all MROpers except for first one (referred as baseMROPer) Then, create a MROper which will do indexing job (idxMROper) Connect idxMROper before the mappedMROper in the MRPlan. |
void |
PhyPlanSetter.visitMergeJoin(POMergeJoin join)
|
void |
MRCompiler.visitMergeJoin(POMergeJoin joinOp)
Since merge-join works on two inputs there are exactly two MROper predecessors identified as left and right. |
void |
PhyPlanSetter.visitMod(Mod mod)
|
void |
CombinerOptimizer.visitMROp(MapReduceOper mr)
|
void |
SampleOptimizer.visitMROp(MapReduceOper mr)
|
void |
KeyTypeDiscoveryVisitor.visitMROp(MapReduceOper mr)
|
void |
LimitAdjuster.visitMROp(MapReduceOper mr)
|
void |
SecondaryKeyOptimizer.visitMROp(MapReduceOper mr)
|
void |
AccumulatorOptimizer.visitMROp(MapReduceOper mr)
|
void |
PhyPlanSetter.visitMultiply(Multiply mul)
|
void |
PhyPlanSetter.visitNative(PONative nt)
|
void |
MRCompiler.visitNative(PONative op)
|
void |
PhyPlanSetter.visitNot(PONot not)
|
void |
PhyPlanSetter.visitNotEqualTo(NotEqualToExpr eq)
|
void |
PhyPlanSetter.visitOr(POOr or)
|
void |
PhyPlanSetter.visitPackage(POPackage pkg)
|
void |
MRCompiler.visitPackage(POPackage op)
|
void |
PhyPlanSetter.visitPOForEach(POForEach nfe)
|
void |
MRCompiler.visitPOForEach(POForEach op)
|
void |
PhyPlanSetter.visitProject(POProject proj)
|
void |
PhyPlanSetter.visitRegexp(PORegexp re)
|
void |
PhyPlanSetter.visitSkewedJoin(POSkewedJoin join)
|
void |
MRCompiler.visitSkewedJoin(POSkewedJoin op)
|
void |
PhyPlanSetter.visitSort(POSort sort)
|
void |
MRCompiler.visitSort(POSort op)
|
void |
PhyPlanSetter.visitSplit(POSplit spl)
|
void |
MRCompiler.visitSplit(POSplit op)
Compiles a split operator. |
void |
PhyPlanSetter.visitStore(POStore st)
|
void |
MRCompiler.visitStore(POStore op)
|
void |
PhyPlanSetter.visitStream(POStream stream)
|
void |
MRCompiler.visitStream(POStream op)
|
void |
PhyPlanSetter.visitSubtract(Subtract sub)
|
void |
PhyPlanSetter.visitUnion(POUnion un)
|
void |
MRCompiler.visitUnion(POUnion op)
|
void |
PhyPlanSetter.visitUserFunc(POUserFunc userFunc)
|
void |
UDFFinishVisitor.visitUserFunc(POUserFunc userFunc)
|
Uses of VisitorException in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.plans |
---|
Methods in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.plans that throw VisitorException | |
---|---|
void |
UDFFinder.visitComparisonFunc(POUserComparisonFunc compFunc)
|
void |
POPackageAnnotator.visitMROp(MapReduceOper mr)
|
void |
EndOfAllInputSetter.visitMROp(MapReduceOper mr)
|
void |
MROpPlanVisitor.visitMROp(MapReduceOper mr)
|
void |
MRPrinter.visitMROp(MapReduceOper mr)
|
void |
UDFFinder.visitSort(POSort op)
|
void |
UDFFinder.visitUserFunc(POUserFunc userFunc)
|
void |
ScalarPhyFinder.visitUserFunc(POUserFunc userFunc)
|
Uses of VisitorException in org.apache.pig.backend.hadoop.executionengine.physicalLayer |
---|
Subclasses of VisitorException in org.apache.pig.backend.hadoop.executionengine.physicalLayer | |
---|---|
class |
LogicalToPhysicalTranslatorException
|
Methods in org.apache.pig.backend.hadoop.executionengine.physicalLayer that throw VisitorException | |
---|---|
abstract void |
PhysicalOperator.visit(PhyPlanVisitor v)
|
Uses of VisitorException in org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators |
---|
Methods in org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators that throw VisitorException | |
---|---|
void |
POUserComparisonFunc.visit(PhyPlanVisitor v)
|
void |
Multiply.visit(PhyPlanVisitor v)
|
void |
Subtract.visit(PhyPlanVisitor v)
|
void |
POIsNull.visit(PhyPlanVisitor v)
|
void |
ConstantExpression.visit(PhyPlanVisitor v)
|
void |
NotEqualToExpr.visit(PhyPlanVisitor v)
|
void |
EqualToExpr.visit(PhyPlanVisitor v)
|
void |
POMapLookUp.visit(PhyPlanVisitor v)
|
abstract void |
ExpressionOperator.visit(PhyPlanVisitor v)
|
void |
Divide.visit(PhyPlanVisitor v)
|
void |
POAnd.visit(PhyPlanVisitor v)
|
void |
Add.visit(PhyPlanVisitor v)
|
void |
PORelationToExprProject.visit(PhyPlanVisitor v)
|
void |
LessThanExpr.visit(PhyPlanVisitor v)
|
void |
Mod.visit(PhyPlanVisitor v)
|
void |
POUserFunc.visit(PhyPlanVisitor v)
|
void |
POCast.visit(PhyPlanVisitor v)
|
void |
POBinCond.visit(PhyPlanVisitor v)
|
void |
PONot.visit(PhyPlanVisitor v)
|
void |
POOr.visit(PhyPlanVisitor v)
|
void |
GreaterThanExpr.visit(PhyPlanVisitor v)
|
void |
GTOrEqualToExpr.visit(PhyPlanVisitor v)
|
void |
PONegative.visit(PhyPlanVisitor v)
|
void |
POProject.visit(PhyPlanVisitor v)
|
void |
LTOrEqualToExpr.visit(PhyPlanVisitor v)
|
void |
PORegexp.visit(PhyPlanVisitor v)
|
Uses of VisitorException in org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans |
---|
Methods in org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans that throw VisitorException | |
---|---|
protected void |
PlanPrinter.breadthFirst()
|
protected String |
PlanPrinter.depthFirstPP()
|
void |
PlanPrinter.print(OutputStream printer)
|
void |
PlanPrinter.visit()
|
void |
PhyPlanVisitor.visitAdd(Add add)
|
void |
PhyPlanVisitor.visitAnd(POAnd and)
|
void |
PhyPlanVisitor.visitCollectedGroup(POCollectedGroup mg)
|
void |
PhyPlanVisitor.visitCombinerPackage(POCombinerPackage pkg)
|
void |
PhyPlanVisitor.visitComparisonFunc(POUserComparisonFunc compFunc)
|
void |
PhyPlanVisitor.visitConstant(ConstantExpression cnst)
|
void |
PhyPlanVisitor.visitCross(POCross cross)
|
void |
PhyPlanVisitor.visitDemux(PODemux demux)
|
void |
PhyPlanVisitor.visitDistinct(PODistinct distinct)
|
void |
PhyPlanVisitor.visitDivide(Divide dv)
|
void |
PhyPlanVisitor.visitEqualTo(EqualToExpr eq)
|
void |
PhyPlanVisitor.visitFilter(POFilter fl)
|
void |
PhyPlanVisitor.visitFRJoin(POFRJoin join)
|
void |
PhyPlanVisitor.visitGlobalRearrange(POGlobalRearrange gr)
|
void |
PhyPlanVisitor.visitGreaterThan(GreaterThanExpr grt)
|
void |
PhyPlanVisitor.visitGTOrEqual(GTOrEqualToExpr gte)
|
void |
PhyPlanVisitor.visitIsNull(POIsNull isNull)
|
void |
PhyPlanVisitor.visitJoinPackage(POJoinPackage joinPackage)
|
void |
PhyPlanVisitor.visitLessThan(LessThanExpr lt)
|
void |
PhyPlanVisitor.visitLimit(POLimit lim)
|
void |
PhyPlanVisitor.visitLoad(POLoad ld)
|
void |
PhyPlanVisitor.visitLocalRearrange(POLocalRearrange lr)
|
void |
PhyPlanVisitor.visitLTOrEqual(LTOrEqualToExpr lte)
|
void |
PhyPlanVisitor.visitMergeCoGroup(POMergeCogroup mergeCoGrp)
|
void |
PhyPlanVisitor.visitMergeJoin(POMergeJoin join)
|
void |
PhyPlanVisitor.visitMod(Mod mod)
|
void |
PhyPlanVisitor.visitMultiply(Multiply mul)
|
void |
PhyPlanVisitor.visitMultiQueryPackage(POMultiQueryPackage pkg)
|
void |
PhyPlanVisitor.visitNative(PONative nat)
|
void |
PhyPlanVisitor.visitNot(PONot not)
|
void |
PhyPlanVisitor.visitNotEqualTo(NotEqualToExpr eq)
|
void |
PhyPlanVisitor.visitOr(POOr or)
|
void |
PhyPlanVisitor.visitPackage(POPackage pkg)
|
void |
PhyPlanVisitor.visitPartitionRearrange(POPartitionRearrange pr)
|
void |
PhyPlanVisitor.visitPOForEach(POForEach nfe)
|
void |
PhyPlanVisitor.visitPOOptimizedForEach(POOptimizedForEach optimizedForEach)
|
void |
PhyPlanVisitor.visitProject(POProject proj)
|
void |
PhyPlanVisitor.visitRegexp(PORegexp re)
|
void |
PhyPlanVisitor.visitSkewedJoin(POSkewedJoin sk)
|
void |
PhyPlanVisitor.visitSort(POSort sort)
|
void |
PhyPlanVisitor.visitSplit(POSplit spl)
|
void |
PhyPlanVisitor.visitStore(POStore st)
|
void |
PhyPlanVisitor.visitStream(POStream stream)
|
void |
PhyPlanVisitor.visitSubtract(Subtract sub)
|
void |
PhyPlanVisitor.visitUnion(POUnion un)
|
void |
PhyPlanVisitor.visitUserFunc(POUserFunc userFunc)
|
Uses of VisitorException in org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators |
---|
Methods in org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators that throw VisitorException | |
---|---|
void |
POMergeCogroup.visit(PhyPlanVisitor v)
|
void |
POPartialAgg.visit(PhyPlanVisitor v)
|
void |
POSplit.visit(PhyPlanVisitor v)
|
void |
POOptimizedForEach.visit(PhyPlanVisitor v)
|
void |
PONative.visit(PhyPlanVisitor v)
|
void |
POStore.visit(PhyPlanVisitor v)
|
void |
POFilter.visit(PhyPlanVisitor v)
|
void |
POFRJoin.visit(PhyPlanVisitor v)
|
void |
POLocalRearrange.visit(PhyPlanVisitor v)
|
void |
POJoinPackage.visit(PhyPlanVisitor v)
|
void |
POSkewedJoin.visit(PhyPlanVisitor v)
|
void |
POStream.visit(PhyPlanVisitor v)
|
void |
POUnion.visit(PhyPlanVisitor v)
|
void |
PODemux.visit(PhyPlanVisitor v)
|
void |
POForEach.visit(PhyPlanVisitor v)
|
void |
POLimit.visit(PhyPlanVisitor v)
|
void |
POPackage.visit(PhyPlanVisitor v)
|
void |
PODistinct.visit(PhyPlanVisitor v)
|
void |
POMergeJoin.visit(PhyPlanVisitor v)
|
void |
POSort.visit(PhyPlanVisitor v)
|
void |
POGlobalRearrange.visit(PhyPlanVisitor v)
|
void |
POCross.visit(PhyPlanVisitor v)
|
void |
POPreCombinerLocalRearrange.visit(PhyPlanVisitor v)
|
void |
POLoad.visit(PhyPlanVisitor v)
|
void |
POCombinerPackage.visit(PhyPlanVisitor v)
|
void |
POMultiQueryPackage.visit(PhyPlanVisitor v)
|
void |
POCollectedGroup.visit(PhyPlanVisitor v)
|
Uses of VisitorException in org.apache.pig.backend.hadoop.executionengine.physicalLayer.util |
---|
Methods in org.apache.pig.backend.hadoop.executionengine.physicalLayer.util that throw VisitorException | |
---|---|
static LinkedList<POLoad> |
PlanHelper.getLoads(PhysicalPlan plan)
Get all the load operators in the plan in the right dependency order |
static LinkedList<PONative> |
PlanHelper.getNativeMRs(PhysicalPlan plan)
Get all the load operators in the plan in the right dependency order |
static LinkedList<POStore> |
PlanHelper.getStores(PhysicalPlan plan)
Get all the store operators in the plan in the right dependency order |
Uses of VisitorException in org.apache.pig.impl.logicalLayer.validators |
---|
Subclasses of VisitorException in org.apache.pig.impl.logicalLayer.validators | |
---|---|
class |
TypeCheckerException
|
Uses of VisitorException in org.apache.pig.impl.plan |
---|
Subclasses of VisitorException in org.apache.pig.impl.plan | |
---|---|
class |
PlanValidationException
|
Methods in org.apache.pig.impl.plan that throw VisitorException | |
---|---|
protected void |
DependencyOrderWalker.doAllPredecessors(O node,
Set<O> seen,
Collection<O> fifo)
|
protected void |
ReverseDependencyOrderWalker.doAllSuccessors(O node,
Set<O> seen,
Collection<O> fifo)
|
protected void |
PlanVisitor.popWalker()
Pop the next to previous walker off of the stack and set it as the current walker. |
void |
PlanVisitor.visit()
Entry point for visiting the plan. |
abstract void |
Operator.visit(V v)
Visit this node with the provided visitor. |
abstract void |
PlanWalker.walk(PlanVisitor<O,P> visitor)
Begin traversing the graph. |
void |
DepthFirstWalker.walk(PlanVisitor<O,P> visitor)
Begin traversing the graph. |
void |
DependencyOrderWalker.walk(PlanVisitor<O,P> visitor)
Begin traversing the graph. |
void |
ReverseDependencyOrderWalker.walk(PlanVisitor<O,P> visitor)
Begin traversing the graph. |
Uses of VisitorException in org.apache.pig.impl.plan.optimizer |
---|
Subclasses of VisitorException in org.apache.pig.impl.plan.optimizer | |
---|---|
class |
OptimizerException
|
Uses of VisitorException in org.apache.pig.newplan.logical.visitor |
---|
Methods in org.apache.pig.newplan.logical.visitor that throw VisitorException | |
---|---|
void |
TypeCheckingRelVisitor.visit(LOCross cs)
Return concatenated of all fields from all input operators If one of the inputs have no schema then we cannot construct the output schema. |
void |
TypeCheckingRelVisitor.visit(LODistinct op)
LODistinct, output schema should be the same as input |
void |
TypeCheckingRelVisitor.visit(LOSplit split)
The schema of split output will be the same as split input |
Uses of VisitorException in org.apache.pig.pen |
---|
Methods in org.apache.pig.pen that throw VisitorException | |
---|---|
void |
IllustratorAttacher.revisit(PhysicalPlan plan)
revisit an enhanced physical plan from MR compilation |
void |
IllustratorAttacher.visitAnd(POAnd and)
|
void |
IllustratorAttacher.visitCombinerPackage(POCombinerPackage pkg)
|
void |
IllustratorAttacher.visitComparisonFunc(POUserComparisonFunc compFunc)
|
void |
IllustratorAttacher.visitDemux(PODemux demux)
|
void |
IllustratorAttacher.visitDistinct(PODistinct distinct)
|
void |
IllustratorAttacher.visitEqualTo(EqualToExpr eq)
|
void |
IllustratorAttacher.visitFilter(POFilter fl)
|
void |
IllustratorAttacher.visitGreaterThan(GreaterThanExpr grt)
|
void |
IllustratorAttacher.visitGTOrEqual(GTOrEqualToExpr gte)
|
void |
IllustratorAttacher.visitIsNull(POIsNull isNull)
|
void |
IllustratorAttacher.visitJoinPackage(POJoinPackage joinPackage)
|
void |
IllustratorAttacher.visitLessThan(LessThanExpr lt)
|
void |
IllustratorAttacher.visitLimit(POLimit lim)
|
void |
IllustratorAttacher.visitLoad(POLoad ld)
|
void |
IllustratorAttacher.visitLocalRearrange(POLocalRearrange lr)
|
void |
IllustratorAttacher.visitLTOrEqual(LTOrEqualToExpr lte)
|
void |
IllustratorAttacher.visitMultiQueryPackage(POMultiQueryPackage pkg)
|
void |
IllustratorAttacher.visitNot(PONot not)
|
void |
IllustratorAttacher.visitNotEqualTo(NotEqualToExpr eq)
|
void |
IllustratorAttacher.visitOr(POOr or)
|
void |
IllustratorAttacher.visitPackage(POPackage pkg)
|
void |
PhysicalPlanResetter.visitPackage(POPackage pkg)
|
void |
IllustratorAttacher.visitPOForEach(POForEach nfe)
|
void |
IllustratorAttacher.visitPOOptimizedForEach(POOptimizedForEach optimizedForEach)
|
void |
IllustratorAttacher.visitProject(POProject proj)
|
void |
IllustratorAttacher.visitRegexp(PORegexp re)
|
void |
IllustratorAttacher.visitSort(POSort sort)
|
void |
IllustratorAttacher.visitSplit(POSplit spl)
|
void |
IllustratorAttacher.visitStore(POStore st)
|
void |
IllustratorAttacher.visitStream(POStream stream)
|
void |
IllustratorAttacher.visitUnion(POUnion un)
|
void |
IllustratorAttacher.visitUserFunc(POUserFunc userFunc)
|
Constructors in org.apache.pig.pen that throw VisitorException | |
---|---|
IllustratorAttacher(PhysicalPlan plan,
LineageTracer lineage,
int maxRecords,
Map<POLoad,LogicalSchema> poLoadToSchemaMap,
PigContext hadoopPigContext)
|
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |