|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use LogicalOperator | |
---|---|
org.apache.pig | Public interfaces and classes for Pig. |
org.apache.pig.backend.hadoop.executionengine.physicalLayer | Implementation of physical operators that use hadoop as the execution engine and data storage. |
org.apache.pig.backend.local.executionengine.physicalLayer | |
org.apache.pig.impl.logicalLayer | The logical operators that represent a pig script and tools for manipulating those operators. |
org.apache.pig.impl.logicalLayer.optimizer | |
org.apache.pig.impl.logicalLayer.schema | |
org.apache.pig.impl.logicalLayer.validators | |
org.apache.pig.pen | |
org.apache.pig.pen.util |
Uses of LogicalOperator in org.apache.pig |
---|
Methods in org.apache.pig that return types with arguments of type LogicalOperator | |
---|---|
Map<LogicalOperator,DataBag> |
PigServer.getExamples(String alias)
|
Uses of LogicalOperator in org.apache.pig.backend.hadoop.executionengine.physicalLayer |
---|
Fields in org.apache.pig.backend.hadoop.executionengine.physicalLayer with type parameters of type LogicalOperator | |
---|---|
protected Map<LogicalOperator,PhysicalOperator> |
LogToPhyTranslationVisitor.LogToPhyMap
|
Uses of LogicalOperator in org.apache.pig.backend.local.executionengine.physicalLayer |
---|
Methods in org.apache.pig.backend.local.executionengine.physicalLayer that return types with arguments of type LogicalOperator | |
---|---|
Map<LogicalOperator,PhysicalOperator> |
LocalLogToPhyTranslationVisitor.getLogToPhyMap()
|
Uses of LogicalOperator in org.apache.pig.impl.logicalLayer |
---|
Subclasses of LogicalOperator in org.apache.pig.impl.logicalLayer | |
---|---|
class |
BinaryExpressionOperator
This abstract class represents the logical Binary Expression Operator The binary operator has two operands and an operator. |
class |
ExpressionOperator
|
class |
LOAdd
|
class |
LOAnd
|
class |
LOBinCond
|
class |
LOCast
|
class |
LOCogroup
|
class |
LOConst
|
class |
LOCross
|
class |
LODefine
|
class |
LODistinct
|
class |
LODivide
|
class |
LOEqual
|
class |
LOFilter
|
class |
LOForEach
|
class |
LOFRJoin
This is the logical operator for the Fragment Replicate Join It holds the user specified information and is responsible for the schema computation. |
class |
LOGenerate
|
class |
LOGreaterThan
|
class |
LOGreaterThanEqual
|
class |
LOIsNull
|
class |
LOLesserThan
|
class |
LOLesserThanEqual
|
class |
LOLimit
|
class |
LOLoad
|
class |
LOMapLookup
|
class |
LOMod
|
class |
LOMultiply
|
class |
LONegative
|
class |
LONot
|
class |
LONotEqual
|
class |
LOOr
|
class |
LOProject
LOProject is designed like a singly linked list; A few examples will illustrate the point about the linked list nature of the design; a = load 'input1' as (name, age); b = group a by name; foreach b generate a, a.name; The project operator occurs in two places in the above script: generate a(here) and a.name(here) In the first occurrence, we are trying to project the elements of the bag a; In order to retrieve the bag, we need to project the the second column ($1) or column number 1 (using the zero based index) from the input (the relation or bag b) In the second occurence, we are trying to project the first column ($0) or column number 0 from the bag a which in turn is the column number 1 in the relation b; As you can see, the nested structure or the singly linked list nature is clearly visible; Given that it's a singly linked list, the null pointer or the sentinel is marked explictly using the boolean variable mSentinel; The sentinel is marked true only when the input is a relational operator; This occurs when we create the innermost operator |
class |
LORegexp
|
class |
LOSort
|
class |
LOSplit
|
class |
LOSplitOutput
|
class |
LOStore
|
class |
LOStream
LOStream represents the specification of an external
command to be executed in a Pig Query. |
class |
LOSubtract
|
class |
LOUnion
|
class |
LOUserFunc
|
class |
UnaryExpressionOperator
This abstract class represents the logical Unary Expression Operator The unary operator has an operand and an operator. |
Fields in org.apache.pig.impl.logicalLayer with type parameters of type LogicalOperator | |
---|---|
static Map<LogicalOperator,LogicalOperator> |
LogicalPlanCloneHelper.mOpToCloneMap
|
static Map<LogicalOperator,LogicalOperator> |
LogicalPlanCloneHelper.mOpToCloneMap
|
Methods in org.apache.pig.impl.logicalLayer that return LogicalOperator | |
---|---|
LogicalOperator |
LOProject.getExpression()
|
LogicalOperator |
LOFRJoin.getFragOp()
|
LogicalOperator |
LODistinct.getInput()
|
LogicalOperator |
LOFilter.getInput()
|
LogicalOperator |
LOLimit.getInput()
|
LogicalOperator |
LOSort.getInput()
|
LogicalOperator |
LogicalPlan.getSingleLeafPlanOutputOp()
|
Methods in org.apache.pig.impl.logicalLayer that return types with arguments of type LogicalOperator | |
---|---|
MultiMap<LogicalOperator,LogicalPlan> |
LOCogroup.getGroupByPlans()
|
List<LogicalOperator> |
LOCogroup.getInputs()
|
List<LogicalOperator> |
LOCross.getInputs()
|
List<LogicalOperator> |
LOFRJoin.getInputs()
|
List<LogicalOperator> |
LOUnion.getInputs()
|
MultiMap<LogicalOperator,LogicalPlan> |
LOFRJoin.getJoinColPlans()
|
protected MultiMap<LogicalOperator,LogicalPlan> |
DotLOPrinter.getMultiInputNestedPlans(LogicalOperator op)
|
List<LogicalOperator> |
LOSplit.getOutputs()
|
Methods in org.apache.pig.impl.logicalLayer with parameters of type LogicalOperator | |
---|---|
void |
LOSplit.addOutput(LogicalOperator lOp)
|
protected String[] |
DotLOPrinter.getAttributes(LogicalOperator op)
|
protected MultiMap<LogicalOperator,LogicalPlan> |
DotLOPrinter.getMultiInputNestedPlans(LogicalOperator op)
|
protected String |
DotLOPrinter.getName(LogicalOperator op)
|
protected Collection<LogicalPlan> |
DotLOPrinter.getNestedPlans(LogicalOperator op)
|
void |
LOProject.setExpression(LogicalOperator exp)
|
void |
LOFRJoin.setFragOp(LogicalOperator fragOp)
|
void |
LOCogroup.switchGroupByPlanOp(LogicalOperator oldOp,
LogicalOperator newOp)
This does switch the mapping oldOp -> List of inner plans to newOp -> List of inner plans which is useful when there is a structural change in LogicalPlan |
void |
LOFRJoin.switchJoinColPlanOp(LogicalOperator oldOp,
LogicalOperator newOp)
|
protected void |
LOVisitor.visit(LogicalOperator lOp)
|
protected void |
LogicalPlanCloneHelper.visit(LogicalOperator op)
|
Constructors in org.apache.pig.impl.logicalLayer with parameters of type LogicalOperator | |
---|---|
LOFRJoin(LogicalPlan plan,
OperatorKey k,
MultiMap<LogicalOperator,LogicalPlan> joinColPlans,
boolean[] isInner,
LogicalOperator fragOp)
|
|
LOProject(LogicalPlan plan,
OperatorKey key,
LogicalOperator exp,
Integer projection)
|
|
LOProject(LogicalPlan plan,
OperatorKey key,
LogicalOperator exp,
List<Integer> projection)
|
|
LOStream(LogicalPlan plan,
OperatorKey k,
LogicalOperator input,
ExecutableManager exeManager,
StreamingCommand cmd)
Create a new LOStream with the given command. |
Constructor parameters in org.apache.pig.impl.logicalLayer with type arguments of type LogicalOperator | |
---|---|
LOCogroup(LogicalPlan plan,
OperatorKey k,
MultiMap<LogicalOperator,LogicalPlan> groupByPlans,
boolean[] isInner)
|
|
LOFRJoin(LogicalPlan plan,
OperatorKey k,
MultiMap<LogicalOperator,LogicalPlan> joinColPlans,
boolean[] isInner,
LogicalOperator fragOp)
|
|
LogicalPlanCloneHelper(LogicalPlan plan,
Map<LogicalOperator,LogicalOperator> origCloneMap)
|
|
LogicalPlanCloneHelper(LogicalPlan plan,
Map<LogicalOperator,LogicalOperator> origCloneMap)
|
|
LOSplit(LogicalPlan plan,
OperatorKey key,
ArrayList<LogicalOperator> outputs)
|
|
LOVisitor(LogicalPlan plan,
PlanWalker<LogicalOperator,LogicalPlan> walker)
|
Uses of LogicalOperator in org.apache.pig.impl.logicalLayer.optimizer |
---|
Methods in org.apache.pig.impl.logicalLayer.optimizer with parameters of type LogicalOperator | |
---|---|
protected void |
LogicalTransformer.fixUpContainedPlans(LogicalOperator after,
LogicalOperator newNode,
LogicalOperator before,
Map<Integer,Integer> projectionMapping)
Once a node has been inserted, inner plans associated with other nodes may have references to the node that has been replaced or moved. |
protected void |
LogicalTransformer.insertAfter(LogicalOperator after,
LogicalOperator newNode,
Map<Integer,Integer> projectionMapping)
Insert a node in after an existing nodes. |
protected void |
LogicalTransformer.insertBetween(LogicalOperator after,
LogicalOperator newNode,
LogicalOperator before,
Map<Integer,Integer> projectionMapping)
Insert a node in between two existing nodes. |
protected void |
LogicalTransformer.removeFromChain(LogicalOperator nodeToRemove,
Map<Integer,Integer> projectionMapping)
Remove a node in the middle of a linear chain. |
Method parameters in org.apache.pig.impl.logicalLayer.optimizer with type arguments of type LogicalOperator | |
---|---|
boolean |
ImplicitSplitInserter.check(List<LogicalOperator> nodes)
|
boolean |
OpLimitOptimizer.check(List<LogicalOperator> nodes)
|
boolean |
StreamOptimizer.check(List<LogicalOperator> nodes)
|
boolean |
TypeCastInserter.check(List<LogicalOperator> nodes)
|
void |
ImplicitSplitInserter.transform(List<LogicalOperator> nodes)
|
void |
OpLimitOptimizer.transform(List<LogicalOperator> nodes)
|
void |
StreamOptimizer.transform(List<LogicalOperator> nodes)
|
void |
TypeCastInserter.transform(List<LogicalOperator> nodes)
|
Constructor parameters in org.apache.pig.impl.logicalLayer.optimizer with type arguments of type LogicalOperator | |
---|---|
LogicalTransformer(LogicalPlan plan,
PlanWalker<LogicalOperator,LogicalPlan> walker)
|
Uses of LogicalOperator in org.apache.pig.impl.logicalLayer.schema |
---|
Methods in org.apache.pig.impl.logicalLayer.schema that return types with arguments of type LogicalOperator | |
---|---|
Map<String,LogicalOperator> |
Schema.FieldSchema.getCanonicalMap()
|
MultiMap<LogicalOperator,String> |
Schema.FieldSchema.getReverseCanonicalMap()
|
Methods in org.apache.pig.impl.logicalLayer.schema with parameters of type LogicalOperator | |
---|---|
void |
Schema.FieldSchema.setParent(String parentCanonicalName,
LogicalOperator parent)
|
Uses of LogicalOperator in org.apache.pig.impl.logicalLayer.validators |
---|
Methods in org.apache.pig.impl.logicalLayer.validators with parameters of type LogicalOperator | |
---|---|
protected void |
TypeCheckingVisitor.visit(LogicalOperator lOp)
|
Uses of LogicalOperator in org.apache.pig.pen |
---|
Methods in org.apache.pig.pen that return types with arguments of type LogicalOperator | |
---|---|
Map<LogicalOperator,DataBag> |
ExampleGenerator.getExamples()
|
Methods in org.apache.pig.pen with parameters of type LogicalOperator | |
---|---|
static Collection<IdentityHashSet<Tuple>> |
EquivalenceClasses.GetEquivalenceClasses(LogicalOperator op,
Map<LogicalOperator,DataBag> derivedData)
|
void |
DerivedDataVisitor.setOperatorToEvaluate(LogicalOperator op)
|
Method parameters in org.apache.pig.pen with type arguments of type LogicalOperator | |
---|---|
static Collection<IdentityHashSet<Tuple>> |
EquivalenceClasses.GetEquivalenceClasses(LogicalOperator op,
Map<LogicalOperator,DataBag> derivedData)
|
Constructors in org.apache.pig.pen with parameters of type LogicalOperator | |
---|---|
DerivedDataVisitor(LogicalOperator op,
PigContext pc,
Map<LOLoad,DataBag> baseData,
Map<LogicalOperator,PhysicalOperator> logToPhyMap,
PhysicalPlan physPlan)
|
Constructor parameters in org.apache.pig.pen with type arguments of type LogicalOperator | |
---|---|
AugmentBaseDataVisitor(LogicalPlan plan,
Map<LOLoad,DataBag> baseData,
Map<LogicalOperator,DataBag> derivedData)
|
|
DerivedDataVisitor(LogicalOperator op,
PigContext pc,
Map<LOLoad,DataBag> baseData,
Map<LogicalOperator,PhysicalOperator> logToPhyMap,
PhysicalPlan physPlan)
|
|
DerivedDataVisitor(LogicalPlan plan,
PigContext pc,
Map<LOLoad,DataBag> baseData,
Map<LogicalOperator,PhysicalOperator> logToPhyMap,
PhysicalPlan physPlan)
|
|
LineageTrimmingVisitor(LogicalPlan plan,
Map<LOLoad,DataBag> baseData,
Map<LogicalOperator,PhysicalOperator> LogToPhyMap,
PhysicalPlan physPlan,
PigContext pc)
|
Uses of LogicalOperator in org.apache.pig.pen.util |
---|
Methods in org.apache.pig.pen.util with parameters of type LogicalOperator | |
---|---|
static float |
MetricEvaluation.getCompleteness(LogicalOperator op,
Map<LogicalOperator,DataBag> exampleData,
Map<LogicalOperator,Collection<IdentityHashSet<Tuple>>> OperatorToEqClasses,
boolean overallCompleteness)
|
static float |
MetricEvaluation.getConciseness(LogicalOperator op,
Map<LogicalOperator,DataBag> exampleData,
Map<LogicalOperator,Collection<IdentityHashSet<Tuple>>> OperatorToEqClasses,
boolean overallConciseness)
|
static float |
MetricEvaluation.getRealness(LogicalOperator op,
Map<LogicalOperator,DataBag> exampleData,
boolean overallRealness)
|
static void |
DisplayExamples.PrintSimple(LogicalOperator op,
Map<LogicalOperator,DataBag> exampleData)
|
Method parameters in org.apache.pig.pen.util with type arguments of type LogicalOperator | |
---|---|
static float |
MetricEvaluation.getCompleteness(LogicalOperator op,
Map<LogicalOperator,DataBag> exampleData,
Map<LogicalOperator,Collection<IdentityHashSet<Tuple>>> OperatorToEqClasses,
boolean overallCompleteness)
|
static float |
MetricEvaluation.getCompleteness(LogicalOperator op,
Map<LogicalOperator,DataBag> exampleData,
Map<LogicalOperator,Collection<IdentityHashSet<Tuple>>> OperatorToEqClasses,
boolean overallCompleteness)
|
static float |
MetricEvaluation.getConciseness(LogicalOperator op,
Map<LogicalOperator,DataBag> exampleData,
Map<LogicalOperator,Collection<IdentityHashSet<Tuple>>> OperatorToEqClasses,
boolean overallConciseness)
|
static float |
MetricEvaluation.getConciseness(LogicalOperator op,
Map<LogicalOperator,DataBag> exampleData,
Map<LogicalOperator,Collection<IdentityHashSet<Tuple>>> OperatorToEqClasses,
boolean overallConciseness)
|
static float |
MetricEvaluation.getRealness(LogicalOperator op,
Map<LogicalOperator,DataBag> exampleData,
boolean overallRealness)
|
static void |
DisplayExamples.PrintSimple(LogicalOperator op,
Map<LogicalOperator,DataBag> exampleData)
|
static String |
DisplayExamples.PrintTabular(LogicalPlan lp,
Map<LogicalOperator,DataBag> exampleData)
|
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |