|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.pig.impl.plan.Operator<PhyPlanVisitor>
org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLoad
public class POLoad
The load operator which is used in two ways: 1) As a local operator it can be used to load files 2) In the Map Reduce setting, it is used to create jobs from MapReduce operators which keep the loads and stores in the Map and Reduce Plans till the job is created
Field Summary |
---|
Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator |
---|
dummyBag, dummyBool, dummyDBA, dummyDouble, dummyFloat, dummyInt, dummyLong, dummyMap, dummyString, dummyTuple, input, inputAttached, inputs, lineageTracer, outputs, parentPlan, pigLogger, reporter, requestedParallelism, res, resultType, serialVersionUID |
Fields inherited from class org.apache.pig.impl.plan.Operator |
---|
mKey |
Constructor Summary | |
---|---|
POLoad(OperatorKey k,
boolean splittable)
|
|
POLoad(OperatorKey k,
FileSpec lFile,
boolean splittable)
|
|
POLoad(OperatorKey k,
FileSpec lFile,
long offset,
boolean splittable)
|
|
POLoad(OperatorKey k,
int rp,
FileSpec lFile,
boolean splittable)
|
Method Summary | |
---|---|
FileSpec |
getLFile()
|
Result |
getNext(Tuple t)
The main method used by this operator's successor to read tuples from the specified file using the specified load function. |
PigContext |
getPc()
|
boolean |
isSplittable()
|
String |
name()
|
void |
setLFile(FileSpec file)
|
void |
setPc(PigContext pc)
|
void |
setUp()
Set up the loader by 1) Instantiating the load func 2) Opening an input stream to the specified file and 3) Binding to the input stream at the specified offset. |
boolean |
supportsMultipleInputs()
Indicates whether this operator supports multiple inputs. |
boolean |
supportsMultipleOutputs()
Indicates whether this operator supports multiple outputs. |
void |
tearDown()
At the end of processing, the inputstream is closed using this method |
void |
visit(PhyPlanVisitor v)
Visit this node with the provided visitor. |
Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator |
---|
attachInput, clone, cloneHelper, detachInput, getInputs, getLogger, getNext, getNext, getNext, getNext, getNext, getNext, getNext, getNext, getNext, getPigLogger, getRequestedParallelism, getResultType, isBlocking, isInputAttached, processInput, reset, setInputs, setLineageTracer, setParentPlan, setPigLogger, setReporter, setRequestedParallelism, setResultType |
Methods inherited from class org.apache.pig.impl.plan.Operator |
---|
compareTo, equals, getOperatorKey, getProjectionMap, hashCode, regenerateProjectionMap, rewire, toString, unsetProjectionMap |
Methods inherited from class java.lang.Object |
---|
finalize, getClass, notify, notifyAll, wait, wait, wait |
Constructor Detail |
---|
public POLoad(OperatorKey k, boolean splittable)
public POLoad(OperatorKey k, FileSpec lFile, boolean splittable)
public POLoad(OperatorKey k, FileSpec lFile, long offset, boolean splittable)
public POLoad(OperatorKey k, int rp, FileSpec lFile, boolean splittable)
Method Detail |
---|
public void setUp() throws IOException
IOException
public void tearDown() throws IOException
IOException
public Result getNext(Tuple t) throws ExecException
getNext
in class PhysicalOperator
ExecException
public String name()
name
in class Operator<PhyPlanVisitor>
public boolean supportsMultipleInputs()
Operator
supportsMultipleInputs
in class Operator<PhyPlanVisitor>
public boolean supportsMultipleOutputs()
Operator
supportsMultipleOutputs
in class Operator<PhyPlanVisitor>
public void visit(PhyPlanVisitor v) throws VisitorException
Operator
visit
in class PhysicalOperator
v
- Visitor to visit with.
VisitorException
- if the visitor has a problem.public FileSpec getLFile()
public void setLFile(FileSpec file)
public PigContext getPc()
public void setPc(PigContext pc)
public boolean isSplittable()
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |