|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.pig.backend.hadoop.executionengine.HExecutionEngine
public class HExecutionEngine
Field Summary | |
---|---|
protected DataStorage |
ds
|
static String |
JOB_TRACKER_LOCATION
|
protected org.apache.hadoop.mapred.JobClient |
jobClient
|
protected Map<OperatorKey,OperatorKey> |
logicalToPhysicalKeys
|
protected Map<OperatorKey,MapRedResult> |
materializedResults
|
protected Map<OperatorKey,ExecPhysicalOperator> |
physicalOpTable
|
protected PigContext |
pigContext
|
Constructor Summary | |
---|---|
HExecutionEngine(PigContext pigContext)
|
Method Summary | |
---|---|
Collection<String> |
activeScopes()
List scopes that are active in the back-end |
void |
close()
Clean-up and releasing of resources. |
PhysicalPlan |
compile(LogicalPlan plan,
Properties properties)
Compiles a logical plan into a physical plan, given a set of configuration properties that apply at the plan-level. |
List<ExecJob> |
execute(PhysicalPlan plan,
String jobName)
Execute the physical plan in blocking mode. |
void |
explain(PhysicalPlan plan,
PrintStream stream,
String format,
boolean verbose)
Explain executor specific information. |
Properties |
getConfiguration()
Provides configuration information about the execution engine itself. |
DataStorage |
getDataStorage()
|
org.apache.hadoop.mapred.JobClient |
getJobClient()
|
Map<OperatorKey,MapRedResult> |
getMaterializedResults()
|
Map<OperatorKey,ExecPhysicalOperator> |
getPhysicalOpTable()
|
Map<String,Object> |
getStatistics()
Provides statistics on the Execution Engine: number of nodes, node failure rates, average load, average job wait time... |
void |
init()
Place holder for possible initialization activities. |
void |
init(Properties properties)
|
void |
reclaimScope(String scope)
A mechanism to communicate to the back-end that a set of logical plans go out of scope |
Collection<ExecJob> |
runningJobs(Properties properties)
Return currently running jobs (can be useful for admin purposes) |
List<ExecJob> |
submit(PhysicalPlan plan,
String jobName)
Execute the physical plan in non-blocking mode |
void |
updateConfiguration(Properties newConfiguration)
Provides a way to dynamically change configuration parameters at the Execution Engine level. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
public static final String JOB_TRACKER_LOCATION
protected PigContext pigContext
protected DataStorage ds
protected org.apache.hadoop.mapred.JobClient jobClient
protected Map<OperatorKey,OperatorKey> logicalToPhysicalKeys
protected Map<OperatorKey,ExecPhysicalOperator> physicalOpTable
protected Map<OperatorKey,MapRedResult> materializedResults
Constructor Detail |
---|
public HExecutionEngine(PigContext pigContext)
Method Detail |
---|
public org.apache.hadoop.mapred.JobClient getJobClient()
public Map<OperatorKey,MapRedResult> getMaterializedResults()
public Map<OperatorKey,ExecPhysicalOperator> getPhysicalOpTable()
public DataStorage getDataStorage()
getDataStorage
in interface ExecutionEngine
public void init() throws ExecException
ExecutionEngine
init
in interface ExecutionEngine
ExecException
public void init(Properties properties) throws ExecException
ExecException
public Properties getConfiguration() throws ExecException
ExecutionEngine
getConfiguration
in interface ExecutionEngine
ExecException
public void updateConfiguration(Properties newConfiguration) throws ExecException
ExecutionEngine
updateConfiguration
in interface ExecutionEngine
newConfiguration
- - the new configuration settings
ExecException
public void close() throws ExecException
ExecutionEngine
close
in interface ExecutionEngine
ExecException
public Map<String,Object> getStatistics() throws ExecException
ExecutionEngine
getStatistics
in interface ExecutionEngine
ExecException
public PhysicalPlan compile(LogicalPlan plan, Properties properties) throws ExecException
ExecutionEngine
compile
in interface ExecutionEngine
plan
- logical plan to compile
ExecException
public List<ExecJob> execute(PhysicalPlan plan, String jobName) throws ExecException
ExecutionEngine
execute
in interface ExecutionEngine
plan
- PhysicalPlan to execute.jobName
- Name of this plan, will be used to identify the plan
ExecException
public List<ExecJob> submit(PhysicalPlan plan, String jobName) throws ExecException
ExecutionEngine
submit
in interface ExecutionEngine
plan
- PhysicalPlan to submit.jobName
- Name of this plan, will be used to identify the plan
ExecException
public void explain(PhysicalPlan plan, PrintStream stream, String format, boolean verbose)
ExecutionEngine
explain
in interface ExecutionEngine
plan
- PhysicalPlan to explainstream
- Stream to print output toformat
- Format to print inverbose
- Amount of information to printpublic Collection<ExecJob> runningJobs(Properties properties) throws ExecException
ExecutionEngine
runningJobs
in interface ExecutionEngine
ExecException
public Collection<String> activeScopes() throws ExecException
ExecutionEngine
activeScopes
in interface ExecutionEngine
ExecException
public void reclaimScope(String scope) throws ExecException
ExecutionEngine
reclaimScope
in interface ExecutionEngine
ExecException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |