|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.tools.rumen.ZombieJob
public class ZombieJob
ZombieJob
is a layer above LoggedJob
raw JSON objects.
Each ZombieJob
object represents a job in job history. For everything
that exists in job history, contents are returned unchanged faithfully. To
get input splits of a non-exist task, a non-exist task attempt, or an
ill-formed task attempt, proper objects are made up from statistical
sketches.
Constructor Summary | |
---|---|
ZombieJob(LoggedJob job,
ClusterStory cluster)
This constructor creates a ZombieJob with the same semantics as the
LoggedJob passed in this parameter |
|
ZombieJob(LoggedJob job,
ClusterStory cluster,
long seed)
This constructor creates a ZombieJob with the same semantics as the
LoggedJob passed in this parameter |
Method Summary | |
---|---|
InputSplit[] |
getInputSplits()
Get the input splits for the job. |
JobConf |
getJobConf()
Get the JobConf for the job. |
JobID |
getJobID()
Get the job ID |
LoggedJob |
getLoggedJob()
Get the underlining LoggedJob object read directly from the trace. |
TaskAttemptInfo |
getMapTaskAttemptInfoAdjusted(int taskNumber,
int taskAttemptNumber,
int locality)
Get a TaskAttemptInfo with a TaskAttemptID associated with
taskType, taskNumber, and taskAttemptNumber. |
String |
getName()
Get the job name. |
int |
getNumberMaps()
Get the number of maps in the JobStory . |
int |
getNumberReduces()
Get the number of reduce in the JobStory . |
int |
getNumLoggedMaps()
Getting the number of map tasks that are actually logged in the trace. |
int |
getNumLoggedReduces()
Getting the number of reduce tasks that are actually logged in the trace. |
Pre21JobHistoryConstants.Values |
getOutcome()
Get the outcome of the job execution. |
String |
getQueueName()
Get the queue where the job is submitted. |
long |
getSubmissionTime()
Get the job submission time. |
TaskAttemptInfo |
getTaskAttemptInfo(TaskType taskType,
int taskNumber,
int taskAttemptNumber)
Get a TaskAttemptInfo with a TaskAttemptID associated with
taskType, taskNumber, and taskAttemptNumber. |
TaskInfo |
getTaskInfo(TaskType taskType,
int taskNumber)
Get TaskInfo for a given task. |
String |
getUser()
Get the user who ran the job. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public ZombieJob(LoggedJob job, ClusterStory cluster, long seed)
ZombieJob
with the same semantics as the
LoggedJob
passed in this parameter
job
- The dead job this ZombieJob instance is based on.cluster
- The cluster topology where the dead job ran on. This argument can
be null if we do not have knowledge of the cluster topology.seed
- Seed for the random number generator for filling in information
not available from the ZombieJob.public ZombieJob(LoggedJob job, ClusterStory cluster)
ZombieJob
with the same semantics as the
LoggedJob
passed in this parameter
job
- The dead job this ZombieJob instance is based on.cluster
- The cluster topology where the dead job ran on. This argument can
be null if we do not have knowledge of the cluster topology.Method Detail |
---|
public JobConf getJobConf()
JobStory
JobConf
for the job.
getJobConf
in interface JobStory
JobConf
for the jobpublic InputSplit[] getInputSplits()
JobStory
getInputSplits
in interface JobStory
public String getName()
JobStory
getName
in interface JobStory
public JobID getJobID()
JobStory
getJobID
in interface JobStory
public int getNumberMaps()
JobStory
JobStory
.
getNumberMaps
in interface JobStory
Job
public int getNumberReduces()
JobStory
JobStory
.
getNumberReduces
in interface JobStory
Job
public Pre21JobHistoryConstants.Values getOutcome()
JobStory
getOutcome
in interface JobStory
public long getSubmissionTime()
JobStory
getSubmissionTime
in interface JobStory
public String getQueueName()
JobStory
getQueueName
in interface JobStory
public int getNumLoggedMaps()
public int getNumLoggedReduces()
public String getUser()
JobStory
getUser
in interface JobStory
public LoggedJob getLoggedJob()
LoggedJob
object read directly from the trace.
This is mainly for debugging.
LoggedJob
objectpublic TaskAttemptInfo getTaskAttemptInfo(TaskType taskType, int taskNumber, int taskAttemptNumber)
TaskAttemptInfo
with a TaskAttemptID
associated with
taskType, taskNumber, and taskAttemptNumber. This function does not care
about locality, and follows the following decision logic: 1. Make up a
TaskAttemptInfo
if the task attempt is missing in trace, 2. Make up
a TaskAttemptInfo
if the task attempt has a KILLED final status in
trace, 3. Otherwise (final state is SUCCEEDED or FAILED), construct the
TaskAttemptInfo
from the trace.
getTaskAttemptInfo
in interface JobStory
taskType
- TaskType
of the task-attempttaskNumber
- Partition number of the task-attempttaskAttemptNumber
- Attempt number of the task
TaskAttemptInfo
for the given task-attemptpublic TaskInfo getTaskInfo(TaskType taskType, int taskNumber)
JobStory
TaskInfo
for a given task.
getTaskInfo
in interface JobStory
taskType
- TaskType
of the tasktaskNumber
- Partition number of the task
TaskInfo
for the given taskpublic TaskAttemptInfo getMapTaskAttemptInfoAdjusted(int taskNumber, int taskAttemptNumber, int locality)
TaskAttemptInfo
with a TaskAttemptID
associated with
taskType, taskNumber, and taskAttemptNumber. This function considers
locality, and follows the following decision logic: 1. Make up a
TaskAttemptInfo
if the task attempt is missing in trace, 2. Make up
a TaskAttemptInfo
if the task attempt has a KILLED final status in
trace, 3. If final state is FAILED, construct a TaskAttemptInfo
from the trace, without considering locality. 4. If final state is
SUCCEEDED, construct a TaskAttemptInfo
from the trace, with runtime
scaled according to locality in simulation and locality in trace.
getMapTaskAttemptInfoAdjusted
in interface JobStory
taskNumber
- Partition number of the task-attempttaskAttemptNumber
- Attempt number of the tasklocality
- Data locality of the task as scheduled in simulation
TaskAttemptInfo
for the given task-attempt
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |