|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.mapred.TaskTracker
public class TaskTracker
TaskTracker is a process that starts and tracks MR Tasks in a networked environment. It contacts the JobTracker for Task assignments and reporting results.
Nested Class Summary | |
---|---|
static class |
TaskTracker.Child
The main() for child processes. |
Field Summary | |
---|---|
static int |
FILE_NOT_FOUND
|
static long |
HEARTBEAT_INTERVAL
|
static Logger |
LOG
|
static int |
SUCCESS
|
static long |
TASKTRACKER_EXPIRY_INTERVAL
|
Constructor Summary | |
---|---|
TaskTracker(Configuration conf)
Start with the local machine name, and the default JobTracker |
|
TaskTracker(InetSocketAddress jobTrackAddr,
Configuration conf)
Start with the local machine name, and the addr of the target JobTracker |
Method Summary | |
---|---|
void |
close()
Close down the TaskTracker and all its components. |
void |
done(String taskid)
The task is done. |
void |
fsError(String message)
A child task had a local filesystem error. |
org.apache.hadoop.mapred.MapOutputFile |
getFile(String mapTaskId,
String reduceTaskId,
IntWritable partition)
Returns the output from the named map task destined for this partition. |
org.apache.hadoop.mapred.InterTrackerProtocol |
getJobClient()
The connection to the JobTracker, used by the TaskRunner for locating remote files. |
org.apache.hadoop.mapred.Task |
getTask(String taskid)
Called upon startup by the child process, to fetch Task data. |
static void |
main(String[] argv)
Start the TaskTracker, point toward the indicated JobTracker |
void |
mapOutputLost(String taskid)
A completed map task's output has been lost. |
void |
ping(String taskid)
Child checking to see if we're alive. |
void |
progress(String taskid,
float progress,
String state)
Called periodically to report Task progress, from 0.0 to 1.0. |
void |
reportDiagnosticInfo(String taskid,
String info)
Called when the task dies before completion, and we want to report back diagnostic info |
void |
run()
The server retry loop. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
public static final Logger LOG
public static final long HEARTBEAT_INTERVAL
public static final long TASKTRACKER_EXPIRY_INTERVAL
public static final int SUCCESS
public static final int FILE_NOT_FOUND
Constructor Detail |
---|
public TaskTracker(Configuration conf) throws IOException
IOException
public TaskTracker(InetSocketAddress jobTrackAddr, Configuration conf) throws IOException
IOException
Method Detail |
---|
public void close() throws IOException
IOException
public org.apache.hadoop.mapred.InterTrackerProtocol getJobClient()
public void run()
run
in interface Runnable
public org.apache.hadoop.mapred.MapOutputFile getFile(String mapTaskId, String reduceTaskId, IntWritable partition)
public org.apache.hadoop.mapred.Task getTask(String taskid) throws IOException
IOException
public void progress(String taskid, float progress, String state) throws IOException
taskid
- the id of the taskprogress
- value between zero and onestate
- description of task's current state
IOException
public void reportDiagnosticInfo(String taskid, String info) throws IOException
taskid
- the id of the task involvedinfo
- the text to report
IOException
public void ping(String taskid) throws IOException
IOException
public void done(String taskid) throws IOException
IOException
public void fsError(String message) throws IOException
IOException
public void mapOutputLost(String taskid) throws IOException
IOException
public static void main(String[] argv) throws IOException
IOException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |