|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.util.ToolBase
org.apache.hadoop.mapred.JobClient
public class JobClient
JobClient interacts with the JobTracker network interface. This object implements the job-control interface, and should be the primary method by which user programs interact with the networked job system.
Nested Class Summary | |
---|---|
static class |
JobClient.TaskStatusFilter
|
Field Summary | |
---|---|
static int |
FILE_NOT_FOUND
|
static long |
HEARTBEAT_INTERVAL
|
static float |
MAX_INMEM_FILESIZE_FRACTION
Constant denoting the max size (in terms of the fraction of the total size of the filesys) of a map output file that we will try to keep in mem. |
static float |
MAX_INMEM_FILESYS_USE
Constant denoting when a merge of in memory files will be triggered |
static int |
SUCCESS
|
static long |
TASKTRACKER_EXPIRY_INTERVAL
|
Fields inherited from class org.apache.hadoop.util.ToolBase |
---|
conf |
Constructor Summary | |
---|---|
JobClient()
Build a job client, connect to the default job tracker |
|
JobClient(Configuration conf)
|
|
JobClient(InetSocketAddress jobTrackAddr,
Configuration conf)
Build a job client, connect to the indicated job tracker. |
Method Summary | |
---|---|
void |
close()
|
ClusterStatus |
getClusterStatus()
|
FileSystem |
getFs()
Get a filesystem handle. |
RunningJob |
getJob(String jobid)
Get an RunningJob object to track an ongoing job. |
TaskReport[] |
getMapTaskReports(String jobId)
Get the information of the current state of the map tasks of a job. |
TaskReport[] |
getReduceTaskReports(String jobId)
Get the information of the current state of the reduce tasks of a job. |
JobClient.TaskStatusFilter |
getTaskOutputFilter()
Returns task output filter. |
void |
init()
|
JobStatus[] |
jobsToComplete()
|
static void |
main(String[] argv)
|
int |
run(String[] argv)
execute the command with the given arguments |
static void |
runJob(JobConf job)
Utility that submits a job, then polls for progress until the job is complete. |
void |
setTaskOutputFilter(JobClient.TaskStatusFilter newValue)
Sets the output filter for tasks. |
RunningJob |
submitJob(JobConf job)
Submit a job to the MR system |
RunningJob |
submitJob(String jobFile)
Submit a job to the MR system |
Methods inherited from class org.apache.hadoop.util.ToolBase |
---|
doMain, getConf, setConf |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
public static final long HEARTBEAT_INTERVAL
public static final long TASKTRACKER_EXPIRY_INTERVAL
public static final float MAX_INMEM_FILESYS_USE
public static final float MAX_INMEM_FILESIZE_FRACTION
public static final int SUCCESS
public static final int FILE_NOT_FOUND
Constructor Detail |
---|
public JobClient()
public JobClient(Configuration conf) throws IOException
IOException
public JobClient(InetSocketAddress jobTrackAddr, Configuration conf) throws IOException
IOException
Method Detail |
---|
public void init() throws IOException
IOException
public void close() throws IOException
IOException
public FileSystem getFs() throws IOException
IOException
public RunningJob submitJob(String jobFile) throws FileNotFoundException, InvalidJobConfException, IOException
FileNotFoundException
InvalidJobConfException
IOException
public RunningJob submitJob(JobConf job) throws FileNotFoundException, InvalidJobConfException, IOException
FileNotFoundException
InvalidJobConfException
IOException
public RunningJob getJob(String jobid) throws IOException
IOException
public TaskReport[] getMapTaskReports(String jobId) throws IOException
jobId
- the job to query
IOException
public TaskReport[] getReduceTaskReports(String jobId) throws IOException
jobId
- the job to query
IOException
public ClusterStatus getClusterStatus() throws IOException
IOException
public JobStatus[] jobsToComplete() throws IOException
IOException
public static void runJob(JobConf job) throws IOException
IOException
public void setTaskOutputFilter(JobClient.TaskStatusFilter newValue)
newValue
- task filter.public JobClient.TaskStatusFilter getTaskOutputFilter()
public int run(String[] argv) throws Exception
Tool
run
in interface Tool
argv
- command specific arguments
Exception
public static void main(String[] argv) throws Exception
Exception
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |