org.apache.hadoop.mapred

类 DefaultTaskController

java.lang.Object

org.apache.hadoop.mapred.TaskController

org.apache.hadoop.mapred.DefaultTaskController

所有已实现的接口:

Configurable

public class DefaultTaskController
extends TaskController

The default implementation for controlling tasks. This class provides an implementation for launching and killing tasks that need to be run as the tasktracker itself. Hence, many of the initializing or cleanup methods are not required here.
NOTE: This class is internal only class and not intended for users!!

字段概要

从类继承的字段 org.apache.hadoop.mapred.TaskController

allocator, COMMAND_FILE, localStorage, TASK_LAUNCH_SCRIPT_PERMISSION

构造器概要

构造器

构造器和说明
DefaultTaskController()

方法概要

方法

限定符和类型	方法和说明
void	createLogDir(TaskAttemptID taskID, boolean isCleanup) Creates task log dir
void	deleteAsUser(String user, String subDir) Delete the user's files under all of the task tracker root directories.
void	deleteLogAsUser(String user, String subDir) Delete the user's files under the userlogs directory.
void	initializeJob(String user, String jobid, Path credentials, Path jobConf, TaskUmbilicalProtocol taskTracker, InetSocketAddress ttAddr) This routine initializes the local file system for running a job.
int	launchTask(String user, String jobId, String attemptId, List<String> setup, List<String> jvmArguments, File currentWorkDirectory, String stdout, String stderr) Create all of the directories for the task and launches the child jvm.
void	setConf(Configuration conf) Set the configuration to be used by this object.
void	setup(LocalDirAllocator allocator, org.apache.hadoop.mapred.TaskTracker.LocalStorage localStorage) Does initialization and setup.
void	signalTask(String user, int taskPid, ProcessTree.Signal signal) Send a signal to a task pid as the user.
void	truncateLogsAsUser(String user, List<Task> allAttempts) Run the passed command as the user

从类继承的方法 org.apache.hadoop.mapred.TaskController

getConf, getLocalDirs, getRunAsUser, logOutput, writeCommand

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

DefaultTaskController

public DefaultTaskController()

方法详细资料

setConf

public void setConf(Configuration conf)

从接口复制的说明: Configurable

Set the configuration to be used by this object.

指定者:

setConf 在接口中 Configurable

覆盖:

setConf 在类中 TaskController

createLogDir

public void createLogDir(TaskAttemptID taskID,
                boolean isCleanup)
                  throws IOException

从类复制的说明: TaskController

Creates task log dir

指定者:

createLogDir 在类中 TaskController

参数:

taskID - ID of the task

isCleanup - If the task is cleanup task or not

抛出:

IOException

launchTask

public int launchTask(String user,
             String jobId,
             String attemptId,
             List<String> setup,
             List<String> jvmArguments,
             File currentWorkDirectory,
             String stdout,
             String stderr)
               throws IOException

Create all of the directories for the task and launches the child jvm.

指定者:

launchTask 在类中 TaskController

参数:

user - the user name

attemptId - the attempt id

jobId - the jobId in question

setup - list of shell commands to execute before the jvm

jvmArguments - list of jvm arguments

currentWorkDirectory - the full path of the cwd for the task

stdout - the file to redirect stdout to

stderr - the file to redirect stderr to

返回:

the exit code for the task

抛出:

IOException

initializeJob

public void initializeJob(String user,
                 String jobid,
                 Path credentials,
                 Path jobConf,
                 TaskUmbilicalProtocol taskTracker,
                 InetSocketAddress ttAddr)
                   throws IOException,
                          InterruptedException

This routine initializes the local file system for running a job. Details:

• Copies the credentials file from the TaskTracker's private space to the job's private space
• Creates the job work directory and set TaskTracker.JOB_LOCAL_DIR in the configuration
• Downloads the job.jar, unjars it, and updates the configuration to reflect the localized path of the job.jar
• Creates a base JobConf in the job's private space
• Sets up the distributed cache
• Sets up the user logs directory for the job

This method must be invoked in the access control context of the job owner user. This is because the distributed cache is also setup here and the access to the hdfs files requires authentication tokens in case where security is enabled.

指定者:

initializeJob 在类中 TaskController

参数:

user - the user in question (the job owner)

jobid - the ID of the job in question

credentials - the path to the credentials file that the TaskTracker downloaded

jobConf - the path to the job configuration file that the TaskTracker downloaded

taskTracker - the connection to the task tracker

ttAddr - the tasktracker's RPC address

抛出:

IOException

InterruptedException

signalTask

public void signalTask(String user,
              int taskPid,
              ProcessTree.Signal signal)

从类复制的说明: TaskController

Send a signal to a task pid as the user.

指定者:

signalTask 在类中 TaskController

参数:

user - the user name

taskPid - the pid of the task

signal - the id of the signal to send

deleteAsUser

public void deleteAsUser(String user,
                String subDir)
                  throws IOException

Delete the user's files under all of the task tracker root directories.

指定者:

deleteAsUser 在类中 TaskController

参数:

user - the user name

subDir - the path relative to the user's subdirectory under the task tracker root directories.

抛出:

IOException

deleteLogAsUser

public void deleteLogAsUser(String user,
                   String subDir)
                     throws IOException

Delete the user's files under the userlogs directory.

指定者:

deleteLogAsUser 在类中 TaskController

参数:

user - the user to work as

subDir - the path under the userlogs directory.

抛出:

IOException

truncateLogsAsUser

public void truncateLogsAsUser(String user,
                      List<Task> allAttempts)
                        throws IOException

从类复制的说明: TaskController

Run the passed command as the user

指定者:

truncateLogsAsUser 在类中 TaskController

allAttempts - the list of attempts that the JVM ran

抛出:

IOException

setup

public void setup(LocalDirAllocator allocator,
         org.apache.hadoop.mapred.TaskTracker.LocalStorage localStorage)

从类复制的说明: TaskController

Does initialization and setup.

指定者:

setup 在类中 TaskController

参数:

allocator - the local dir allocator to use

localStorage - local storage to obtain dirs from