JobLocalizer (Hadoop 1.2.2-SNAPSHOT API)

字段概要

字段
限定符和类型字段和说明

protected static String JOB_LOCAL_CTXT

protected JobConf ttConf

字段
限定符和类型	字段和说明
`protected static String`	`JOB_LOCAL_CTXT`
`protected JobConf`	`ttConf`

构造器概要

构造器
构造器和说明
`JobLocalizer(JobConf ttConf, String user, String jobid)`
`JobLocalizer(JobConf ttConf, String user, String jobid, String... localDirs)`

方法概要

方法
限定符和类型	方法和说明
`void`	`createJobDirs()` Prepare the job directories for a given job.
`void`	`createLocalDirs()`
`void`	`createUserDirs()` Initialize the local directories for a particular user on this TT.
`void`	`createWorkDir(JobConf jConf)`
`static long[]`	`downloadPrivateCache(Configuration conf)` Download the parts of the distributed cache that are private.
`Path`	`findCredentials()`
`void`	`initializeJobLogDir()` Create job log directory and set appropriate permissions for the directory.
`void`	`localizeJobFiles(JobID jobid, JobConf jConf, Path localJobFile, Path localJobTokenFile, TaskUmbilicalProtocol taskTracker)`
`void`	`localizeJobFiles(JobID jobid, JobConf jConf, Path localJobTokenFile, TaskUmbilicalProtocol taskTracker)`
`static void`	`main(String[] argv)`
`int`	`runSetup(String user, String jobid, Path localJobTokenFile, TaskUmbilicalProtocol taskTracker)`
`static void`	`writeLocalJobFile(Path jobFile, JobConf conf)` Write the task specific job-configuration file.

从类继承的方法 java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

ttConf
```
protected final JobConf ttConf
```

JOB_LOCAL_CTXT

protected static final String JOB_LOCAL_CTXT

另请参阅:: 常量字段值

构造器详细资料

JobLocalizer

public JobLocalizer(JobConf ttConf,
            String user,
            String jobid)
             throws IOException

抛出:: IOException

JobLocalizer

public JobLocalizer(JobConf ttConf,
            String user,
            String jobid,
            String... localDirs)
             throws IOException

抛出:: IOException

方法详细资料

createLocalDirs

public void createLocalDirs()
                     throws IOException

抛出:: IOException

createUserDirs
```
public void createUserDirs()
                    throws IOException
```
Initialize the local directories for a particular user on this TT. This involves creation and setting permissions of the following directories
- $mapred.local.dir/taskTracker/$user
- $mapred.local.dir/taskTracker/$user/jobcache
- $mapred.local.dir/taskTracker/$user/distcache
抛出:

IOException

createJobDirs
```
public void createJobDirs()
                   throws IOException
```
Prepare the job directories for a given job. To be called by the job localization code, only if the job is not already localized.
Here, we set 700 permissions on the job directories created on all disks. This we do so as to avoid any misuse by other users till the time TaskController.initializeJob(java.lang.String, java.lang.String, org.apache.hadoop.fs.Path, org.apache.hadoop.fs.Path, org.apache.hadoop.mapred.TaskUmbilicalProtocol, java.net.InetSocketAddress) is run at a later time to set proper private permissions on the job directories.

抛出:

IOException

initializeJobLogDir
```
public void initializeJobLogDir()
                         throws IOException
```
Create job log directory and set appropriate permissions for the directory.

抛出:

IOException

downloadPrivateCache
```
public static long[] downloadPrivateCache(Configuration conf)
                                   throws IOException
```
Download the parts of the distributed cache that are private.

参数:
conf - the job's configuration

返回:
the size of the archive objects

抛出:

IOException

localizeJobFiles

public void localizeJobFiles(JobID jobid,
                    JobConf jConf,
                    Path localJobTokenFile,
                    TaskUmbilicalProtocol taskTracker)
                      throws IOException,
                             InterruptedException

抛出:: IOException; InterruptedException

localizeJobFiles

public void localizeJobFiles(JobID jobid,
                    JobConf jConf,
                    Path localJobFile,
                    Path localJobTokenFile,
                    TaskUmbilicalProtocol taskTracker)
                      throws IOException,
                             InterruptedException

抛出:: IOException; InterruptedException

createWorkDir

public void createWorkDir(JobConf jConf)
                   throws IOException

抛出:: IOException

findCredentials

public Path findCredentials()
                     throws IOException

抛出:: IOException

runSetup

public int runSetup(String user,
           String jobid,
           Path localJobTokenFile,
           TaskUmbilicalProtocol taskTracker)
             throws IOException,
                    InterruptedException

抛出:: IOException; InterruptedException

main

public static void main(String[] argv)
                 throws IOException,
                        InterruptedException

抛出:: IOException; InterruptedException

writeLocalJobFile

public static void writeLocalJobFile(Path jobFile,
                     JobConf conf)
                              throws IOException

Write the task specific job-configuration file.

抛出:: IOException

类 JobLocalizer

字段概要

构造器概要

方法概要

从类继承的方法 java.lang.Object

字段详细资料

ttConf

JOB_LOCAL_CTXT

构造器详细资料

JobLocalizer

JobLocalizer

方法详细资料

createLocalDirs

createUserDirs

createJobDirs

initializeJobLogDir

downloadPrivateCache

localizeJobFiles

localizeJobFiles

createWorkDir

findCredentials

runSetup

main

writeLocalJobFile