org.apache.hadoop.mapred

类 FileOutputCommitter

java.lang.Object

org.apache.hadoop.mapreduce.OutputCommitter

org.apache.hadoop.mapred.OutputCommitter

org.apache.hadoop.mapred.FileOutputCommitter

public class FileOutputCommitter
extends OutputCommitter

An OutputCommitter that commits files specified in job output directory i.e. ${mapred.output.dir}.

字段概要

字段

限定符和类型	字段和说明
static org.apache.commons.logging.Log	LOG
static String	SUCCEEDED_FILE_NAME
static String	TEMP_DIR_NAME Temporary directory name

构造器概要

构造器

构造器和说明
FileOutputCommitter()

方法概要

方法

限定符和类型	方法和说明
void	abortJob(JobContext context, int runState) Delete the temporary directory, including all of the work directories.
void	abortTask(TaskAttemptContext context) Discard the task output
void	cleanupJob(JobContext context) 已过时。
void	commitJob(JobContext context) For committing job's output after successful job completion.
void	commitTask(TaskAttemptContext context) To promote the task's temporary output to final output location The task's output is moved to the job's output directory.
boolean	needsTaskCommit(TaskAttemptContext context) Check whether task needs a commit
void	setupJob(JobContext context) For the framework to setup the job output during initialization
void	setupTask(TaskAttemptContext context) Sets up output for the task.

从类继承的方法 org.apache.hadoop.mapred.OutputCommitter

abortJob, abortTask, cleanupJob, commitJob, commitTask, needsTaskCommit, setupJob, setupTask

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

LOG

public static final org.apache.commons.logging.Log LOG

TEMP_DIR_NAME

public static final String TEMP_DIR_NAME

Temporary directory name

另请参阅:

常量字段值

SUCCEEDED_FILE_NAME

public static final String SUCCEEDED_FILE_NAME

另请参阅:

常量字段值

构造器详细资料

FileOutputCommitter

public FileOutputCommitter()

方法详细资料

setupJob

public void setupJob(JobContext context)
              throws IOException

从类复制的说明: OutputCommitter

For the framework to setup the job output during initialization

指定者:

setupJob 在类中 OutputCommitter

参数:

context - Context of the job whose output is being written.

抛出:

IOException - if temporary output could not be created

commitJob

public void commitJob(JobContext context)
               throws IOException

从类复制的说明: OutputCommitter

For committing job's output after successful job completion. Note that this is invoked for jobs with final run state as JobStatus.SUCCEEDED.

覆盖:

commitJob 在类中 OutputCommitter

参数:

context - Context of the job whose output is being written.

抛出:

IOException

cleanupJob

@Deprecated
public void cleanupJob(JobContext context)
                throws IOException

已过时。

从类复制的说明: OutputCommitter

For cleaning up the job's output after job completion

覆盖:

cleanupJob 在类中 OutputCommitter

抛出:

IOException

abortJob

public void abortJob(JobContext context,
            int runState)
              throws IOException

Delete the temporary directory, including all of the work directories.

覆盖:

abortJob 在类中 OutputCommitter

参数:

context - the job's context

runState - final run state of the job, should be JobStatus.KILLED or JobStatus.FAILED

抛出:

IOException

setupTask

public void setupTask(TaskAttemptContext context)
               throws IOException

从类复制的说明: OutputCommitter

Sets up output for the task.

指定者:

setupTask 在类中 OutputCommitter

参数:

context - Context of the task whose output is being written.

抛出:

IOException

commitTask

public void commitTask(TaskAttemptContext context)
                throws IOException

从类复制的说明: OutputCommitter

To promote the task's temporary output to final output location The task's output is moved to the job's output directory.

指定者:

commitTask 在类中 OutputCommitter

参数:

context - Context of the task whose output is being written.

抛出:

IOException - if commit is not

abortTask

public void abortTask(TaskAttemptContext context)
               throws IOException

从类复制的说明: OutputCommitter

Discard the task output

指定者:

abortTask 在类中 OutputCommitter

抛出:

IOException

needsTaskCommit

public boolean needsTaskCommit(TaskAttemptContext context)
                        throws IOException

从类复制的说明: OutputCommitter

Check whether task needs a commit

指定者:

needsTaskCommit 在类中 OutputCommitter

返回:

true/false

抛出:

IOException