org.apache.hadoop.mapreduce.lib.output

类 FileOutputCommitter

java.lang.Object

org.apache.hadoop.mapreduce.OutputCommitter

org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter

直接已知子类:

CopyCommitter

public class FileOutputCommitter
extends OutputCommitter

An OutputCommitter that commits files specified in job output directory i.e. ${mapred.output.dir}.

字段概要

字段

限定符和类型	字段和说明
static String	SUCCEEDED_FILE_NAME
protected static String	TEMP_DIR_NAME Temporary directory name

构造器概要

构造器

构造器和说明
FileOutputCommitter(Path outputPath, TaskAttemptContext context) Create a file output committer

方法概要

方法

限定符和类型	方法和说明
void	abortJob(JobContext context, JobStatus.State state) Delete the temporary directory, including all of the work directories.
void	abortTask(TaskAttemptContext context) Delete the work directory
void	cleanupJob(JobContext context) 已过时。
void	commitJob(JobContext context) Delete the temporary directory, including all of the work directories.
void	commitTask(TaskAttemptContext context) Move the files from the work directory to the job output directory
Path	getWorkPath() Get the directory that the task should write results into
boolean	needsTaskCommit(TaskAttemptContext context) Did this task write any files in the work directory?
void	setupJob(JobContext context) Create the temporary directory that is the root of all of the task work directories.
void	setupTask(TaskAttemptContext context) No task setup required.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

TEMP_DIR_NAME

protected static final String TEMP_DIR_NAME

Temporary directory name

另请参阅:

常量字段值

SUCCEEDED_FILE_NAME

public static final String SUCCEEDED_FILE_NAME

另请参阅:

常量字段值

构造器详细资料

FileOutputCommitter

public FileOutputCommitter(Path outputPath,
                   TaskAttemptContext context)
                    throws IOException

Create a file output committer

参数:

outputPath - the job's output path

context - the task's context

抛出:

IOException

方法详细资料

setupJob

public void setupJob(JobContext context)
              throws IOException

Create the temporary directory that is the root of all of the task work directories.

指定者:

setupJob 在类中 OutputCommitter

参数:

context - the job's context

抛出:

IOException - if temporary output could not be created

commitJob

public void commitJob(JobContext context)
               throws IOException

Delete the temporary directory, including all of the work directories. This is called for all jobs whose final run state is SUCCEEDED

覆盖:

commitJob 在类中 OutputCommitter

参数:

context - the job's context.

抛出:

IOException

cleanupJob

@Deprecated
public void cleanupJob(JobContext context)
                throws IOException

已过时。

从类复制的说明: OutputCommitter

For cleaning up the job's output after job completion

覆盖:

cleanupJob 在类中 OutputCommitter

抛出:

IOException

abortJob

public void abortJob(JobContext context,
            JobStatus.State state)
              throws IOException

Delete the temporary directory, including all of the work directories.

覆盖:

abortJob 在类中 OutputCommitter

参数:

context - the job's context

state - final run state of the job, should be FAILED or KILLED

抛出:

IOException

setupTask

public void setupTask(TaskAttemptContext context)
               throws IOException

No task setup required.

指定者:

setupTask 在类中 OutputCommitter

参数:

context - Context of the task whose output is being written.

抛出:

IOException

commitTask

public void commitTask(TaskAttemptContext context)
                throws IOException

Move the files from the work directory to the job output directory

指定者:

commitTask 在类中 OutputCommitter

参数:

context - the task context

抛出:

IOException - if commit is not

abortTask

public void abortTask(TaskAttemptContext context)

Delete the work directory

指定者:

abortTask 在类中 OutputCommitter

needsTaskCommit

public boolean needsTaskCommit(TaskAttemptContext context)
                        throws IOException

Did this task write any files in the work directory?

指定者:

needsTaskCommit 在类中 OutputCommitter

参数:

context - the task's context

返回:

true/false

抛出:

IOException

getWorkPath

public Path getWorkPath()
                 throws IOException

Get the directory that the task should write results into

返回:

the work directory

抛出:

IOException