org.apache.hadoop.tools

类 Logalyzer

java.lang.Object

org.apache.hadoop.tools.Logalyzer

public class Logalyzer
extends Object

Logalyzer: A utility tool for archiving and analyzing hadoop logs.

This tool supports archiving and anaylzing (sort/grep) of log-files. It takes as input a) Input uri which will serve uris of the logs to be archived. b) Output directory (not mandatory). b) Directory on dfs to archive the logs. c) The sort/grep patterns for analyzing the files and separator for boundaries. Usage: Logalyzer -archive -archiveDir -analysis -logs -grep -sort -separator

嵌套类概要

嵌套类

限定符和类型	类和说明
static class	Logalyzer.LogComparator A WritableComparator optimized for UTF8 keys of the logs.
static class	Logalyzer.LogRegexMapper<K extends WritableComparable> A Mapper that extracts text matching a regular expression.

构造器概要

构造器

构造器和说明
Logalyzer()

方法概要

方法

限定符和类型	方法和说明
void	doAnalyze(String inputFilesDirectory, String outputDirectory, String grepPattern, String sortColumns, String columnSeparator) doAnalyze:
void	doArchive(String logListURI, String archiveDirectory) doArchive: Workhorse function to archive log-files.
static void	main(String[] args)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

Logalyzer

public Logalyzer()

方法详细资料

doArchive

public void doArchive(String logListURI,
             String archiveDirectory)
               throws IOException

doArchive: Workhorse function to archive log-files.

参数:

logListURI - : The uri which will serve list of log-files to archive.

archiveDirectory - : The directory to store archived logfiles.

抛出:

IOException

doAnalyze

public void doAnalyze(String inputFilesDirectory,
             String outputDirectory,
             String grepPattern,
             String sortColumns,
             String columnSeparator)
               throws IOException

doAnalyze:

参数:

inputFilesDirectory - : Directory containing the files to be analyzed.

outputDirectory - : Directory to store analysis (output).

grepPattern - : Pattern to *grep* for.

sortColumns - : Sort specification for output.

columnSeparator - : Column separator.

抛出:

IOException

main

public static void main(String[] args)