Package org.apache.pig.backend.hadoop.executionengine.mapReduceLayer

Interface Summary

PigReducerEstimator	Interface to implement when you want to use a custom approach to estimating the number of reducers for a job.
PigStatsOutputSizeReader	Interface to implement when you want to customize the way of computing the size of output in PigStats.

Class Summary

AccumulatorOptimizer	A visitor to optimize plans that determines if a reduce plan can run in accumulative mode.
ColumnChainInfo
ColumnInfo
CombinerOptimizer	Optimize map reduce plans to use the combiner where possible.
DistinctCombiner	A special implementation of combiner used only for distinct.
DistinctCombiner.Combine
FileBasedOutputSizeReader	Class that computes the size of output for file-based systems.
IllustrateDummyReporter	Dummy implementation of StatusReporter for illustrate mode
InputSizeReducerEstimator	Class that estimates the number of reducers based on input size.
JobControlCompiler	This is compiler class that takes an MROperPlan and converts it into a JobControl object with the relevant dependency info maintained.
JobControlCompiler.PigBagWritableComparator
JobControlCompiler.PigBigDecimalWritableComparator
JobControlCompiler.PigBigIntegerWritableComparator
JobControlCompiler.PigBooleanWritableComparator
JobControlCompiler.PigCharArrayWritableComparator
JobControlCompiler.PigDateTimeWritableComparator
JobControlCompiler.PigDBAWritableComparator
JobControlCompiler.PigDoubleWritableComparator
JobControlCompiler.PigFloatWritableComparator
JobControlCompiler.PigGroupingBagWritableComparator
JobControlCompiler.PigGroupingBigDecimalWritableComparator
JobControlCompiler.PigGroupingBigIntegerWritableComparator
JobControlCompiler.PigGroupingBooleanWritableComparator
JobControlCompiler.PigGroupingCharArrayWritableComparator
JobControlCompiler.PigGroupingDateTimeWritableComparator
JobControlCompiler.PigGroupingDBAWritableComparator
JobControlCompiler.PigGroupingDoubleWritableComparator
JobControlCompiler.PigGroupingFloatWritableComparator
JobControlCompiler.PigGroupingIntWritableComparator
JobControlCompiler.PigGroupingLongWritableComparator
JobControlCompiler.PigGroupingPartitionWritableComparator
JobControlCompiler.PigGroupingTupleWritableComparator
JobControlCompiler.PigIntWritableComparator
JobControlCompiler.PigLongWritableComparator
JobControlCompiler.PigSecondaryKeyGroupComparator
JobControlCompiler.PigTupleWritableComparator
JobControlCompiler.PigWritableComparator
KeyTypeDiscoveryVisitor	A visitor to figure out the type of the key for the map plan this is needed when the key is null to create an appropriate NullableXXXWritable object
LimitAdjuster
LocalExecType	LocalExecType is the ExecType for local mode in Hadoop Mapreduce.
MapReduceLauncher	Main class that launches pig for Map Reduce
MapReduceOper	An operator model for a Map Reduce job.
MapReducePOStoreImpl	This class is used to have a POStore write to DFS via a output collector/record writer.
MergeJoinIndexer	Merge Join indexer is used to generate on the fly index for doing Merge Join efficiently.
MRCompiler	The compiler that compiles a given physical plan into a DAG of MapReduce operators which can then be converted into the JobControl structure.
MRExecType	MRExecType is the ExecType for distributed mode in Hadoop Mapreduce.
MRExecutionEngine
MRTaskContext
MRUtil
NativeMapReduceOper
PhyPlanSetter	Sets the parent plan for all Physical Operators.
PigBigDecimalRawComparator
PigBigIntegerRawComparator
PigBooleanRawComparator
PigBytesRawComparator
PigCombiner
PigCombiner.Combine
PigDateTimeRawComparator
PigDoubleRawComparator
PigFileInputFormat<K,V>
PigFloatRawComparator
PigGenericMapBase	This class is the base class for PigMapBase, which has slightly difference among different versions of hadoop.
PigGenericMapReduce	This class is the static Mapper & Reducer classes that are used by Pig to execute Pig Map Reduce jobs.
PigGenericMapReduce.Map
PigGenericMapReduce.MapWithComparator	This "specialized" map class is ONLY to be used in pig queries with order by a udf.
PigGenericMapReduce.MapWithPartitionIndex	Used by Skewed Join
PigGenericMapReduce.Reduce
PigGenericMapReduce.ReduceWithComparator	This "specialized" reduce class is ONLY to be used in pig queries with order by a udf.
PigHadoopLogger	A singleton class that implements the PigLogger interface for use in map reduce context.
PigInputFormat
PigIntRawComparator
PigLongRawComparator
PigMapOnly	This class is the static Mapper class used by Pig to execute Pig map only jobs.
PigMapOnly.Map
PigMapReduceCounter
PigMapReduceCounter.PigMapCounter	This class is the used only for simple RANK operation, namely row number mode.
PigMapReduceCounter.PigReduceCounter	This class is the used for RANK BY operations, independently if it is dense or not.
PigOutputCommitter	A specialization of the default FileOutputCommitter to allow pig to inturn delegate calls to the OutputCommiter(s) of the StoreFunc(s)' OutputFormat(s).
PigOutputFormat	The better half of PigInputFormat which is responsible for the Store functionality.
PigOutputFormat.PigRecordWriter	Wrapper class which will delegate calls to the actual RecordWriter - this should only get called in the single store case.
PigRecordReader	A wrapper around the actual RecordReader and loadfunc - this is needed for two reasons 1) To intercept the initialize call from hadoop and initialize the underlying actual RecordReader with the right Context object - this is achieved by looking up the Context corresponding to the input split this Reader is supposed to process 2) We need to give hadoop consistent key-value types - text and tuple respectively - so PigRecordReader will call underlying Loader's getNext() to get the Tuple value - the key is null text since key is not used in input to map() in Pig.
PigSecondaryKeyComparator
PigSequenceFileInputFormat<K,V>
PigSplit	The main split class that maintains important information about the input split.
PigTextInputFormat
PigTextOutputFormat
PigTextOutputFormat.PigLineRecordWriter
PigTextRawComparator
PigTupleDefaultRawComparator
PigTupleSortComparator
ProgressableReporter
RunJarSecurityManager
SampleOptimizer	A visitor to optimize plans that have a sample job that immediately follows a load/store only MR job.
SecondaryKeyOptimizer
SortKeyInfo
UDFFinishVisitor

Exception Summary

MRCompilerException