|
Generated by JDiff |
|||||||
PREV PACKAGE NEXT PACKAGE FRAMES NO FRAMES | DETAIL: REMOVED | ADDED | CHANGED |
Removed Classes | |
|
Wraps a Slice in an InputSplit so it's usable by hadoop. |
Added Classes | |
|
A visitor to optimize plans that determines if a reduce plan can run in accumulative mode. |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Merge Join indexer is used to generate on the fly index for doing Merge Join efficiently. |
|
|
|
Used by Skewed Join |
|
A specialization of the default FileOutputCommitter to allow pig to inturn delegate calls to the OutputCommiter(s) of the StoreFunc(s)' OutputFormat(s). |
|
A wrapper around the actual RecordReader and loadfunc - this is needed for two reasons 1) To intercept the initialize call from hadoop and initialize the underlying actual RecordReader with the right Context object - this is achieved by looking up the Context corresponding to the input split this Reader is supposed to process 2) We need to give hadoop consistent key-value types - text and tuple respectively - so PigRecordReader will call underlying Loader's getNext() to get the Tuple value - the key is null text since key is not used in input to map() in Pig. |
|
|
|
|
|
|
|
|
|
|
|
A visitor to optimize plans that have a sample job that immediately follows a load/store only MR job. |
|
|
|
Changed Classes | |
|
|
|
This is compiler class that takes an MROperPlan and converts it into a JobControl object with the relevant dependency info maintained. |
|
|
|
The compiler that compiles a given physical plan into a DAG of MapReduce operators which can then be converted into the JobControl structure. |
|
An operator model for a Map Reduce job. |
|
This class is used to have a POStore write to DFS via a output collector/record writer. |
|
Sets the parent plan for all Physical Operators. |
|
|
|
|
|
A singleton class that implements the PigLogger interface for use in map reduce context. |
|
|
|
|
|
|
|
This class is the static Mapper & Reducer classes that are used by Pig to execute Pig Map Reduce jobs. |
|
|
|
This "specialized" map class is ONLY to be used in pig queries with order by a udf. |
|
|
|
This "specialized" reduce class is ONLY to be used in pig queries with order by a udf. |
|
The better half of PigInputFormat which is responsible for the Store functionality. |
|
Wrapper class which will delegate calls to the actual RecordWriter - this should only get called in the single store case. |
|
The main split class that maintains important information about the input split. |
|
|
||||||||
PREV PACKAGE NEXT PACKAGE FRAMES NO FRAMES |