public final class MapReduceOperation extends MapReducePlan
Modifier and Type | Class and Description |
---|---|
static class |
MapReduceOperation.MRContainerPartitioner |
Plan.MRContainerKeyComparator
cache, conf, counter_container, counter_key, max_input_files, temporary_paths, value_container
Constructor and Description |
---|
MapReduceOperation() |
Modifier and Type | Method and Description |
---|---|
static DataSet |
mapReduce(Tree map_fnc,
Tree combine_fnc,
Tree reduce_fnc,
Tree acc_fnc,
Tree zero,
DataSet source,
int num_reduces,
String stop_counter,
boolean orderp)
The MapReduce physical operator
|
aggregate, closure, outputRecords, repeat, setupSplits, setupSplits
, binarySource, binarySource, clean, collect, collect, distribute_compiled_arguments, fileCache, functional_argument, generator, generator, getCache, merge, merge, new_path, parsedSource, parsedSource, print_stream, setCache, size
public static final DataSet mapReduce(Tree map_fnc, Tree combine_fnc, Tree reduce_fnc, Tree acc_fnc, Tree zero, DataSet source, int num_reduces, String stop_counter, boolean orderp) throws Exception
map_fnc
- the mapper functioncombine_fnc
- optional in-mapper combiner functionreduce_fnc
- the reducer functionacc_fnc
- optional accumulator functionzero
- optional the zero value for the accumulatorsource
- the input data sourcenum_reduces
- number of reducersstop_counter
- optional counter used in repeat operationorderp
- does the result need to be ordered?Exception
Copyright © 2013-2015 The Apache Software Foundation. All Rights Reserved.