A B C D E F G I L M N O P R S T W 

A

aggregate(Tree, Tree, Tree, Environment) - Method in class org.apache.mrql.SparkEvaluator
The Aggregate physical operator

B

bag(JavaRDD<MRData>) - Static method in class org.apache.mrql.SparkEvaluator
Convert a Spark RDD into a lazy bag
binaryInputFormat() - Method in class org.apache.mrql.SparkEvaluator
return the FileInputFormat for binary files

C

close() - Method in class org.apache.mrql.SparkGeneratorInputFormat.GeneratorRecordReader
 
close() - Method in class org.apache.mrql.SparkParsedInputFormat.ParsedRecordReader
 
collect(DataSet, boolean) - Method in class org.apache.mrql.SparkMRQLFileInputFormat
materialize the entire dataset into a Bag
compareTo(MRData) - Method in class org.apache.mrql.MR_rdd
 
compute(Time) - Method in class org.apache.mrql.SparkFileInputStream.MRDataInputStream
 
containerData(JavaPairRDD<MRContainer, MRContainer>) - Static method in class org.apache.mrql.SparkEvaluator
 
createKey() - Method in class org.apache.mrql.SparkGeneratorInputFormat.GeneratorRecordReader
 
createKey() - Method in class org.apache.mrql.SparkParsedInputFormat.ParsedRecordReader
 
createValue() - Method in class org.apache.mrql.SparkGeneratorInputFormat.GeneratorRecordReader
 
createValue() - Method in class org.apache.mrql.SparkParsedInputFormat.ParsedRecordReader
 

D

data_source_dir_name - Static variable in class org.apache.mrql.SparkEvaluator
 
dependencies() - Method in class org.apache.mrql.SparkFileInputStream.MRDataInputStream
 
dump(String, Tree, MRData) - Method in class org.apache.mrql.SparkEvaluator
dump MRQL data into a sequence file
dump_source_dir() - Static method in class org.apache.mrql.SparkEvaluator
used by the master to send parsing details (eg, record types) to workers
dump_text(String, Tree, MRData) - Method in class org.apache.mrql.SparkEvaluator
dump MRQL data into text a CVS file

E

empty_bag - Static variable in class org.apache.mrql.SparkEvaluator
 
end - Variable in class org.apache.mrql.SparkParsedInputFormat.ParsedRecordReader
 
equals(Object) - Method in class org.apache.mrql.MR_rdd
 
eval(Tree, Environment, String) - Method in class org.apache.mrql.SparkEvaluator
Evaluate an MRQL physical plan using Spark
eval(Tree, Environment) - Method in class org.apache.mrql.SparkEvaluator
Evaluate an MRQL physical plan using Spark and print tracing info
evalD(Tree, Environment) - Method in class org.apache.mrql.SparkEvaluator
Evaluate MRQL physical operators using Spark
evaluate(Tree, Environment, DataSetFunction) - Static method in class org.apache.mrql.SparkStreaming
evaluate plan in stream mode: evaluate each batch of data and apply the function f

F

fsin - Variable in class org.apache.mrql.SparkParsedInputFormat.ParsedRecordReader
 

G

generatorInputFormat() - Method in class org.apache.mrql.SparkEvaluator
return the FileInputFormat for data generator files
getPos() - Method in class org.apache.mrql.SparkGeneratorInputFormat.GeneratorRecordReader
 
getPos() - Method in class org.apache.mrql.SparkParsedInputFormat.ParsedRecordReader
 
getProgress() - Method in class org.apache.mrql.SparkGeneratorInputFormat.GeneratorRecordReader
 
getProgress() - Method in class org.apache.mrql.SparkParsedInputFormat.ParsedRecordReader
 
getRecordReader(InputSplit, JobConf, Reporter) - Method in class org.apache.mrql.SparkBinaryInputFormat
 
getRecordReader(InputSplit, JobConf, Reporter) - Method in class org.apache.mrql.SparkGeneratorInputFormat
 
getRecordReader(InputSplit, JobConf, Reporter) - Method in class org.apache.mrql.SparkMRQLFileInputFormat
record reader for spark
getRecordReader(InputSplit, JobConf, Reporter) - Method in class org.apache.mrql.SparkParsedInputFormat
 

I

index - Variable in class org.apache.mrql.SparkGeneratorInputFormat.GeneratorRecordReader
 
init(Configuration) - Method in class org.apache.mrql.SparkEvaluator
initialize the Spark evaluator
initialize_query() - Method in class org.apache.mrql.SparkEvaluator
 

L

load_source_dir() - Static method in class org.apache.mrql.SparkEvaluator
executed by a worker when reading parsed input (see SparkParsedInputFormat)
loop(Tree, Environment) - Method in class org.apache.mrql.SparkEvaluator
Evaluate a loop a fixed # of times

M

materialize(Path) - Method in class org.apache.mrql.SparkGeneratorInputFormat
Insert all results from the generators stored in path into a Bag.
materialize(Path) - Method in class org.apache.mrql.SparkMRQLFileInputFormat
materialize the input file into a memory Bag
materializeAll() - Method in class org.apache.mrql.MR_rdd
 
MAX_CACHE_SIZE - Static variable in class org.apache.mrql.SparkEvaluator
 
MR_rdd - Class in org.apache.mrql
a wrapper of a JavaRDD<MRData> (stored in HDFS) as an MRData
MR_rdd(JavaRDD<MRData>) - Constructor for class org.apache.mrql.MR_rdd
 

N

new_configuration() - Method in class org.apache.mrql.SparkEvaluator
 
next(MRContainer, MRContainer) - Method in class org.apache.mrql.SparkBinaryInputFormat.BinaryInputRecordReader
 
next(MRContainer, MRContainer) - Method in class org.apache.mrql.SparkGeneratorInputFormat.GeneratorRecordReader
 
next(MRContainer, MRContainer) - Method in class org.apache.mrql.SparkParsedInputFormat.ParsedRecordReader
 

O

offset - Variable in class org.apache.mrql.SparkGeneratorInputFormat.GeneratorRecordReader
 
org.apache.mrql - package org.apache.mrql
 

P

P_0 - Static variable in class org.apache.mrql.PatternNames_282933004431473570
 
P_0 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_1 - Static variable in class org.apache.mrql.PatternNames_282933004431473570
 
P_1 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_10 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_11 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_12 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_13 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_14 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_15 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_16 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_17 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_18 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_19 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_2 - Static variable in class org.apache.mrql.PatternNames_282933004431473570
 
P_2 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_20 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_21 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_22 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_23 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_24 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_25 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_26 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_27 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_28 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_3 - Static variable in class org.apache.mrql.PatternNames_282933004431473570
 
P_3 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_4 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_5 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_6 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_7 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_8 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
P_9 - Static variable in class org.apache.mrql.PatternNames_6318533349645492632
 
parsedInputFormat() - Method in class org.apache.mrql.SparkEvaluator
return the FileInputFormat for parsed files (CSV, XML, JSON, etc)
parser - Variable in class org.apache.mrql.SparkParsedInputFormat.ParsedRecordReader
 
PatternNames_282933004431473570 - Class in org.apache.mrql
 
PatternNames_282933004431473570() - Constructor for class org.apache.mrql.PatternNames_282933004431473570
 
PatternNames_6318533349645492632 - Class in org.apache.mrql
 
PatternNames_6318533349645492632() - Constructor for class org.apache.mrql.PatternNames_6318533349645492632
 

R

rdd - Variable in class org.apache.mrql.MR_rdd
 
rdd() - Method in class org.apache.mrql.MR_rdd
 
rdd - Variable in class org.apache.mrql.RDDDataSource
 
RDDDataSource - Class in org.apache.mrql
 
RDDDataSource(JavaRDD<MRData>) - Constructor for class org.apache.mrql.RDDDataSource
 
reader - Variable in class org.apache.mrql.SparkGeneratorInputFormat.GeneratorRecordReader
 
readFields(DataInput) - Method in class org.apache.mrql.MR_rdd
 
reduce(MRData, Function) - Method in class org.apache.mrql.RDDDataSource
accumulate all dataset values
result - Variable in class org.apache.mrql.SparkBinaryInputFormat.BinaryInputRecordReader
 
result - Variable in class org.apache.mrql.SparkParsedInputFormat.ParsedRecordReader
 

S

shutdown(Configuration) - Method in class org.apache.mrql.SparkEvaluator
shutdown the Spark evaluator
size(Configuration) - Method in class org.apache.mrql.RDDDataSource
 
size - Variable in class org.apache.mrql.SparkGeneratorInputFormat.GeneratorRecordReader
 
slideDuration() - Method in class org.apache.mrql.SparkFileInputStream.MRDataInputStream
 
spark_context - Static variable in class org.apache.mrql.SparkEvaluator
 
SparkBinaryInputFormat - Class in org.apache.mrql
Input format for hadoop sequence files
SparkBinaryInputFormat() - Constructor for class org.apache.mrql.SparkBinaryInputFormat
 
SparkBinaryInputFormat.BinaryInputRecordReader - Class in org.apache.mrql
 
SparkBinaryInputFormat.BinaryInputRecordReader(FileSplit, JobConf) - Constructor for class org.apache.mrql.SparkBinaryInputFormat.BinaryInputRecordReader
 
SparkEvaluator - Class in org.apache.mrql
Evaluates physical plans in Apache Spark mode
SparkEvaluator() - Constructor for class org.apache.mrql.SparkEvaluator
 
SparkFileInputStream - Class in org.apache.mrql
A Spark InputDStream for MRQL InputFormats
SparkFileInputStream(JavaStreamingContext, String, boolean) - Constructor for class org.apache.mrql.SparkFileInputStream
 
SparkFileInputStream.MRDataInputStream - Class in org.apache.mrql
 
SparkFileInputStream.MRDataInputStream(JavaStreamingContext, String, boolean) - Constructor for class org.apache.mrql.SparkFileInputStream.MRDataInputStream
 
SparkGeneratorInputFormat - Class in org.apache.mrql
the FileInputFormat for data generators: it creates HDFS files, where each file contains an (offset,size) pair that generates the range of values [offset,offset+size]
SparkGeneratorInputFormat() - Constructor for class org.apache.mrql.SparkGeneratorInputFormat
 
SparkGeneratorInputFormat.GeneratorRecordReader - Class in org.apache.mrql
 
SparkGeneratorInputFormat.GeneratorRecordReader(FileSplit, Configuration) - Constructor for class org.apache.mrql.SparkGeneratorInputFormat.GeneratorRecordReader
 
SparkMRQLFileInputFormat - Class in org.apache.mrql
A superclass for all MRQL FileInputFormats
SparkMRQLFileInputFormat() - Constructor for class org.apache.mrql.SparkMRQLFileInputFormat
 
SparkParsedInputFormat - Class in org.apache.mrql
A FileInputFormat for text files (CVS, XML, JSON, ...)
SparkParsedInputFormat() - Constructor for class org.apache.mrql.SparkParsedInputFormat
 
SparkParsedInputFormat.ParsedRecordReader - Class in org.apache.mrql
 
SparkParsedInputFormat.ParsedRecordReader(FileSplit, Configuration, Class<? extends Parser>, Trees) - Constructor for class org.apache.mrql.SparkParsedInputFormat.ParsedRecordReader
 
SparkStreaming - Class in org.apache.mrql
Evaluates physical plans in Apache Spark stream mode
SparkStreaming() - Constructor for class org.apache.mrql.SparkStreaming
 
start() - Method in class org.apache.mrql.SparkFileInputStream.MRDataInputStream
 
start - Variable in class org.apache.mrql.SparkParsedInputFormat.ParsedRecordReader
 
stop() - Method in class org.apache.mrql.SparkFileInputStream.MRDataInputStream
 
stream_context - Static variable in class org.apache.mrql.SparkEvaluator
 
streaming(Tree, Environment, DataSetFunction) - Method in class org.apache.mrql.SparkEvaluator
evaluate plan in stream mode: evaluate each batch of data and apply the function f

T

take(int) - Method in class org.apache.mrql.RDDDataSource
return the first num values

W

write(DataOutput) - Method in class org.apache.mrql.MR_rdd
 
A B C D E F G I L M N O P R S T W 

Copyright © 2013-2015 The Apache Software Foundation. All Rights Reserved.