|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
StreamingCommand.HandleSpec
to a given StreamingCommand.Handle
BinaryStorage
is a simple, as-is, serializer/deserializer pair.BinaryStorage
with default buffer size for reading
inputs.
BinaryStorage
with the given buffer-size for
reading inputs.
InputHandler
to the OutputStream
from which it reads input and sends it to the managed process.
OutputHandler
to the InputStream
from which to read the output data of the managed process.
ExecutableManager
.
InputHandler
since there is no more input
to be sent to the managed process.
OutputHandler
.
ExecutableManager
.
ExecutableManager
depending on the ExecType.
InputHandler
for the given input specification
of the StreamingCommand
.
OutputHandler
for the given output specification
of the StreamingCommand
.
stdin
.stdout
.o
is a DoubleWritable with the same value.
ExecutableManager
manages an external executable which processes data
in a Pig query.ExecutableManager
.
StreamingCommand
for this StreamSpec
.
StreamingCommand
for the given alias.
PigContext.getProperties()
instead
Handle
.
StreamingCommand
.
InputType
HandleSpec
.
Tuple
of the managed process.
StreamingCommand
.
OutputType
.
MapRedUtil.getStoreFunc(JobConf)
- this will get the StoreFunc
reference to use in the RecordWriter.write()
MapRedUtil.getStoreConfig(JobConf)
- this will get the StoreConfig
reference which has metadata like the location (the string supplied with store statement in the script)
and the Schema
of the data.
HandleSpec
.
OutputFormat.getRecordWriter(FileSystem ignored, JobConf job,
String name, Progressable progress)
method to obtain a reference to the StoreConfig
object.
OutputFormat.getRecordWriter(FileSystem ignored, JobConf job,
String name, Progressable progress)
method to obtain a reference to the StoreFunc
object to be used by
that OutputFormat to perform the write() operation
HadoopExecutableManager
is a specialization of
ExecutableManager
and provides HDFS-specific support for secondary
outputs, task-logs etc.InputHandler
or OutputHandler
depending on the specification of the StreamingCommand
.Slicer
that split the hbase table into HBaseSlice
s.InputHandler
is responsible for handling the input to the
Pig-Streaming external command.LOStream
represents the specification of an external
command to be executed in a Pig Query.LOStream
with the given command.
value
.
OutputHandler
is responsible for handling the output of the
Pig-Streaming external command.PigException
class.Tuple
to the managed executable.
ExecutableManager
.
StreamingCommand
.
StreamingCommand
.
StreamingCommand
.
HandleSpec
.
StreamingCommand.HandleSpec
for the given StreamingCommand.Handle
of the
StreamSpec
.
StreamingCommand
.
HandleSpec
.
store
at location
.
Slice
in an InputSplit
so it's usable by hadoop.StreamingCommand
represents the specification of an external
command to be executed in a Pig Query.StreamingCommand
with the given command.
StreamingCommand.Handle
to communicate
with the external process.StreamingCommand.HandleSpec
with a given name using the default
PigStorage
serializer/deserializer.
StreamingCommand.HandleSpec
with a given name using the default
PigStorage
serializer/deserializer.
DataType
.
location
is parsable by this Slicer, and that
if the DataStorage is used by the Slicer, it's readable from there.
ExecType
of context
is LOCAL,
validation is not performed.
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |