org.apache.hadoop.hive.ql.io
Class BucketizedHiveRecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>
java.lang.Object
org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader<K,V>
org.apache.hadoop.hive.ql.io.BucketizedHiveRecordReader<K,V>
- All Implemented Interfaces:
- org.apache.hadoop.mapred.RecordReader<K,V>
public class BucketizedHiveRecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>
- extends HiveContextAwareRecordReader<K,V>
BucketizedHiveRecordReader is a wrapper on a list of RecordReader. It behaves
similar as HiveRecordReader while it wraps a list of RecordReader from one
file.
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
split
protected final BucketizedHiveInputSplit split
inputFormat
protected final org.apache.hadoop.mapred.InputFormat inputFormat
jobConf
protected final org.apache.hadoop.mapred.JobConf jobConf
reporter
protected final org.apache.hadoop.mapred.Reporter reporter
curReader
protected org.apache.hadoop.mapred.RecordReader curReader
progress
protected long progress
idx
protected int idx
BucketizedHiveRecordReader
public BucketizedHiveRecordReader(org.apache.hadoop.mapred.InputFormat inputFormat,
BucketizedHiveInputSplit bucketizedSplit,
org.apache.hadoop.mapred.JobConf jobConf,
org.apache.hadoop.mapred.Reporter reporter)
throws IOException
- Throws:
IOException
doClose
public void doClose()
throws IOException
- Description copied from class:
HiveContextAwareRecordReader
- Close this
InputSplit
to future operations.
- Specified by:
doClose
in class HiveContextAwareRecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>
- Throws:
IOException
createKey
public K createKey()
createValue
public V createValue()
getPos
public long getPos()
throws IOException
- Throws:
IOException
getProgress
public float getProgress()
throws IOException
- Throws:
IOException
doNext
public boolean doNext(K key,
V value)
throws IOException
- Description copied from class:
HiveContextAwareRecordReader
- Reads the next key/value pair from the input for processing.
- Specified by:
doNext
in class HiveContextAwareRecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>
- Parameters:
key
- the key to read data intovalue
- the value to read data into
- Returns:
- true if a key/value was read, false if at EOF
- Throws:
IOException
initNextRecordReader
protected boolean initNextRecordReader()
throws IOException
- Get the record reader for the next chunk in this
BucketizedHiveRecordReader.
- Throws:
IOException
Copyright © 2011 The Apache Software Foundation