org.apache.hadoop.hive.ql.io
Class BucketizedHiveRecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>

java.lang.Object
  extended by org.apache.hadoop.hive.ql.io.BucketizedHiveRecordReader<K,V>
All Implemented Interfaces:
org.apache.hadoop.mapred.RecordReader<K,V>

public class BucketizedHiveRecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>
extends Object
implements org.apache.hadoop.mapred.RecordReader<K,V>

BucketizedHiveRecordReader is a wrapper on a list of RecordReader. It behaves similar as HiveRecordReader while it wraps a list of RecordReader from one file.


Field Summary
protected  org.apache.hadoop.mapred.RecordReader curReader
           
protected  int idx
           
protected  org.apache.hadoop.mapred.InputFormat inputFormat
           
protected  org.apache.hadoop.mapred.JobConf jobConf
           
protected  long progress
           
protected  org.apache.hadoop.mapred.Reporter reporter
           
protected  BucketizedHiveInputSplit split
           
 
Constructor Summary
BucketizedHiveRecordReader(org.apache.hadoop.mapred.InputFormat inputFormat, BucketizedHiveInputSplit bucketizedSplit, org.apache.hadoop.mapred.JobConf jobConf, org.apache.hadoop.mapred.Reporter reporter)
           
 
Method Summary
 void close()
           
 K createKey()
           
 V createValue()
           
 long getPos()
           
 float getProgress()
           
protected  boolean initNextRecordReader()
          Get the record reader for the next chunk in this BucketizedHiveRecordReader.
 boolean next(K key, V value)
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

split

protected final BucketizedHiveInputSplit split

inputFormat

protected final org.apache.hadoop.mapred.InputFormat inputFormat

jobConf

protected final org.apache.hadoop.mapred.JobConf jobConf

reporter

protected final org.apache.hadoop.mapred.Reporter reporter

curReader

protected org.apache.hadoop.mapred.RecordReader curReader

progress

protected long progress

idx

protected int idx
Constructor Detail

BucketizedHiveRecordReader

public BucketizedHiveRecordReader(org.apache.hadoop.mapred.InputFormat inputFormat,
                                  BucketizedHiveInputSplit bucketizedSplit,
                                  org.apache.hadoop.mapred.JobConf jobConf,
                                  org.apache.hadoop.mapred.Reporter reporter)
                           throws IOException
Throws:
IOException
Method Detail

close

public void close()
           throws IOException
Specified by:
close in interface org.apache.hadoop.mapred.RecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>
Throws:
IOException

createKey

public K createKey()
Specified by:
createKey in interface org.apache.hadoop.mapred.RecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>

createValue

public V createValue()
Specified by:
createValue in interface org.apache.hadoop.mapred.RecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>

getPos

public long getPos()
            throws IOException
Specified by:
getPos in interface org.apache.hadoop.mapred.RecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>
Throws:
IOException

getProgress

public float getProgress()
                  throws IOException
Specified by:
getProgress in interface org.apache.hadoop.mapred.RecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>
Throws:
IOException

next

public boolean next(K key,
                    V value)
             throws IOException
Specified by:
next in interface org.apache.hadoop.mapred.RecordReader<K extends org.apache.hadoop.io.WritableComparable,V extends org.apache.hadoop.io.Writable>
Throws:
IOException

initNextRecordReader

protected boolean initNextRecordReader()
                                throws IOException
Get the record reader for the next chunk in this BucketizedHiveRecordReader.

Throws:
IOException


Copyright © 2010 The Apache Software Foundation