org.apache.accumulo.examples.simple.filedata
Class ChunkInputFormat

java.lang.Object
  extended by org.apache.hadoop.mapreduce.InputFormat<K,V>
      extended by org.apache.accumulo.core.client.mapreduce.InputFormatBase<List<Map.Entry<Key,Value>>,InputStream>
          extended by org.apache.accumulo.examples.simple.filedata.ChunkInputFormat

public class ChunkInputFormat
extends InputFormatBase<List<Map.Entry<Key,Value>>,InputStream>

An InputFormat that turns the file data ingested with FileDataIngest into an InputStream using ChunkInputStream. Mappers used with this InputFormat must close the InputStream.


Nested Class Summary
 
Nested classes/interfaces inherited from class org.apache.accumulo.core.client.mapreduce.InputFormatBase
InputFormatBase.RangeInputSplit, InputFormatBase.RecordReaderBase<K,V>, InputFormatBase.RegexType
 
Field Summary
 
Fields inherited from class org.apache.accumulo.core.client.mapreduce.InputFormatBase
log
 
Constructor Summary
ChunkInputFormat()
           
 
Method Summary
 org.apache.hadoop.mapreduce.RecordReader<List<Map.Entry<Key,Value>>,InputStream> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)
           
 
Methods inherited from class org.apache.accumulo.core.client.mapreduce.InputFormatBase
addIterator, addIterator, disableAutoAdjustRanges, disableAutoAdjustRanges, fetchColumns, fetchColumns, getAuthorizations, getAuthorizations, getAutoAdjustRanges, getAutoAdjustRanges, getFetchedColumns, getFetchedColumns, getInstance, getInstance, getIteratorOptions, getIteratorOptions, getIterators, getIterators, getLogLevel, getLogLevel, getMaxVersions, getMaxVersions, getPassword, getPassword, getRanges, getRanges, getRegex, getSplits, getTablename, getTablename, getTabletLocator, getTabletLocator, getUsername, getUsername, isIsolated, isIsolated, isOfflineScan, setInputInfo, setInputInfo, setIsolated, setIsolated, setIterator, setIteratorOption, setLocalIterators, setLocalIterators, setLogLevel, setLogLevel, setMaxVersions, setMaxVersions, setMockInstance, setMockInstance, setRanges, setRanges, setRegex, setScanOffline, setZooKeeperInstance, setZooKeeperInstance, usesLocalIterators, usesLocalIterators, validateOptions, validateOptions
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

ChunkInputFormat

public ChunkInputFormat()
Method Detail

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<List<Map.Entry<Key,Value>>,InputStream> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                           org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                                    throws IOException,
                                                                                                           InterruptedException
Specified by:
createRecordReader in class org.apache.hadoop.mapreduce.InputFormat<List<Map.Entry<Key,Value>>,InputStream>
Throws:
IOException
InterruptedException


Copyright © 2012 The Apache Software Foundation. All Rights Reserved.