|
|||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.mapred.InputFormatBase
A base class for InputFormat
.
Field Summary | |
static org.apache.commons.logging.Log |
LOG
|
Constructor Summary | |
InputFormatBase()
|
Method Summary | |
abstract RecordReader |
getRecordReader(FileSystem fs,
FileSplit split,
JobConf job,
Reporter reporter)
Construct a RecordReader for a FileSplit . |
FileSplit[] |
getSplits(FileSystem fs,
JobConf job,
int numSplits)
Splits files returned by {#listPaths(FileSystem,JobConf) when they're too big. |
protected File[] |
listFiles(FileSystem fs,
JobConf job)
Deprecated. Call listFiles(FileSystem,JobConf) instead. |
protected Path[] |
listPaths(FileSystem fs,
JobConf job)
List input directories. |
protected void |
setMinSplitSize(long minSplitSize)
|
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
public static final org.apache.commons.logging.Log LOG
Constructor Detail |
public InputFormatBase()
Method Detail |
protected void setMinSplitSize(long minSplitSize)
public abstract RecordReader getRecordReader(FileSystem fs, FileSplit split, JobConf job, Reporter reporter) throws IOException
InputFormat
RecordReader
for a FileSplit
.
getRecordReader
in interface InputFormat
fs
- the FileSystem
split
- the FileSplit
job
- the job that this split belongs to
RecordReader
IOException
protected File[] listFiles(FileSystem fs, JobConf job) throws IOException
listFiles(FileSystem,JobConf)
instead.
IOException
protected Path[] listPaths(FileSystem fs, JobConf job) throws IOException
fs
- job
-
IOException
- if zero items.public FileSplit[] getSplits(FileSystem fs, JobConf job, int numSplits) throws IOException
getSplits
in interface InputFormat
fs
- the filesystem containing the files to be splitjob
- the job whose input files are to be splitnumSplits
- the desired number of splits
IOException
|
|||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |