|
|||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
An input data format. Input files are stored in a FileSystem
.
The processing of an input file may be split across multiple machines.
Files are processed as sequences of records, implementing RecordReader
. Files must thus be split on record boundaries.
Method Summary | |
RecordReader |
getRecordReader(FileSystem fs,
FileSplit split,
JobConf job,
Reporter reporter)
Construct a RecordReader for a FileSplit . |
FileSplit[] |
getSplits(FileSystem fs,
JobConf job,
int numSplits)
Splits a set of input files. |
Method Detail |
public FileSplit[] getSplits(FileSystem fs, JobConf job, int numSplits) throws IOException
fs
- the filesystem containing the files to be splitjob
- the job whose input files are to be splitnumSplits
- the desired number of splits
IOException
public RecordReader getRecordReader(FileSystem fs, FileSplit split, JobConf job, Reporter reporter) throws IOException
RecordReader
for a FileSplit
.
fs
- the FileSystem
split
- the FileSplit
job
- the job that this split belongs to
RecordReader
IOException
|
|||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |