Uses of Class
net.nutch.fs.NutchFileSystem

Packages that use NutchFileSystem
net.nutch.db Web database: tracks page fetches and link structure. 
net.nutch.fetcher The Nutch robot. 
net.nutch.fs   
net.nutch.indexer Maintain Lucene full-text indexes. 
net.nutch.io Generic i/o code for use when reading and writing data to the network, to databases, and to files. 
net.nutch.mapReduce A system for scalable, fault-tolerant, distributed computation over large data collections. 
net.nutch.searcher Search API 
net.nutch.segment   
net.nutch.tools   
 

Uses of NutchFileSystem in net.nutch.db
 

Methods in net.nutch.db with parameters of type NutchFileSystem
static void WebDBWriter.createWebDB(NutchFileSystem nfs, File dbDir)
          Create the WebDB for the first time.
static void EditSectionGroupWriter.createEditGroup(NutchFileSystem nfs, File dbDir, String label, int numSections, int keySpaceType)
          Initialize an EditSectionGroup.
static void DistributedWebDBWriter.createDB(NutchFileSystem nfs, File root, int totalMachines)
          Method useful for the first time we create a distributed db project.
 

Constructors in net.nutch.db with parameters of type NutchFileSystem
WebDBWriter(NutchFileSystem fs, File dbDir)
          Create a WebDBWriter.
WebDBReader(NutchFileSystem nfs, File dbDir)
          Open a web db reader for the named directory.
EditSectionGroupReader(NutchFileSystem nfs, String label, int readerNum, int totalMachines)
          Open the EditSectionGroupReader for the appropriate file.
EditSectionWriter(NutchFileSystem nfs, String label, int targetNum, int writerNum, Class keyClass, Class valClass)
          Make a EditSectionWriter for the appropriate file.
EditSectionGroupWriter(NutchFileSystem nfs, int machineNum, int totalMachines, String label, Class keyClass, Class valClass, EditSectionGroupWriter.KeyExtractor extractor)
          Start a EditSectionGroupWriter at the indicated location, for a single emitter.
DistributedWebDBWriter(NutchFileSystem nfs, File root, int machineNum)
          Open the db files.
DistributedWebDBReader(NutchFileSystem nfs, File root)
          Open a web db reader for the named directory.
DBSectionReader(NutchFileSystem nfs, File sectionFile, WritableComparator comparator)
          Right now we assume we're getting a File that is a MapFile.Reader directory.
 

Uses of NutchFileSystem in net.nutch.fetcher
 

Constructors in net.nutch.fetcher with parameters of type NutchFileSystem
Fetcher(NutchFileSystem nfs, String directory, boolean parsing)
           
 

Uses of NutchFileSystem in net.nutch.fs
 

Subclasses of NutchFileSystem in net.nutch.fs
 class LocalFileSystem
          Implement the NutchFileSystem interface for the local disk.
 class NDFSFileSystem
          Implement the NutchFileSystem interface for the NDFS system.
 

Methods in net.nutch.fs that return NutchFileSystem
static NutchFileSystem NutchFileSystem.parseArgs(String[] argv, int i)
          Parse the cmd-line args, starting at i.
 

Methods in net.nutch.fs with parameters of type NutchFileSystem
static boolean FileUtil.fullyDelete(NutchFileSystem nfs, File dir)
           
static boolean FileUtil.copyContents(NutchFileSystem nfs, File src, File dst, boolean overwrite)
          Copy a file's contents to a new location.
static void FileUtil.recursiveCopy(NutchFileSystem nfs, File src, File dst)
          Copy a file and/or directory and all its contents (whether data or other files/dirs)
 

Constructors in net.nutch.fs with parameters of type NutchFileSystem
TestClient(NutchFileSystem nfs)
           
 

Uses of NutchFileSystem in net.nutch.indexer
 

Constructors in net.nutch.indexer with parameters of type NutchFileSystem
IndexSegment(NutchFileSystem nfs, long maxDocs, File srcDir, File localWorkingDir)
          Index a segment in the given NFS.
IndexMerger(NutchFileSystem nfs, File[] segments, File outputIndex, File localWorkingDir)
          Merge all of the segments given
 

Uses of NutchFileSystem in net.nutch.io
 

Methods in net.nutch.io with parameters of type NutchFileSystem
static void MapFile.rename(NutchFileSystem nfs, String oldName, String newName)
          Renames an existing map directory.
static void MapFile.delete(NutchFileSystem nfs, String name)
          Deletes the named map file.
static long MapFile.fix(NutchFileSystem nfs, File dir, Class keyClass, Class valueClass, boolean dryrun)
          This method attempts to fix a corrupt MapFile by re-creating its index.
 

Constructors in net.nutch.io with parameters of type NutchFileSystem
ArrayFile.Writer(NutchFileSystem nfs, String file, Class valClass)
          Create the named file for values of the named class.
ArrayFile.Reader(NutchFileSystem nfs, String file)
          Construct an array reader for the named file.
SetFile.Writer(NutchFileSystem nfs, String dirName, Class keyClass)
          Create the named set for keys of the named class.
SetFile.Writer(NutchFileSystem nfs, String dirName, WritableComparator comparator)
          Create the named set using the named key comparator.
SetFile.Reader(NutchFileSystem nfs, String dirName)
          Construct a set reader for the named set.
SetFile.Reader(NutchFileSystem nfs, String dirName, WritableComparator comparator)
          Construct a set reader for the named set using the named comparator.
SequenceFile.Writer(NutchFileSystem nfs, String name, Class keyClass, Class valClass)
          Create the named file.
SequenceFile.Reader(NutchFileSystem nfs, String file)
          Open the named file.
SequenceFile.Sorter(NutchFileSystem nfs, Class keyClass, Class valClass)
          Sort and merge files containing the named classes.
SequenceFile.Sorter(NutchFileSystem nfs, WritableComparator comparator, Class valClass)
          Sort and merge using an arbitrary WritableComparator.
MapFile.Writer(NutchFileSystem nfs, String dirName, Class keyClass, Class valClass)
          Create the named map for keys of the named class.
MapFile.Writer(NutchFileSystem nfs, String dirName, WritableComparator comparator, Class valClass)
          Create the named map using the named key comparator.
MapFile.Reader(NutchFileSystem nfs, String dirName)
          Construct a map reader for the named map.
MapFile.Reader(NutchFileSystem nfs, String dirName, WritableComparator comparator)
          Construct a map reader for the named map using the named comparator.
 

Uses of NutchFileSystem in net.nutch.mapReduce
 

Methods in net.nutch.mapReduce that return NutchFileSystem
 NutchFileSystem FileSplit.getFileSystem()
          The file system containing this split's data.
 

Methods in net.nutch.mapReduce with parameters of type NutchFileSystem
 InputFormat.Split[] TextInputFormat.getSplits(NutchFileSystem fs, File[] files, int numSplits)
           
 InputFormat.Split[] InputFormat.getSplits(NutchFileSystem fs, File[] files, int numSplits)
          Splits a set of input files.
 

Constructors in net.nutch.mapReduce with parameters of type NutchFileSystem
FileSplit(NutchFileSystem fs, File file, long start, long length)
          Constructs a split.
 

Uses of NutchFileSystem in net.nutch.searcher
 

Constructors in net.nutch.searcher with parameters of type NutchFileSystem
FetchedSegments(NutchFileSystem nfs, String segmentsDir)
          Construct given a directory containing fetcher output.
 

Uses of NutchFileSystem in net.nutch.segment
 

Fields in net.nutch.segment declared as NutchFileSystem
 NutchFileSystem SegmentReader.nfs
           
 

Methods in net.nutch.segment with parameters of type NutchFileSystem
static boolean SegmentReader.isParsedSegment(NutchFileSystem nfs, File segdir)
           
static boolean SegmentReader.fixSegment(NutchFileSystem nfs, File dir, boolean withContent, boolean withParseText, boolean withParseData, boolean dryrun)
          Attempt to fix a partially corrupted segment.
 

Constructors in net.nutch.segment with parameters of type NutchFileSystem
SegmentWriter(NutchFileSystem nfs, File dir, boolean force)
           
SegmentWriter(NutchFileSystem nfs, File dir, boolean force, boolean isParsed)
           
SegmentWriter(NutchFileSystem nfs, File dir, boolean force, boolean isParsed, boolean withContent, boolean withParseText, boolean withParseData)
          Open a segment for writing.
SegmentSlicer(NutchFileSystem nfs, File[] input, File output, boolean withContent, boolean withParseText, boolean withParseData, boolean autoFix, long maxCount)
          Create new SegmentSlicer.
SegmentReader(NutchFileSystem nfs, File dir)
          Open a segment for reading.
SegmentReader(NutchFileSystem nfs, File dir, boolean autoFix)
          Open a segment for reading.
SegmentReader(NutchFileSystem nfs, File dir, boolean withContent, boolean withParseText, boolean withParseData, boolean autoFix)
          Open a segment for reading.
 

Uses of NutchFileSystem in net.nutch.tools
 

Methods in net.nutch.tools with parameters of type NutchFileSystem
 void UpdateDatabaseTool.updateForSegment(NutchFileSystem nfs, String directory)
          Iterate through items in the FetcherOutput.
 

Constructors in net.nutch.tools with parameters of type NutchFileSystem
SegmentMergeTool(NutchFileSystem nfs, File[] segments, File output, long maxCount, boolean runIndexer, boolean delSegs)
          Create a SegmentMergeTool.
ParseSegment(NutchFileSystem nfs, String directory, boolean dryRun)
          ParseSegment constructor
LinkAnalysisTool(NutchFileSystem nfs, File dbDir)
          We need a DistributedAnalysisTool in order to get things done!
FetchListTool(NutchFileSystem nfs, File dbDir, boolean refetchOnly, boolean anchorOptimize, float cutoffScore, int seed)
          FetchListTool takes a page db, and emits a RECNO-based subset of it.
DistributedAnalysisTool(NutchFileSystem nfs, File dbDir)
          Give the pagedb and linkdb files and their cache sizes
 



Copyright © 2005 The Nutch Organization.