|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use FileSpec | |
---|---|
org.apache.pig.backend.executionengine.util | |
org.apache.pig.backend.hadoop.executionengine | |
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators | |
org.apache.pig.backend.local.executionengine | |
org.apache.pig.impl.builtin | |
org.apache.pig.impl.io | |
org.apache.pig.impl.logicalLayer | The logical operators that represent a pig script and tools for manipulating those operators. |
Uses of FileSpec in org.apache.pig.backend.executionengine.util |
---|
Methods in org.apache.pig.backend.executionengine.util that return FileSpec | |
---|---|
static FileSpec |
ExecTools.checkLeafIsStore(PhysicalPlan plan,
PigContext pigContext)
|
Uses of FileSpec in org.apache.pig.backend.hadoop.executionengine |
---|
Fields in org.apache.pig.backend.hadoop.executionengine declared as FileSpec | |
---|---|
FileSpec |
MapRedResult.outFileSpec
|
protected FileSpec |
HJob.outFileSpec
|
Constructors in org.apache.pig.backend.hadoop.executionengine with parameters of type FileSpec | |
---|---|
HJob(ExecJob.JOB_STATUS status,
PigContext pigContext,
FileSpec outFileSpec)
|
|
HJob(ExecJob.JOB_STATUS status,
PigContext pigContext,
FileSpec outFileSpec,
PigStats stats)
|
|
MapRedResult(FileSpec outFileSpec,
int parallelismRequest)
|
Uses of FileSpec in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer |
---|
Fields in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer with type parameters of type FileSpec | |
---|---|
protected List<FileSpec> |
Launcher.failedStores
|
protected List<FileSpec> |
Launcher.succeededStores
|
Methods in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer that return FileSpec | |
---|---|
FileSpec[] |
MapReduceOper.getReplFiles()
|
Methods in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer that return types with arguments of type FileSpec | |
---|---|
List<FileSpec> |
Launcher.getFailedFiles()
Returns a list of locations of results that have failed. |
List<FileSpec> |
Launcher.getSucceededFiles()
Returns a list of locations of results that have been successfully completed. |
Methods in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer with parameters of type FileSpec | |
---|---|
StoreFunc |
MapReducePOStoreImpl.createStoreFunc(FileSpec sFile,
Schema schema,
SortInfo sortInfo)
|
Exception |
MapReduceLauncher.getError(FileSpec spec)
Get the exception that caused a failure on the backend for a store location (if any). |
Pair<MapReduceOper,Integer> |
MRCompiler.getQuantileJob(POSort inpSort,
MapReduceOper prevJob,
FileSpec lFile,
FileSpec quantFile,
int rp,
Pair<Integer,Byte>[] fields)
|
protected Pair<MapReduceOper,Integer> |
MRCompiler.getSamplingJob(POSort sort,
MapReduceOper prevJob,
List<PhysicalPlan> transformPlans,
FileSpec lFile,
FileSpec sampleFile,
int rp,
List<PhysicalPlan> sortKeyPlans,
String udfClassName,
String[] udfArgs,
String sampleLdrClassName)
Create a sampling job to collect statistics by sampling an input file. |
Pair<MapReduceOper,Integer> |
MRCompiler.getSkewedJoinSampleJob(POSkewedJoin op,
MapReduceOper prevJob,
FileSpec lFile,
FileSpec sampleFile,
int rp)
Create Sampling job for skewed join. |
MapReduceOper |
MRCompiler.getSortJob(POSort sort,
MapReduceOper quantJob,
FileSpec lFile,
FileSpec quantFile,
int rp,
Pair<Integer,Byte>[] fields)
|
void |
MapReduceOper.setReplFiles(FileSpec[] replFiles)
|
Uses of FileSpec in org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators |
---|
Methods in org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators that return FileSpec | |
---|---|
FileSpec |
POStore.getInputSpec()
|
FileSpec |
POLoad.getLFile()
|
FileSpec[] |
POFRJoin.getReplFiles()
|
FileSpec |
POStore.getSFile()
|
FileSpec |
POSplit.getSplitStore()
Returns the name of the file associated with this operator |
Methods in org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators with parameters of type FileSpec | |
---|---|
abstract StoreFunc |
POStoreImpl.createStoreFunc(FileSpec sFile,
Schema schema,
SortInfo sortInfo)
Set up the storer |
void |
POStore.setInputSpec(FileSpec lFile)
|
void |
POLoad.setLFile(FileSpec file)
|
void |
POFRJoin.setReplFiles(FileSpec[] replFiles)
|
void |
POStore.setSFile(FileSpec sFile)
|
void |
POSplit.setSplitStore(FileSpec splitStore)
Sets the name of the file associated with this operator |
Constructors in org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators with parameters of type FileSpec | |
---|---|
POFRJoin(OperatorKey k,
int rp,
List<PhysicalOperator> inp,
List<List<PhysicalPlan>> ppLists,
List<List<Byte>> keyTypes,
FileSpec[] replFiles,
int fragment,
boolean isLeftOuter,
Tuple nullTuple)
|
|
POLoad(OperatorKey k,
FileSpec lFile,
boolean splittable)
|
|
POLoad(OperatorKey k,
FileSpec lFile,
long offset,
boolean splittable)
|
|
POLoad(OperatorKey k,
int rp,
FileSpec lFile,
boolean splittable)
|
Uses of FileSpec in org.apache.pig.backend.local.executionengine |
---|
Fields in org.apache.pig.backend.local.executionengine declared as FileSpec | |
---|---|
FileSpec |
LocalResult.outFileSpec
|
protected FileSpec |
LocalJob.outFileSpec
|
Methods in org.apache.pig.backend.local.executionengine with parameters of type FileSpec | |
---|---|
StoreFunc |
LocalPOStoreImpl.createStoreFunc(FileSpec sFile,
Schema schema,
SortInfo sortInfo)
|
Constructors in org.apache.pig.backend.local.executionengine with parameters of type FileSpec | |
---|---|
LocalJob(ExecJob.JOB_STATUS status,
PigContext pigContext,
FileSpec outFileSpec)
|
|
LocalJob(ExecJob.JOB_STATUS status,
PigContext pigContext,
FileSpec outFileSpec,
PigStats stats)
|
|
LocalResult(FileSpec outFileSpec)
|
Uses of FileSpec in org.apache.pig.impl.builtin |
---|
Method parameters in org.apache.pig.impl.builtin with type arguments of type FileSpec | |
---|---|
void |
SampleLoader.computeSamples(ArrayList<Pair<FileSpec,Boolean>> inputs,
PigContext pc)
|
void |
PoissonSampleLoader.computeSamples(ArrayList<Pair<FileSpec,Boolean>> inputs,
PigContext pc)
Computes the number of samples for the loader |
Uses of FileSpec in org.apache.pig.impl.io |
---|
Subclasses of FileSpec in org.apache.pig.impl.io | |
---|---|
class |
ValidatingInputFileSpec
Creates a Slicer using its funcSpec in its construction and checks that it's valid. |
Constructors in org.apache.pig.impl.io with parameters of type FileSpec | |
---|---|
ValidatingInputFileSpec(FileSpec fileSpec,
DataStorage store)
|
Uses of FileSpec in org.apache.pig.impl.logicalLayer |
---|
Methods in org.apache.pig.impl.logicalLayer that return FileSpec | |
---|---|
FileSpec |
LOLoad.getInputFile()
|
FileSpec |
LOStore.getInputSpec()
|
FileSpec |
LOStore.getOutputFile()
|
Methods in org.apache.pig.impl.logicalLayer with parameters of type FileSpec | |
---|---|
void |
LOLoad.setInputFile(FileSpec inputFileSpec)
|
void |
LOStore.setInputSpec(FileSpec in)
|
void |
LOStore.setOutputFile(FileSpec outputFileSpec)
|
Constructors in org.apache.pig.impl.logicalLayer with parameters of type FileSpec | |
---|---|
LOLoad(LogicalPlan plan,
OperatorKey key,
FileSpec inputFileSpec,
ExecType execType,
DataStorage storage,
boolean splittable)
|
|
LOStore(LogicalPlan plan,
OperatorKey key,
FileSpec outputFileSpec)
|
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |