|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Uses of EvalFunc in org.apache.pig |
---|
Subclasses of EvalFunc in org.apache.pig | |
---|---|
class |
FilterFunc
|
Uses of EvalFunc in org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators |
---|
Constructors in org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators with parameters of type EvalFunc | |
---|---|
POUserFunc(OperatorKey k,
int rp,
List<PhysicalOperator> inp,
FuncSpec funcSpec,
EvalFunc func)
|
Uses of EvalFunc in org.apache.pig.builtin |
---|
Subclasses of EvalFunc in org.apache.pig.builtin | |
---|---|
class |
ARITY
|
class |
AVG
Generates the average of the values of the first field of a tuple. |
static class |
AVG.Final
|
static class |
AVG.Initial
|
static class |
AVG.Intermediate
|
class |
BagSize
Generates the size of the first field of a tuple. |
class |
CONCAT
Generates the concatenation of the first two fields of a tuple. |
class |
ConstantSize
Generates the size of the first field of a tuple. |
class |
COUNT
Generates the count of the values of the first field of a tuple. |
class |
COUNT_STAR
Generates the count of the values of the first field of a tuple. |
static class |
COUNT_STAR.Final
|
static class |
COUNT_STAR.Initial
|
static class |
COUNT_STAR.Intermediate
|
static class |
COUNT.Final
|
static class |
COUNT.Initial
|
static class |
COUNT.Intermediate
|
class |
DIFF
DIFF compares the fields of a tuple with arity 2. |
class |
Distinct
Find the distinct set of tuples in a bag. |
static class |
Distinct.Final
|
static class |
Distinct.Initial
|
static class |
Distinct.Intermediate
|
class |
DoubleAvg
Generates the average of the values of the first field of a tuple. |
static class |
DoubleAvg.Final
|
static class |
DoubleAvg.Initial
|
static class |
DoubleAvg.Intermediate
|
class |
DoubleMax
Generates the max of the values of the first field of a tuple. |
static class |
DoubleMax.Final
|
static class |
DoubleMax.Initial
|
static class |
DoubleMax.Intermediate
|
class |
DoubleMin
Generates the min of the Double values in the first field of a tuple. |
static class |
DoubleMin.Final
|
static class |
DoubleMin.Initial
|
static class |
DoubleMin.Intermediate
|
class |
DoubleSum
Generates the sum of the values of the first field of a tuple. |
static class |
DoubleSum.Final
|
static class |
DoubleSum.Initial
|
static class |
DoubleSum.Intermediate
|
class |
FloatAvg
Generates the average of the values of the first field of a tuple. |
static class |
FloatAvg.Final
|
static class |
FloatAvg.Initial
|
static class |
FloatAvg.Intermediate
|
class |
FloatMax
Generates the max of the values of the first field of a tuple. |
static class |
FloatMax.Final
|
static class |
FloatMax.Initial
|
static class |
FloatMax.Intermediate
|
class |
FloatMin
Generates the min of the Float values in the first field of a tuple. |
static class |
FloatMin.Final
|
static class |
FloatMin.Initial
|
static class |
FloatMin.Intermediate
|
class |
FloatSum
Generates the sum of the Float values in the first field of a tuple. |
static class |
FloatSum.Final
|
static class |
FloatSum.Initial
|
static class |
FloatSum.Intermediate
|
class |
IntAvg
Generates the average of the values of the first field of a tuple. |
static class |
IntAvg.Final
|
static class |
IntAvg.Initial
|
static class |
IntAvg.Intermediate
|
class |
IntMax
Generates the max of the values of the first field of a tuple. |
static class |
IntMax.Final
|
static class |
IntMax.Initial
|
static class |
IntMax.Intermediate
|
class |
IntMin
Generates the min of the Integer values in the first field of a tuple. |
static class |
IntMin.Final
|
static class |
IntMin.Initial
|
static class |
IntMin.Intermediate
|
class |
IntSum
Generates the sum of the Integer in the first field of a tuple. |
static class |
IntSum.Final
|
static class |
IntSum.Initial
|
static class |
IntSum.Intermediate
|
class |
IsEmpty
|
class |
LongAvg
Generates the average of the values of the first field of a tuple. |
static class |
LongAvg.Final
|
static class |
LongAvg.Initial
|
static class |
LongAvg.Intermediate
|
class |
LongMax
Generates the max of the values of the first field of a tuple. |
static class |
LongMax.Final
|
static class |
LongMax.Initial
|
static class |
LongMax.Intermediate
|
class |
LongMin
Generates the min of the Long values in the first field of a tuple. |
static class |
LongMin.Final
|
static class |
LongMin.Initial
|
static class |
LongMin.Intermediate
|
class |
LongSum
Generates the sum of the Long values in the first field of a tuple. |
static class |
LongSum.Final
|
static class |
LongSum.Initial
|
static class |
LongSum.Intermediate
|
class |
MapSize
Generates the size of the first field of a tuple. |
class |
MAX
Generates the max of the values of the first field of a tuple. |
static class |
MAX.Final
|
static class |
MAX.Initial
|
static class |
MAX.Intermediate
|
class |
MIN
Generates the min of the values of the first field of a tuple. |
static class |
MIN.Final
|
static class |
MIN.Initial
|
static class |
MIN.Intermediate
|
class |
RANDOM
|
class |
SIZE
Generates the Size of the first field of a tuple. |
class |
StringConcat
Generates the concatenation of the first two fields of a tuple. |
class |
StringMax
Generates the max of the values of the first field of a tuple. |
static class |
StringMax.Final
|
static class |
StringMax.Initial
|
static class |
StringMax.Intermediate
|
class |
StringMin
Generates the min of the String values in the first field of a tuple. |
static class |
StringMin.Final
|
static class |
StringMin.Initial
|
static class |
StringMin.Intermediate
|
class |
StringSize
Generates the size of the first field of a tuple. |
class |
SUM
Generates the sum of the values of the first field of a tuple. |
static class |
SUM.Final
|
static class |
SUM.Initial
|
static class |
SUM.Intermediate
|
class |
TOKENIZE
|
class |
TupleSize
Generates the size of the first field of a tuple. |
Uses of EvalFunc in org.apache.pig.impl.builtin |
---|
Subclasses of EvalFunc in org.apache.pig.impl.builtin | |
---|---|
class |
FindQuantiles
|
class |
GetMemNumRows
UDF to get memory size of a tuple and extracts number of rows value from special tuple created by PoissonSampleLoader It is used by skewed join. |
class |
GFAny
built-in grouping function; permits system to choose any grouping. |
class |
GFCross
|
class |
GFReplicate
|
class |
PartitionSkewedKeys
Partition reducers for skewed keys. |
Uses of EvalFunc in org.apache.pig.piggybank.evaluation |
---|
Subclasses of EvalFunc in org.apache.pig.piggybank.evaluation | |
---|---|
class |
MaxTupleBy1stField
MaxTupleBy1stField UDF returns a tuple with max value of the first field in a given bag. |
static class |
MaxTupleBy1stField.Final
|
static class |
MaxTupleBy1stField.Initial
|
static class |
MaxTupleBy1stField.Intermediate
|
Uses of EvalFunc in org.apache.pig.piggybank.evaluation.datetime |
---|
Subclasses of EvalFunc in org.apache.pig.piggybank.evaluation.datetime | |
---|---|
class |
DiffDate
Syntax: int DiffDate(String yyyymmdd1, String yyyymmdd2) .
Input:
date string in "yyyymmdd" format .
Output:
(date1-date2) in days, can be negative .
|
Uses of EvalFunc in org.apache.pig.piggybank.evaluation.datetime.convert |
---|
Subclasses of EvalFunc in org.apache.pig.piggybank.evaluation.datetime.convert | |
---|---|
class |
CustomFormatToISO
CustomFormatToISO converts arbitrary date formats to ISO format. |
class |
ISOToUnix
ISOToUnix converts ISO8601 datetime strings to Unix Time Longs Jodatime: http://joda-time.sourceforge.net/ ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601 Unix Time: http://en.wikipedia.org/wiki/Unix_time Example usage: REGISTER /Users/me/commiter/piggybank/java/piggybank.jar ; REGISTER /Users/me/commiter/piggybank/java/lib/joda-time-1.6.jar ; DEFINE ISOToUnix org.apache.pig.piggybank.evaluation.datetime.convert.ISOToUnix(); ISOin = LOAD 'test.tsv' USING PigStorage('\t') AS (dt:chararray, dt2:chararray); DESCRIBE ISOin; ISOin: {dt: chararray,dt2: chararray} DUMP ISOin; (2009-01-07T01:07:01.000Z,2008-02-01T00:00:00.000Z) (2008-02-06T02:06:02.000Z,2008-02-01T00:00:00.000Z) (2007-03-05T03:05:03.000Z,2008-02-01T00:00:00.000Z) ... |
class |
UnixToISO
UnixToISO converts Unix Time Long datetimes to ISO8601 datetime strings Jodatime: http://joda-time.sourceforge.net/ ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601 Unix Time: http://en.wikipedia.org/wiki/Unix_time Example usage: REGISTER /Users/me/commiter/piggybank/java/piggybank.jar ; REGISTER /Users/me/commiter/piggybank/java/lib/joda-time-1.6.jar ; DEFINE UnixToISO org.apache.pig.piggybank.evaluation.datetime.convert.UnixToISO(); UnixIn = LOAD 'test2.tsv' USING PigStorage('\t') AS (dt:long); DESCRIBE UnixIn; UnixIn: {dt: long} DUMP UnixIn; (1231290421000L) (1233885962000L) (1236222303000L) toISO = FOREACH UnixIn GENERATE UnixToISO(dt) AS ISOTime:chararray; DESCRIBE toISO; toISO: {ISOTime: chararray} DUMP toISO; (2009-01-07T01:07:01.000Z) (2009-02-06T02:06:02.000Z) (2009-03-05T03:05:03.000Z) ... |
Uses of EvalFunc in org.apache.pig.piggybank.evaluation.datetime.diff |
---|
Subclasses of EvalFunc in org.apache.pig.piggybank.evaluation.datetime.diff | |
---|---|
class |
ISODaysBetween
ISODaysBetween returns the number of days between two ISO8601 datetimes as a Long Jodatime: http://joda-time.sourceforge.net/ ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601 Example usage: REGISTER /Users/me/commiter/piggybank/java/piggybank.jar ; REGISTER /Users/me/commiter/piggybank/java/lib/joda-time-1.6.jar ; DEFINE ISOYearsBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOYearsBetween(); DEFINE ISOMonthsBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOMonthsBetween(); DEFINE ISODaysBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISODaysBetween(); DEFINE ISOHoursBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOHoursBetween(); DEFINE ISOMinutesBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOMinutesBetween(); DEFINE ISOSecondsBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOSecondsBetween(); ISOin = LOAD 'test.tsv' USING PigStorage('\t') AS (dt:chararray, dt2:chararray); DESCRIBE ISOin; ISOin: {dt: chararray,dt2: chararray} DUMP ISOin; (2009-01-07T01:07:01.000Z,2008-02-01T00:00:00.000Z) (2008-02-06T02:06:02.000Z,2008-02-01T00:00:00.000Z) (2007-03-05T03:05:03.000Z,2008-02-01T00:00:00.000Z) ... |
class |
ISOHoursBetween
ISOHoursBetween returns the number of hours between two ISO8601 datetimes as a Long Jodatime: http://joda-time.sourceforge.net/ ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601 Example usage: REGISTER /Users/me/commiter/piggybank/java/piggybank.jar ; REGISTER /Users/me/commiter/piggybank/java/lib/joda-time-1.6.jar ; DEFINE ISOYearsBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOYearsBetween(); DEFINE ISOMonthsBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOMonthsBetween(); DEFINE ISODaysBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISODaysBetween(); DEFINE ISOHoursBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOHoursBetween(); DEFINE ISOMinutesBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOMinutesBetween(); DEFINE ISOSecondsBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOSecondsBetween(); ISOin = LOAD 'test.tsv' USING PigStorage('\t') AS (dt:chararray, dt2:chararray); DESCRIBE ISOin; ISOin: {dt: chararray,dt2: chararray} DUMP ISOin; (2009-01-07T01:07:01.000Z,2008-02-01T00:00:00.000Z) (2008-02-06T02:06:02.000Z,2008-02-01T00:00:00.000Z) (2007-03-05T03:05:03.000Z,2008-02-01T00:00:00.000Z) ... |
class |
ISOMinutesBetween
ISOMinutesBetween returns the number of minutes between two ISO8601 datetimes as a Long Jodatime: http://joda-time.sourceforge.net/ ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601 Example usage: REGISTER /Users/me/commiter/piggybank/java/piggybank.jar ; REGISTER /Users/me/commiter/piggybank/java/lib/joda-time-1.6.jar ; DEFINE ISOYearsBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOYearsBetween(); DEFINE ISOMonthsBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOMonthsBetween(); DEFINE ISODaysBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISODaysBetween(); DEFINE ISOHoursBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOHoursBetween(); DEFINE ISOMinutesBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOMinutesBetween(); DEFINE ISOSecondsBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOSecondsBetween(); ISOin = LOAD 'test.tsv' USING PigStorage('\t') AS (dt:chararray, dt2:chararray); DESCRIBE ISOin; ISOin: {dt: chararray,dt2: chararray} DUMP ISOin; (2009-01-07T01:07:01.000Z,2008-02-01T00:00:00.000Z) (2008-02-06T02:06:02.000Z,2008-02-01T00:00:00.000Z) (2007-03-05T03:05:03.000Z,2008-02-01T00:00:00.000Z) ... |
class |
ISOMonthsBetween
ISOMonthsBetween returns the number of months between two ISO8601 datetimes as a Long Jodatime: http://joda-time.sourceforge.net/ ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601 Example usage: REGISTER /Users/me/commiter/piggybank/java/piggybank.jar ; REGISTER /Users/me/commiter/piggybank/java/lib/joda-time-1.6.jar ; DEFINE ISOYearsBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOYearsBetween(); DEFINE ISOMonthsBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOMonthsBetween(); DEFINE ISODaysBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISODaysBetween(); DEFINE ISOHoursBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOHoursBetween(); DEFINE ISOMinutesBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOMinutesBetween(); DEFINE ISOSecondsBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOSecondsBetween(); ISOin = LOAD 'test.tsv' USING PigStorage('\t') AS (dt:chararray, dt2:chararray); DESCRIBE ISOin; ISOin: {dt: chararray,dt2: chararray} DUMP ISOin; (2009-01-07T01:07:01.000Z,2008-02-01T00:00:00.000Z) (2008-02-06T02:06:02.000Z,2008-02-01T00:00:00.000Z) (2007-03-05T03:05:03.000Z,2008-02-01T00:00:00.000Z) ... |
class |
ISOSecondsBetween
ISOSecondsBetween returns the number of seconds between two ISO8601 datetimes as a Long Jodatime: http://joda-time.sourceforge.net/ ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601 Example usage: REGISTER /Users/me/commiter/piggybank/java/piggybank.jar ; REGISTER /Users/me/commiter/piggybank/java/lib/joda-time-1.6.jar ; DEFINE ISOYearsBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOYearsBetween(); DEFINE ISOMonthsBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOMonthsBetween(); DEFINE ISODaysBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISODaysBetween(); DEFINE ISOHoursBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOHoursBetween(); DEFINE ISOMinutesBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOMinutesBetween(); DEFINE ISOSecondsBetween org.apache.pig.piggybank.evaluation.datetime.diff.ISOSecondsBetween(); ISOin = LOAD 'test.tsv' USING PigStorage('\t') AS (dt:chararray, dt2:chararray); DESCRIBE ISOin; ISOin: {dt: chararray,dt2: chararray} DUMP ISOin; (2009-01-07T01:07:01.000Z,2008-02-01T00:00:00.000Z) (2008-02-06T02:06:02.000Z,2008-02-01T00:00:00.000Z) (2007-03-05T03:05:03.000Z,2008-02-01T00:00:00.000Z) ... |
class |
ISOYearsBetween
|
Uses of EvalFunc in org.apache.pig.piggybank.evaluation.datetime.truncate |
---|
Subclasses of EvalFunc in org.apache.pig.piggybank.evaluation.datetime.truncate | |
---|---|
class |
ISOToDay
ISOToDay truncates an ISO8601 datetime string to the precision of the day field Jodatime: http://joda-time.sourceforge.net/ ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601 Example usage: REGISTER /Users/me/commiter/piggybank/java/piggybank.jar ; REGISTER /Users/me/commiter/piggybank/java/lib/joda-time-1.6.jar ; DEFINE ISOToYear org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToYear(); DEFINE ISOToMonth org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToMonth(); DEFINE ISOToWeek org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToWeek(); DEFINE ISOToDay org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToDay(); DEFINE ISOToHour org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToHour(); DEFINE ISOToMinute org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToMinute(); DEFINE ISOToSecond org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToSecond(); ISOin = LOAD 'test.tsv' USING PigStorage('\t') AS (dt:chararray, dt2:chararray); DESCRIBE ISOin; ISOin: {dt: chararray,dt2: chararray} DUMP ISOin; (2009-01-07T01:07:01.000Z,2008-02-01T00:00:00.000Z) (2008-02-06T02:06:02.000Z,2008-02-01T00:00:00.000Z) (2007-03-05T03:05:03.000Z,2008-02-01T00:00:00.000Z) ... |
class |
ISOToHour
ISOToHour truncates an ISO8601 datetime string to the precision of the hour field Jodatime: http://joda-time.sourceforge.net/ ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601 Example usage: REGISTER /Users/me/commiter/piggybank/java/piggybank.jar ; REGISTER /Users/me/commiter/piggybank/java/lib/joda-time-1.6.jar ; DEFINE ISOToYear org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToYear(); DEFINE ISOToMonth org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToMonth(); DEFINE ISOToWeek org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToWeek(); DEFINE ISOToDay org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToDay(); DEFINE ISOToHour org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToHour(); DEFINE ISOToMinute org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToMinute(); DEFINE ISOToSecond org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToSecond(); ISOin = LOAD 'test.tsv' USING PigStorage('\t') AS (dt:chararray, dt2:chararray); DESCRIBE ISOin; ISOin: {dt: chararray,dt2: chararray} DUMP ISOin; (2009-01-07T01:07:01.000Z,2008-02-01T00:00:00.000Z) (2008-02-06T02:06:02.000Z,2008-02-01T00:00:00.000Z) (2007-03-05T03:05:03.000Z,2008-02-01T00:00:00.000Z) ... |
class |
ISOToMinute
ISOToMinute truncates an ISO8601 datetime string to the precision of the minute field Jodatime: http://joda-time.sourceforge.net/ ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601 Example usage: REGISTER /Users/me/commiter/piggybank/java/piggybank.jar ; REGISTER /Users/me/commiter/piggybank/java/lib/joda-time-1.6.jar ; DEFINE ISOToYear org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToYear(); DEFINE ISOToMonth org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToMonth(); DEFINE ISOToWeek org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToWeek(); DEFINE ISOToDay org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToDay(); DEFINE ISOToHour org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToHour(); DEFINE ISOToMinute org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToMinute(); DEFINE ISOToSecond org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToSecond(); ISOin = LOAD 'test.tsv' USING PigStorage('\t') AS (dt:chararray, dt2:chararray); DESCRIBE ISOin; ISOin: {dt: chararray,dt2: chararray} DUMP ISOin; (2009-01-07T01:07:01.000Z,2008-02-01T00:00:00.000Z) (2008-02-06T02:06:02.000Z,2008-02-01T00:00:00.000Z) (2007-03-05T03:05:03.000Z,2008-02-01T00:00:00.000Z) ... |
class |
ISOToMonth
ISOToMonth truncates an ISO8601 datetime string to the precision of the month field Jodatime: http://joda-time.sourceforge.net/ ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601 Example usage: REGISTER /Users/me/commiter/piggybank/java/piggybank.jar ; REGISTER /Users/me/commiter/piggybank/java/lib/joda-time-1.6.jar ; DEFINE ISOToYear org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToYear(); DEFINE ISOToMonth org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToMonth(); DEFINE ISOToWeek org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToWeek(); DEFINE ISOToDay org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToDay(); DEFINE ISOToHour org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToHour(); DEFINE ISOToMinute org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToMinute(); DEFINE ISOToSecond org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToSecond(); ISOin = LOAD 'test.tsv' USING PigStorage('\t') AS (dt:chararray, dt2:chararray); DESCRIBE ISOin; ISOin: {dt: chararray,dt2: chararray} DUMP ISOin; (2009-01-07T01:07:01.000Z,2008-02-01T00:00:00.000Z) (2008-02-06T02:06:02.000Z,2008-02-01T00:00:00.000Z) (2007-03-05T03:05:03.000Z,2008-02-01T00:00:00.000Z) ... |
class |
ISOToSecond
ISOToSecond truncates an ISO8601 datetime string to the precision of the second field Jodatime: http://joda-time.sourceforge.net/ ISO8601 Date Format: http://en.wikipedia.org/wiki/ISO_8601 Example usage: REGISTER /Users/me/commiter/piggybank/java/piggybank.jar ; REGISTER /Users/me/commiter/piggybank/java/lib/joda-time-1.6.jar ; DEFINE ISOToYear org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToYear(); DEFINE ISOToMonth org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToMonth(); DEFINE ISOToWeek org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToWeek(); DEFINE ISOToDay org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToDay(); DEFINE ISOToHour org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToHour(); DEFINE ISOToMinute org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToMinute(); DEFINE ISOToSecond org.apache.pig.piggybank.evaluation.datetime.truncate.ISOToSecond(); ISOin = LOAD 'test.tsv' USING PigStorage('\t') AS (dt:chararray, dt2:chararray); DESCRIBE ISOin; ISOin: {dt: chararray,dt2: chararray} DUMP ISOin; (2009-01-07T01:07:01.000Z,2008-02-01T00:00:00.000Z) (2008-02-06T02:06:02.000Z,2008-02-01T00:00:00.000Z) (2007-03-05T03:05:03.000Z,2008-02-01T00:00:00.000Z) ... |
class |
ISOToWeek
ISOToWeek truncates an ISO8601 datetime string to the precision of the day field, for the first day of the week of the datetime. |
class |
ISOToYear
|
Uses of EvalFunc in org.apache.pig.piggybank.evaluation.decode |
---|
Subclasses of EvalFunc in org.apache.pig.piggybank.evaluation.decode | |
---|---|
class |
Bin
Syntax: String Bin(arithmetic_expression, string1, ,..., stringN, sentinelN, default_string) .
Logic:
if (arithmetic_expression<=sentinel1) return string1; |
class |
BinCond
Syntax: String BinCond(boolean_expression1, mapping_string1, ..., boolean_expressionN, mapping_stringN, other_string) .
Logic:
if (boolean_expression1) return mapping_string1; |
class |
Decode
Syntax: String Decode(expression, value1, mapping_string1, ..., valueN, mapping_stringN, other_string) .
Logic:
if (expression==value1) return mapping_string1; |
Uses of EvalFunc in org.apache.pig.piggybank.evaluation.math |
---|
Subclasses of EvalFunc in org.apache.pig.piggybank.evaluation.math | |
---|---|
class |
ABS
math.ABS implements a binding to the Java function Math.abs(double) for computing the
absolute value of the argument. |
class |
ACOS
math.ACOS implements a binding to the Java function Math.acos(double) for computing the
arc cosine of value of the argument. |
class |
ASIN
math.ASIN implements a binding to the Java function Math.asin(double) for computing the
arc sine of value of the argument. |
class |
ATAN
math.ATAN implements a binding to the Java function Math.atan(double) for computing the
arc tangent of value of the argument. |
class |
ATAN2
math.ATAN2 implements a binding to the Java function Math.atan2(double,double) . |
class |
Base
base class for math udfs |
class |
CBRT
math.CBRT implements a binding to the Java function Math.cbrt(double) for computing the
cube root of the argument. |
class |
CEIL
math.CEIL implements a binding to the Java function Math.ceil(double) . |
class |
copySign
math.copySign implements a binding to the Java function Math.copySign(double,double) . |
class |
COS
math.COS implements a binding to the Java function Math.cos(double) . |
class |
COSH
math.COSH implements a binding to the Java function Math.cosh(double) . |
class |
DoubleAbs
math.ABS implements a binding to the Java function Math.abs(double) for computing the
absolute value of the argument. |
class |
DoubleBase
base class for math udfs that return Double value |
class |
DoubleCopySign
math.copySign implements a binding to the Java function Math.copySign(double,double) . |
class |
DoubleDoubleBase
base class for math udfs that return Double value |
class |
DoubleGetExponent
math.getExponent implements a binding to the Java function Math.getExponent(double) . |
class |
DoubleNextAfter
math.nextAfter implements a binding to the Java function Math.nextAfter(double,double) . |
class |
DoubleNextup
math.NEXTUP implements a binding to the Java function Math.nextUp(double) . |
class |
DoubleRound
math.ROUND implements a binding to the Java function Math.round(double) . |
class |
DoubleSignum
math.SIGNUM implements a binding to the Java function Math.signum(double) . |
class |
DoubleUlp
math.ULP implements a binding to the Java function Math.ulp(double) . |
class |
EXP
math.EXP implements a binding to the Java function Math.exp(double) . |
class |
EXPM1
math.EXPM1 implements a binding to the Java function Math.expm1(double) . |
class |
FloatAbs
math.ABS implements a binding to the Java function Math.abs(float) for computing the
absolute value of the argument. |
class |
FloatCopySign
math.copySign implements a binding to the Java function Math.copySign(float,float) . |
class |
FloatGetExponent
math.getExponent implements a binding to the Java function Math.getExponent(double) . |
class |
FloatNextAfter
math.nextAfter implements a binding to the Java function Math.nextAfter(double,double) . |
class |
FloatNextup
math.NEXTUP implements a binding to the Java function Math.nextUp(double) . |
class |
FloatRound
math.ROUND implements a binding to the Java function Math.round(float) . |
class |
FloatSignum
math.SIGNUM implements a binding to the Java function Math.signum(float) . |
class |
FloatUlp
math.ULP implements a binding to the Java function Math.ulp(float) . |
class |
FLOOR
math.FLOOR implements a binding to the Java function Math.floor(double) . |
class |
getExponent
math.getExponent implements a binding to the Java function Math.getExponent(double) . |
class |
HYPOT
math.HYPOT implements a binding to the Java function Math.hypot(double,double) . |
class |
IEEEremainder
math.IEEEremainder implements a binding to the Java function Math.IEEEremainder(double,double) . |
class |
IntAbs
math.ABS implements a binding to the Java function Math.abs(int) for computing the
absolute value of the argument. |
class |
LOG
math.LOG implements a binding to the Java function Math.log(double) . |
class |
LOG10
math.LOG10 implements a binding to the Java function Math.log10(double) . |
class |
LOG1P
math.LOG1P implements a binding to the Java function Math.log1p(double) . |
class |
LongAbs
math.ABS implements a binding to the Java function Math.abs(long) for computing the
absolute value of the argument. |
class |
nextAfter
math.nextAfter implements a binding to the Java function Math.nextAfter(double,double) . |
class |
NEXTUP
math.NEXTUP implements a binding to the Java function Math.nextUp(double) . |
class |
POW
math.POW implements a binding to the Java function Math.pow(double,double) . |
class |
RINT
math.RINT implements a binding to the Java function Math.rint(double) . |
class |
ROUND
math.ROUND implements a binding to the Java function Math.round(double) . |
class |
SCALB
math.SCALB implements a binding to the Java function Math.scalb(double,int) . |
class |
SIGNUM
math.SIGNUM implements a binding to the Java function Math.signum(double) . |
class |
SIN
math.SIN implements a binding to the Java function Math.sin(double) . |
class |
SINH
math.SINH implements a binding to the Java function Math.sinh(double) . |
class |
SQRT
math.SQRT implements a binding to the Java function Math.sqrt(double) . |
class |
TAN
math.TAN implements a binding to the Java function Math.tan(double) . |
class |
TANH
math.TANH implements a binding to the Java function Math.tanh(double) . |
class |
toDegrees
math.toDegrees implements a binding to the Java function Math.toDegrees(double) . |
class |
toRadians
math.toRadians implements a binding to the Java function Math.toRadians(double) . |
class |
ULP
math.ULP implements a binding to the Java function Math.ulp(double) . |
Uses of EvalFunc in org.apache.pig.piggybank.evaluation.stats |
---|
Subclasses of EvalFunc in org.apache.pig.piggybank.evaluation.stats | |
---|---|
class |
COR
Computes the correlation between sets of data. |
static class |
COR.Final
|
static class |
COR.Initial
|
static class |
COR.Intermed
|
class |
COV
Computes the covariance between sets of data. |
static class |
COV.Final
|
static class |
COV.Initial
|
static class |
COV.Intermed
|
Uses of EvalFunc in org.apache.pig.piggybank.evaluation.string |
---|
Subclasses of EvalFunc in org.apache.pig.piggybank.evaluation.string | |
---|---|
class |
HashFNV
Syntax: long HashFNV(String string_to_hash, [int mod]) .
|
class |
HashFNV1
Implementation for HashFNV which takes 1 parameter |
class |
HashFNV2
Implementation for HashFNV which takes 2 parameter |
class |
INDEXOF
string.INDEXOF implements eval function to search for a string Example: register pigudfs.jar; A = load 'mydata' as (name); B = foreach A generate string.INDEXOF(name, ","); dump B; |
class |
LASTINDEXOF
string.INSTR implements eval function to search for the last occurrence of a string Returns null on error Example:
register pigudfs.jar;
A = load 'mydata' as (name);
B = foreach A generate string.LASTINDEXOF(name, ",");
dump B;
|
class |
LcFirst
lower-case the first character of a string |
class |
LENGTH
string.LENGTH implements eval function to find length of a string Example: register piggybank.jar; A = load 'mydata' as (name); B = foreach A generate string.LENGTH(name); dump B; |
class |
LookupInFiles
Syntax: int lookupInFiles(String expression,... |
class |
LOWER
string.LOWER implements eval function to convert a string to lower case Example: register pigudfs.jar; A = load 'mydata' as (name); B = foreach A generate string.LOWER(name); dump B; |
class |
RegexExtract
Syntax: String RegexExtract(String expression, String regex, int match_index) .
Input:
expression -source string .
regex -regular expression .
match_index -index of the group to extract .
Output:
extracted group, if fail, return null .
|
class |
RegexExtractAll
Syntax: String RegexExtractAll(String expression, String regex) .
Input:
expression -source string .
regex -regular expression .
Output:
A tuple of matched strings .
|
class |
RegexMatch
Syntax: int RegexMatch(String expression, String regex) .
Output:
return 1 if expression contains regex, 0 otherwise .
|
class |
REPLACE
string.REPLACE implements eval function to replace part of a string. |
class |
Reverse
|
class |
Split
Wrapper around Java's String.split input tuple: first column is assumed to have a string to split; the optional second column is assumed to have the delimiter or regex to split on; if not provided, it's assumed to be '\s' (space) the optional third column may provide a limit to the number of results. If limit is not provided, 0 is assumed, as per Java's split(). |
class |
SUBSTRING
string.SUBSTRING implements eval function to get a part of a string. |
class |
Trim
|
class |
UcFirst
upper-case the first character of a string |
class |
UPPER
string.UPPER implements eval function to convert a string to upper case Example: register pigudfs.jar; A = load 'mydata' as (name); B = foreach A generate string.UPPER(name); dump B; |
Uses of EvalFunc in org.apache.pig.piggybank.evaluation.util |
---|
Subclasses of EvalFunc in org.apache.pig.piggybank.evaluation.util | |
---|---|
class |
SearchQuery
This small UDF takes a search engine URL (Google/Yahoo/AOL/Live) containing the search query and extracts it. |
class |
Top
Top UDF accepts a bag of tuples and returns top-n tuples depending upon the tuple field value of type long. |
static class |
Top.Final
|
static class |
Top.Initial
|
static class |
Top.Intermed
|
Uses of EvalFunc in org.apache.pig.piggybank.evaluation.util.apachelogparser |
---|
Subclasses of EvalFunc in org.apache.pig.piggybank.evaluation.util.apachelogparser | |
---|---|
class |
DateExtractor
DateExtractor has four different constructors which each allow for different functionality. |
class |
HostExtractor
HostExtractor takes a url and returns the host. |
class |
SearchEngineExtractor
SearchEngineExtractor takes a url string and extracts the search engine. |
class |
SearchTermExtractor
SearchTermExtractor takes a url string and extracts the search terms. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |