|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.vertica.VerticaConfiguration
public class VerticaConfiguration
A container for configuration property names for jobs with Vertica
input/output.
The job can be configured using the static methods in this class,
VerticaInputFormat
, and VerticaOutputFormat
. Alternatively,
the properties can be set in the configuration with proper values.
configureVertica(Configuration, String[], String,
String, String)
,
configureVertica(Configuration, String[], String,
String, String, String[], String, String, String)
Field Summary | |
---|---|
static String |
DATABASE_PROP
Name of database to connect to |
static String |
DATE_STRING
Whether to marshal dates as strings |
static String |
DELIMITER
|
static String |
HOSTNAMES_PROP
Host names to connect to, selected from at random |
static String |
INPUT_DELIMITER_PROP
Optional input delimiter for streaming |
static String |
INPUT_TERMINATOR_PROP
Optional input terminator for streaming |
static int |
OPTIMIZE_POLL_TIMER
|
static String |
OPTIMIZE_POLL_TIMER_PROP
Override the sleep timer for optimize to poll when new projetions have refreshed |
static String |
OUTPUT_DATABASE_PROP
Name of database to connect to |
static String |
OUTPUT_DELIMITER_PROP
Optional output format delimiter |
static String |
OUTPUT_HOSTNAMES_PROP
Host names to connect to, selected from at random |
static String |
OUTPUT_PASSWORD_PROP
Password for Vertica |
static String |
OUTPUT_TABLE_DEF_PROP
Definition of output table types |
static String |
OUTPUT_TABLE_DROP
Whether to drop tables |
static String |
OUTPUT_TABLE_NAME_PROP
Output table name |
static String |
OUTPUT_TERMINATOR_PROP
Optional output format terminator |
static String |
OUTPUT_USERNAME_PROP
User name for Vertica |
static String |
PASSWORD_PROP
Password for Vertica |
static String |
QUERY_PARAM_PROP
Query to run to retrieve parameters |
static String |
QUERY_PARAMS_PROP
Static parameters for query |
static String |
QUERY_PROP
Query to run for input |
static String |
RECORD_TERMINATER
|
static String |
USERNAME_PROP
User name for Vertica |
static Integer |
VERSION_3_5
Vertica Version Constants |
static String |
VERTICA_DRIVER_CLASS
Class name for Vertica JDBC Driver |
Method Summary | |
---|---|
static void |
configureVertica(org.apache.hadoop.conf.Configuration conf,
String[] hostnames,
String database,
String username,
String password)
Sets the Vertica database connection information in the (@link Configuration) |
static void |
configureVertica(org.apache.hadoop.conf.Configuration conf,
String[] hostnames,
String database,
String username,
String password,
String[] output_hostnames,
String output_database,
String output_username,
String output_password)
Sets the Vertica database connection information in the (@link Configuration) |
org.apache.hadoop.conf.Configuration |
getConfiguration()
|
boolean |
getDropTable()
Return whether output table is truncated before loading |
String |
getInputDelimiter()
For streaming return the delimiter to separate values to the mapper |
Collection<List<Object>> |
getInputParameters()
Return static input parameters if set |
String |
getInputQuery()
|
String |
getInputRecordTerminator()
For streaming return the record terminator to separate values to the mapper |
Long |
getOptimizePollTimeout()
Returns poll timer for optimize loop |
String |
getOutputDelimiter()
For streaming return the delimiter used by the reducer |
String |
getOutputRecordTerminator()
For streaming return the record terminator used by the reducer |
String[] |
getOutputTableDef()
Return definition of columns for output table |
String |
getOutputTableName()
Get the table that is the target of output |
String |
getParamsQuery()
Return the query used to retrieve parameters for the input query (if set) |
void |
setDropTable(boolean drop_table)
Set whether to truncate the output table before loading |
void |
setInputDelimiter(String delimiter)
For streaming set the delimiter to separate values to the mapper |
void |
setInputParams(Collection<List<Object>> segment_params)
Sets a collection of lists. |
void |
setInputQuery(String inputQuery)
get Run this query and give the results to mappers. |
void |
setInputRecordTerminator(String terminator)
For streaming set the record terminator to separate values to the mapper |
void |
setOptimizePollTimeout(Long timeout)
Set the timour for the optimize poll loop |
void |
setOutputDelimiter(String delimiter)
For streaming set the delimiter used by the reducer |
void |
setOutputRecordTerminator(String terminator)
For streaming set the record terminator used by the reducer |
void |
setOutputTableDef(String... fieldNames)
Set the definition of a table for output if it needs to be created |
void |
setOutputTableName(String tableName)
Set table that is being loaded as output |
void |
setParamsQuery(String segment_params_query)
Query used to retrieve parameters for the input query. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
public static final Integer VERSION_3_5
public static final String VERTICA_DRIVER_CLASS
public static final String HOSTNAMES_PROP
public static final String DATABASE_PROP
public static final String USERNAME_PROP
public static final String PASSWORD_PROP
public static final String OUTPUT_HOSTNAMES_PROP
public static final String OUTPUT_DATABASE_PROP
public static final String OUTPUT_USERNAME_PROP
public static final String OUTPUT_PASSWORD_PROP
public static final String QUERY_PROP
public static final String QUERY_PARAM_PROP
public static final String QUERY_PARAMS_PROP
public static final String INPUT_DELIMITER_PROP
public static final String INPUT_TERMINATOR_PROP
public static final String DATE_STRING
public static final String OUTPUT_TABLE_NAME_PROP
public static final String OUTPUT_TABLE_DEF_PROP
public static final String OUTPUT_TABLE_DROP
public static final String OUTPUT_DELIMITER_PROP
public static final String OUTPUT_TERMINATOR_PROP
public static final String OPTIMIZE_POLL_TIMER_PROP
public static final String RECORD_TERMINATER
public static final String DELIMITER
public static final int OPTIMIZE_POLL_TIMER
Method Detail |
---|
public static void configureVertica(org.apache.hadoop.conf.Configuration conf, String[] hostnames, String database, String username, String password)
conf
- the configurationhostnames
- one or more hosts in the Vertica clusterdatabase
- the name of the Vertica databaseusername
- Vertica database usernamepassword
- Vertica database passwordpublic static void configureVertica(org.apache.hadoop.conf.Configuration conf, String[] hostnames, String database, String username, String password, String[] output_hostnames, String output_database, String output_username, String output_password)
conf
- the configurationhostnames
- one or more hosts in the source Clusterdatabase
- the name of the source Vertica databaseusername
- for the source Vertica databasepassword
- for he source Vertica databaseoutput_hostnames
- one or more hosts in the output Clusteroutput_database
- the name of the output VerticaDatabaseoutput_username
- for the target Vertica databaseoutput_password
- for the target Vertica databasepublic org.apache.hadoop.conf.Configuration getConfiguration()
public String getInputQuery()
public void setInputQuery(String inputQuery)
inputQuery
- public String getParamsQuery()
public void setParamsQuery(String segment_params_query)
segment_params_query
- public Collection<List<Object>> getInputParameters() throws IOException
IOException
public void setInputParams(Collection<List<Object>> segment_params) throws IOException
segment_params
-
IOException
public String getInputDelimiter()
public void setInputDelimiter(String delimiter)
public String getInputRecordTerminator()
public void setInputRecordTerminator(String terminator)
public String getOutputTableName()
public void setOutputTableName(String tableName)
tableName
- public String[] getOutputTableDef()
public void setOutputTableDef(String... fieldNames)
fieldNames
- public boolean getDropTable()
public void setDropTable(boolean drop_table)
drop_table
- public String getOutputDelimiter()
public void setOutputDelimiter(String delimiter)
delimiter
- public String getOutputRecordTerminator()
public void setOutputRecordTerminator(String terminator)
terminator
- public Long getOptimizePollTimeout()
public void setOptimizePollTimeout(Long timeout)
timeout
-
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |