gpsscli.yaml

gpsscli.yaml

gpsscli configuration file.

Synopsis

DATABASE: db_name
USER: user_name
PASSWORD: password
HOST: master_host
PORT: greenplum_port
VERSION: version_number

DATASOURCE
  DATASOURCE_specific_parameters

[SCHEDULE:
   RETRY_INTERVAL: retry_time
   MAX_RETRIES: num_retries]

Description

You specify the configuration parameters for a Greenplum Streaming Server (GPSS) job in a YAML-formatted configuration file that you provide to the gpsscli submit command. There are two types of configuration parameters in this file - Greenplum Database connection parameters, and parameters specific to the data source from which you will load data into Greenplum.

This reference page uses the name gpsscli.yaml to refer to this file; you may choose your own name for the file.

Note: GPSS currently supports only the Kafka data source. Refer to the Greenplum-Kafka Integration Documentation for detailed information about using GPSS to load Kafka data into Greenplum Database.

The gpsscli utility processes the YAML configuration file in order, using indentation (spaces) to determine the document hierarchy and the relationships between the sections. The use of white space in the file is significant, and keywords are case-sensitive.

Keywords and Values

Greenplum Database Options
DATABASE: db_name
The name of the Greenplum database.
USER: user_name
The name of the Greenplum Database user/role. This user_name must have permissions as described in Configuring Greenplum Database Role Privileges.
PASSWORD: password
The password for the Greenplum Database user/role. By default, the GPSS client passes the password to the GPSS server in clear text. When the password has a SHADOW: prefix, it represents a shadowed password string, and GPSS uses the Shadow:Key specified in its gpss.json configuration file, or a default key, to decode the password.
HOST: master_host
The host name or IP address of the Greenplum Database master host.
PORT: greenplum_port
The port number of the Greenplum Database server on the master host.
VERSION: version_number
The version of the gpsscli configuration file. GPSS supports versions 1 and 2.
DATASOURCE: Options
DATASOURCE
The data source. GPSS currently supports only the KAFKA data source; see gpkafka-v2.yaml in the Greenplum-Kafka Integration documentation for the Kafka configuration file format and parameters.
DATASOURCE_specific_parameters
Parameters specific to the datasource.
Job SCHEDULE: Options
SCHEDULE:
Controls the frequency and interval of restarting failed jobs.
RETRY_INTERVAL: retry_time
The period of time that GPSS waits before retrying the job. You can specify the time interval in day (d), hour (h), minute (m), second (s), or millisecond (ms) integer units; do not mix units. The default retry interval is 5m (5 minutes).
MAX_RETRIES: num_retries
The maximum number of times that GPSS attempts to retry the job. The default is 0, do not retry. If you specify a negative value, GPSS retries the job indefinitely.

Examples

Submit a job to load data into Greenplum Database as defined in the load configuration file named loadit.yaml:

$ gpsscli submit loadit.yaml

Example Greenplum Database configuration parameters in loadit.yaml:

DATABASE: ops
USER: gpadmin
PASSWORD: changeme
HOST: mdw-1
PORT: 15432
DATASOURCE_block ...

See Also

gpsscli history, gpsscli submit, gpkafka-v2.yaml