Installing the Connector
The Greenplum Connector for Apache NiFi is available as a separate download for VMware Tanzu Greenplum 6.x from VMware Tanzu Network.
You can run a single instance of Apache NiFi, or run NiFi in a clustered environment. Before installing the Connector, ensure that you meet the following prerequisites:
- Apache NiFi requires Java version 8 or 11. Install Java 8 or 11 on your NiFi host(s).
- You have installed Apache NiFi on your single or cluster host(s). Refer to Downloading and Installing NiFi in the Apache NiFi documentation for instructions.
This documentation uses the environment variable
$NIFI_HOMEto identify the base directory of the Apache NiFi installation on the system. You may choose to set this environment variable in your shell login start up script on the host(s). For example:
- You have administrative access to the NiFi host(s).
The Connector is available as a separate download for Greenplum Database 6.x from VMware Tanzu Network. The Connector download package is a
.tar.gz file; it includes the Apache NiFi NAR files for the Connector and an installation script.
Perform these steps to download the Connector package:
Navigate to the Greenplum Database product on VMware Tanzu Network and locate and select the release download directory named Greenplum Connectors.
The format of the Connector download file name is
greenplum-connector-apache-nifi-<version>.tar.gz. For example:
Make note of the directory to which the file was downloaded.
Extract the Connector download package. For example:
$ mkdir gpnifi_work $ cd gpnifi_work $ tar xzf downloadir/greenplum-connector-apache-nifi-1.0.0.tar.gz
This command extracts the following files and directories to the current working directory:
File/Directory Description commit.sha The commit identifier for this Connector release. install.sh A Connector install script that installs to
nars/ The directory containing the Connector NAR files. version The version of this Connector release.
If you are running an Apache NiFi cluster, copy the Connector download package to all NiFi hosts, and extract as described.
You register the Connector with Apache NiFi by copying the NAR files in
nars/ to the Apache NiFi installation on the host(s). Choose one of these options for registration:
install.shscript to copy the NAR files to
$NIFI_HOME/lib. If you choose this option, you must restart Apache NiFi after you run the script, and you may be required to re-register the Connector NAR file after you upgrade Apache NiFi.
- Ensure that you have set the
$NIFI_HOMEenvironment variable, that it identifies your Apache NiFi installation directory, and that you have permission to write to this directory.
Run the install script:
$ ./install.sh Removing old Greenplum NiFi Connector artifacts ... Installing new Greenplum NiFi Connector (version 1.0.0) ... ... Successfully installed Greenplum NiFi Connector (version 1.0.0) into /usr/local/nifi/lib
The script removes any previously-installed Connector artifacts in
$NIFI_HOME/libbefore it copies the contents of
nar/*to that directory.
- Ensure that you have set the
Copy the NAR files to the Apache NiFi autoload directory (the directory specified by the
nifi.nar.library.autoload.directoryproperty value in the
nifi.propertiesfile). NiFi auto-loads NAR files it finds in this directory, and does not require a restart.
Copy the NAR files to a location of your choosing and set this location in the
nifi.nar.library.directory.<custom>property. You must restart Apache NiFi.
If you are running an Apache NiFi cluster, be sure to register the Connector NAR files on each NiFi host.