Installation and Configuration of IBM Watson Analytics and StoredIQ: Complete Administration Guide of IBM Watson, IBM Cloud, Red Hat OpenShift, Docker, and IBM StoredIQ (English Edition)

By Alan Bluck

This book provides instructions for installation, configuration and troubleshooting sections to improve the IT support productivity and fast resolution of issues that arise. It covers readers' references that are available online and also step-by-step procedures required for a successful installation of a broad range of IBM Data Analytics products. This book provides a holistic in-depth knowledge for students, software architects, installation specialists, and developers of Data Analysis software and a handbook for data analysts who want a single source of information on IBM Data Analysis Software products. This book provides a single resource that covers the latest available IBM Data Analysis software on the most recent RedHat Linux and IBM Cloud platforms.

This book includes comprehensive technical guidance, enabling IT professionals to gain an in-depth knowledge of the installation of a broad range of IBM Software products across different operating systems.

• Language: English
• Publisher: BPB Online LLP
• Release date: Apr 30, 2021
• ISBN: 9789390684502

Book preview

CHAPTER 1

Getting started with IBM Resources for Analytics

Introduction

This book is a consolidation and rationalization of several separate publications describing the Installation and Configuration of IBM Watson Analytics on Red Hat Enterprise Linux 8.0, IBM Cloud, IBM Cloud Private (Community Edition), and the Windows 10 Operating System (OS).

The book focuses on the initial preparation and configuration of the prerequisite requirements for each of the system platforms covered, and the initial installation and configuration of the supporting systems for successful deployment of the IBM software products, which are listed as follows:

IBM Watson Explorer Foundational Components 12.x

IBM Watson Explorer oneWEX 12.x Docker Container

IBM StoredIQ for Legal VM 2.0.3.7 Server Installation

This chapter covers the Bill of Materials for the IBM Information Management System (IMS) products to be installed, with the download site URLs, product codes, descriptions, and size and name of the download gzip, tar files for each software package download.

Structure:

In this chapter, we will discuss the following topics:

Red Hat Linux RHEL 8.0

Download location, estimated download time, and version

License requirements User Value Unit (UVU), Processor Value Unit (PVU)

Fix pack location and versions

IBM Cloud

Download location, estimated download time, and version

License requirements UVU PVU

Fix pack location and versions

Red Hat OpenShift 4.5

Download location, estimated download time, and version

License requirements UVU PVU

Fix pack location and versions

IBM Watson Explorer Foundational Components V12

Download location, estimated download time, and version

License requirements UVU PVU

Fix pack location and versions

IBM Watson Explorer oneWEX 12.x Docker Container

Download location, estimated download time, and version

License requirements UVU PVU

Fix pack location and versions

IBM Case Analyzer 5.5

Download location, estimated download time, and version

License requirements UVU PVU

Fix pack location and versions

IBM StoredIQ for Legal 2.0.3.7

Download location, estimated download time, and version

License requirements UVU PVU

Fix pack location and versions

Objectives

After studying this unit, you should be able to:

Locate and download the required software packages for installation.

Understand the prerequisite requirements for the target software to be installed, or know where to look for them.

1.1: Red Hat Linux RHEL 8.0

Red Hat has now been acquired by IBM, but has been given some independence (as of August 2020) in respect to its open source origins.

It has an open source Linux version called Centos, which is maintained in parallel with the commercial Red Hat Enterprise Linux (RHEL) versions.

1.1.1: Download location, estimated download time, and version

You can download RHEL 8.0 iso image file from the following URL location:

https://developers.redhat.com/products/rhel/download/

And then select the DVD iso file to download Red Hat Enterprise Linux 8.0 operating system, which is downloaded as an image file (with a file extension of .iso). This file can be loaded into VMware Workstation Pro version 15.1.0 virtual machine (VM) software or later versions, and holds a DVD disk image which can be booted to install the Linux Operating system.

The file, RHEL version 8.2 Linux DVD .iso file, can be selected; however this needs to be checked against IBM’s Compatibility Matrix for the IBM supported version with the target versions of the IBM Watson software, which are listed as follows:

IBM Watson Explorer Foundational Components 12.x

IBM Watson Explorer oneWEX 12.x Docker Container

Click on the View Older Downloads link option to get a full list of available RHEL versions (I used RHEL Version 8.0).

The RHEL 8.0 OS is NOT needed for the IBM StoredIQ for Legal VM 2.0.3.7 server installation, as this is itself supplied as an installation, which is already a pre-built Virtual Machine .ova VMware file, based on CentOS 7. See Chapter 14, IBM StoredIQ for Legal VM 2.0.3.7 Server Installation for the full installation details.

1.1.2: License requirements UVU PVU

The Red Hat Linux RHEL 8.0 system can be loaded using a Developer License (FREE) for non-production purposes. This gives access to all the currently supported versions of Red Hat Linux (including versions 5 and 6 currently.)

See the following link:

https://developers.redhat.com/products/rhel/download

The Red Hat Enterprise Linux 8.0 download is covered fully using the following URL:

https://doi.org/10.13140/RG.2.2.14590.95049

(Content Navigator 3.0.6 Installation on RHEL 8.0_V1.docx, on pages 15 – 20 of this word document, downloaded using the above DOI URL)

On the Download page, you will be able to download using the browser (I used AVG, version 84.0.5270.107):

Figure 1.1: The download progress of the DVD iso file shown in the browser, bottom left

For RHEL 8.2, the download takes around 17 minutes for 7.9 GB.

You may find that the virus checker leaves the download unconfirmed if the space on the download drive is limited!

If so, and the size is as 7.9 GB, as above, just rename the file.

Figure 1.2: The highlighted link will give additional information and access to a number of Red Hat related eBooks

Figure 1.3: eBook free downloads (others are available!)

1.1.3: Fix pack location and versions

For Red Hat Linux RHEL 8.x, the subscription manager can be used together with the yum installer to upgrade packages (some examples are given in the preceding figure 1.2).

1.1.3.1: How to downgrade an installation for selected packages?

The following is a real (and current) example of the use of yum downgrade to install the previous version of an installed package to effectively back out from an installed version on RHEL or CentOS.

Red Hat is currently advising (https://access.redhat.com/solutions/5272311) users not to apply the GRUB2 security patches RHSA-2020:3216 (https://access.redhat.com/errata/RHSA-2020:3216) or RHSA-2020:3217 (https://access.redhat.com/errata/RHSA-2020:3217) until reboot failure issues have been resolved.

If you administer a RHEL or CentOS system, and believe you may have installed these patches, do not reboot your system. Downgrade the affected packages using the following:

sudo yum downgrade shim\* grub2\* mokutil

and configure yum not to upgrade those packages by temporarily adding the following:

exclude=grub2* shim* mokutil to /etc/yum.conf.

if so, in /etc/yum.conf append:

exclude=grub2* shim* mokutil

using vi/etc/yum.conf

Figure 1.4: Edit /etc/yum.conf as highlighted

1.2: IBM Cloud

IBM Cloud can be set up to use Red Hat (OpenShift based) systems remotely via the internet; this provides organisations a built and ready security system, full scalability, and flexible component installation to allow a fast route to a customised production environment for a large range of pre-built software container modules.

To create an IBM Cloud account, there is a free option for the trial of the software from the following link:

https://www.ibm.com/cloud

Figure 1.5: Select the Start for free link

See Chapter 10, IBM Cloud Private Cluster on CentOS 8.0, for the full step by step details for installing and using this software.

1.2.1: Download location, estimated download time, and version

The following screen, Figure 1.6 below, shows the In screentext which is the initial home page you will see after logging into the IBM Cloud.

Figure 1.6: Logging into the IBM Cloud dashboard

The main download, initially required for using an IBM Cloud based system, is to install the IBM Cloud CLI client on an RHEL 8.0 server.

When you log into the installed IBM Cloud CLI using:

ibmcloud login -a cloud.ibm.com -sso

You are prompted from a launched browser to log into your IBM Cloud account and presented with a one-time pass code to copy and use as a security token to allow access to retrieve a container using docker pull.

This installs a local Docker container, which accesses other resources held in the IBM Cloud. (In my case, a local DB2 Graph container connecting to a remote Gremlin container on the IBM Cloud).

The container sizes are usually relatively small; for my example, it was less than 2 GB.

1.2.2 License requirements UVU PVU

This is the main browser page to the PDF downloads for the IBM SLA:

https://www-03.ibm.com/software/sla/sladb.nsf/sla/bm-7747-06

and links to the license agreements:

https://www-03.ibm.com/software/sla/sladb.nsf/sla/home?OpenDocument

See the following link:

https://cloud.ibm.com/catalog

IBM Cloud catalog is used to find the components that can be used (there is a list of around 200 container packages, many of these are free to use).

Figure 1.7: The IBM Cloud software catalog browser page

1.2.3 Fix pack location and versions

See the following link:

https://cloud.ibm.com/catalog/services/watson-studio

IBM Cloud fix packs are automatically applied by IBM, so there is no requirement to administer them (and, in fact, no need as these are regularly updated by IBM).

1.2.3.1: Lite

The Free Lite version of Watson Studio has the following resources allowed: 1 authorized user

50 capacity unit-hours monthly limit

Environment = # of capacity units required per hour

1 vCPU + 4 GB RAM = 0.5

2 vCPU + 8 GB RAM = 1

4 vCPU + 16 GB RAM = 2

Decision Optimization = Environment + 5

So, in the preceding resources mentioned, if a 4 virtual CPU system is selected with 16 GB of memory for Watson Studio, there will be around 7 hours available time per month. This can be calculated as follows:

50 units are available for a month, 2 units are required per hour for the environment, 5 additional units are required for the decision optimization per hour, so we need 7 units per hour.

50/(5 units for the Environment plus 2) = 50/7 hours = just over 7 hours

1.2.3.2: Standard v1

The next level is called Standard v1 and it is a paid for service; this has the same unit capacity as the Lite (free) service but allows unlimited viewer collaborators; it also has a Graphics Processor Unit (GPU) offering, unlike the Lite free version:

Price (as on 8th August 2020):

$99.00 USD/instance

$0.50 USD/capacity unit-hour

$99.00 USD/authorized user

1 authorized user + unlimited viewer collaborators

50 capacity unit-hours included monthly (additional capacity available)

Unlimited elastic compute environments

Environment = # of capacity units required per hour

1 vCPU + 4 GB RAM = 0.5

2 vCPU + 8 GB RAM = 1

4 vCPU + 16 GB RAM = 2

8 vCPU + 32 GB RAM = 4

16 vCPU + 64 GB RAM = 8

4 vCPU + 24 GB RAM + 0.5 NVIDIA Tesla K80 (1 GPU) = 4

8 vCPU + 48 GB RAM + 1 NVIDIA Tesla K80 (2 GPU) = 8

16 vCPU + 96 GB RAM + 2 NVIDIA Tesla K80 (4 GPU) = 12

Decision Optimization = Environment + 5

NVIDIA K80 GPU environments available only in Dallas.

The next level is called Enterprise V2 and the top level is applied for to IBM sales and is called SQO Enterprise v2.

See Cloud PAK For Data as a service documentation details:

https://dataplatform.cloud.ibm.com/docs/content/wsj/getting-started/welcome-main.html?context=cpdaas

See Chapter 6, IBM Cloud PAK systems, of this book for the full step by step details for installing and using this software. oneWEX for single container deployment does not support high availability (HA) and scale-out by adding additional containers.

1.3: Red Hat OpenShift 4.5

1.3.1: Download location, estimated download time, and version

https://cloud.redhat.com/openshift

For the full access to the preceding URL, you need a Red Hat account.

See the following link:

https://access.redhat.com/articles/4207611

For the full access to the preceding URL, you need a Red Hat account.

1.3.2: License requirements UVU PVU

Firstly, the installation guide is effectively governed by a creative commons attribution license:

1.3.2.1: License notice

The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–ShareAlike 3.0 (CC-BY-SA 3.0) unported license. An explanation of CC-BY-SA is available at the following link:

http://creativecommons.org/licenses/by-sa/3.0/

In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version.

See the following link:

https://access.redhat.com/documentation/en-us/openshift_container_platform/4.5/html/installing_on_bare_metal/index

Deploying OpenShift 4.x on non-tested platforms using the bare metal install method (this is the method I have documented in Chapter 7, Red Hat OpenShift 4.x Installations).

1.3.2.2: Installation downloads for Red Hat OpenShift 4.5

https://cloud.redhat.com/openshift

Figure 1.8: Log in using a Red Hat account and select Create cluster

Figure 1.9: The bare metal option can be scrolled down to and selected

Figure 1.10: Select the Run on Bare Metal cluster option (highlighted)

Click on the OpenShift Installer Select OS drop-down.

The downloaded file will be found in the browser downloads area and will need to be saved where required for loading.

The downloaded openshift-install-linux.tar.gz file is copied to the bare metal Linux server, and will need to be unpacked using the tar -zxvf command for processing in the Linux environment.

Figure 1.11: Select the Download pull secret command button (highlighted)

The pull secret text file is a very small file with a code unique to your account and download session; it is required to be entered for a valid installation configuration.

Select the folder location for the pull secret file, pull-secret.txt.

See the following link:

https://docs.openshift.com/container-platform/4.5/installing/installing_bare_metal/installing-bare-metal.html#creating-machines-bare-metal

See Chapter 7, On-premise server configurations and prerequisites – Red Hat OpenShift 4.x, for the full download and installation of OpenShift 4.5. Also, note that IBM Cloud Pak for data will only function correctly up to OpenShift version 4.3, as of July 2020.

1.3.3: Fix pack location and versions

See the following link:

https://docs.openshift.com/container-platform/4.5/migration/migrating_4_2_4/migrating-application-workloads-4-2-4.html

Tools are provided for migration:

The Cluster Application Migration (CAM) tool is used to upgrade to newer versions of OpenShift.

The following URL lists the bug fix updates and provides links:

https://docs.openshift.com/container-platform/4.5/release_notes/ocp-4-5-release-notes.html

1.4: IBM Watson

This section covers the download of both the Linux direct installation and container installation downloads of the following IBM Watson products:

IBM Watson Explorer Foundational Components V12, is the Linux direct installation (non-container) software.

IBM Watson Explorer oneWEX 12.x Docker Container is the Docker container installation.

See the following link:

https://www.ibm.com/support/knowledgecenter/SS8NLW_12.0.0/com.ibm.watson.wex.ee.doc/explorer_onewex.html

1.4.1: Download location, estimated download time, and versions

The full details of the download files can be found on page 4 of the following DOI URL document:

See the following link:

https://doi.org/10.13140/RG.2.2.12248.44803

IBM Watson Explorer oneWEX 12.0.3 Docker container installation on CentOS Linux 8.0.

1.4.1.1: Downloads

The product code, CJ5DNML, highlighted below, is specific to the version of IBM Watson Explorer Deep Analytics Edition to be downloaded:

Figure 1.12: The main IBM Watson Product code for searching CJ5DNML (highlighted)

The product code is useful to identify the specific IBM software product, as it can be used to search the software catalog to target the exact version required:

Figure 1.13: The product .package code, CC1G4EN for the Linux version of IBM Watson Explorer Deep Analytics software

To search and download the preceding installation, I logged into the IBM software catalog URL (google search IBM Software Download Catalog):

https://www.ibm.com/partnerworld/program/benefits/software-access-catalog

Figure 1.14: Enter your IBM user ID and click Continue

Figure 1.15: Enter your IBM user password and click Continue

There is a link to create a new IBM id on the logon page, as shown in the preceding screenshot, which will allow a new user to apply for access (starting from July 2020, there is a new level of access to the IBM software value package, which provides an option for free access to download IBM software):

Figure 1.16: Scroll down to the bottom of the page

Look carefully at the Software Access Catalog terms and conditions, as there are license limitations which restrict the number of downloads you can make, depending on the license level of your organization:

Figure 1.17: Review the terms of use and Click I agree (or cancel)

The following page is shown for a specific agreement, which is recorded in a download history maintained by IBM:

Figure 1.18: Redirected to the Software Access Catalog Downloads page. Scroll down to search for the Software to download

You can now search for an IBM software product, based either on a text search, as shown in the following screenshot, or the product code, as described earlier:

Figure 1.19: Enter the Product name or the Product code in the other search box

The Screentext search text box has an active typeahead search, which attempts to give you a sub-set of matching products as you type, but always use the product code if possible, as this should be an exact match:

Figure 1.20: Select the required IBM Watson installation tar (or .zip) files

The two software packages, as shown in the preceding screenshot, are selected using tick boxes, for the Windows and Linux versions of IBM Watson Explorer Deep Analytics Edition, Foundational Components V12.0.3:

Figure 1.21: Select the I agree radio button to download

The I agree radio button has to be selected for download to be initiated as shown in the preceding screenshot.

Figure 1.22: Click on Open IBM Download Director

The Download Director option provides a streaming download of a Java-based program, which should prompt to be run, but recent changes to Windows 10 security updates can cause the launch of the program to fail, in which case you will get a pop-up window with a link, as shown in the following screenshot:

Figure 1.23: If the Download Director fails to start you may be prompted to install/re-install it

Figure 1.24: Follow the step-by-step instructions to install the Download Director

The preceding instructions are displayed, which you can follow to reload the Download Director .jnlp file.

Figure 1.25: Click on Install Download Director to complete the install

Figure 1.26: Save the downloaded Download Director .jnlp file to launch

The file IBM_install_DD.jnlp is downloaded and should be selected in the bottom left of the browser page, as shown in the following screenshot, so that it launches the Java program.

Figure 1.27: In the bottom left corner of the browser, double click on the .jnlp file

Figure 1.28: Click the Run command button to start the download of the selected software

1.4.1.2: If Download Director fails to run

There is a solution to this: using the HTTP option, as shown in the following screenshot:

Figure 1.29: At the top of the software selection page, change to using standard HTTP download (highlighted)

This change to HTTP loads a slightly different format of the software list on the page, such that you have to select using a single select radio-button interface shown as follows, rather than the tick-box multiple item select option available with Download Director:

Figure 1.30: On changing to this, you will see the selection change to radio button, so you can only select one download item at a time!

Figure 1.31: The HTTP file can be seen downloading in the bottom left browser page

The preceding icon in the bottom left-hand corner of the browser page shows the progress of the download.

Figure 1.32: The HTTP downloaded file can be saved using the browser to the folder required

Figure 1.33: The details screen showing the date of download and size of two downloads

If you move a downloaded file to a different disk to make space (so effectively deleting it from the Download folder), then the file will still be displayed in the Download Director details list, but with a status of DELETED, as shown in the preceding screenshot.

1.4.1.3: IBM Watson Explorer Deep Analytics Edition Foundational Components Product details

File name: IBM_WE_DEEP_ANALYTICS_EDITION_FOU.tar

Platform(s): Red Hat Entrprs Linx RHEL Base Srvr, Red Hat Entrprs Lnx RHEL Adv Pltfrm

Language(s): English

Related information: Estimated download duration

File size: 3,554,304,000 bytes

Figure 1.34: The download for IBM Watson oneWEX product code CC1GCML

In the preceding screenshot, the View details link will display the size and download speed text information, which can be cut and pasted for reference, as shown in the example shown at the start of this section, 1.4.1.3.

1.4.1.4: IBM Watson Explorer Deep Analytics Edition oneWEX Product details

File name: IBM_WE_DEEP_ANALYTICS_EDITION_EMB.tar

Platform(s): Red Hat Entrprs Linx RHEL Base Srvr, Red Hat Entrprs Lnx RHEL Adv Pltfrm

Language(s): Chinese Simplified, Chinese Traditional, English, French, German, Italian, Japanese, Korean, Portuguese Brazilian, Spanish

Related information: Estimated download duration

File size: 5,216,788,480 bytes

Figure 1.35: The download for IBM Watson Explorer Deep Analytics product code CC1G6ML

1.4.1.5: IBM Watson Explorer Deep Analytics Edition Analytical Components Product details

OneWEX processes unstructured data (free text formatted files and text streams).

File name: IBM_WAT_EXPLORER_DEEP_ANALYTICS_E.tar

Platform(s): Red Hat Entrprs Linx RHEL Base Srvr, Red Hat Entrprs Lnx RHEL Adv Pltfrm

Language(s): Chinese Simplified, Chinese Traditional, English, French, German, Italian, Japanese, Korean, Portuguese Brazilian, Spanish

Related information: Estimated download duration

File size: 4,830,801,920 bytes

Figure 1.36: Summary of the Downloads for IBM Watson products on Linux

Figure 1.37: The existing servers being targeted for IBM Cloud private installation of IBM Watson

See the following link:

https://www.ibm.com/support/knowledgecenter/SS8NLW_12.0.0/com.ibm.swg.im.infosphere.dataexpl.welcome.doc/doc/watsonexplorer_12.0.0.html

Watson Explorer oneWEX now has a combination of exploration and content analytics components. The is a Docker container based, cloud ready solution.

https://www.ibm.com/support/knowledgecenter/en/SS8NLW_12.0.0/com.ibm.watson.wex.ee.doc/c_onewex_install_docker.html

Create the installation directory on the Linux server:

cd /opt

mkdir watson

cd watson

Copy the oneWEX and other tar files downloaded to the /opt/watson directory.

1.4.1.6: Copy the Watson Analytics, Foundation and oneWEX installation downloads

Copy from FTP transfer to /home/wasadm (using the VMware Master Boot Cloud Private server); the commands to enter in a Linux command window is shown as follows: (logged in as root)

[root@ecmukdemo20 tmp]# cd /opt/watson/

[root@ecmukdemo20 watson]# ls

[root@ecmukdemo20 watson]# cp /home/wasadm/IBM_WAT_EXPLORER_DEEP_ANALYTICS_E.tar