Upgrade Deploy - JVM
This topic describes the prerequisites, considerations and process for upgrading Deploy from version 10.1 or later to the current version.
Prerequisites
Before you upgrade:
- We strongly recommend that you take a backup of configuration files and database.
- Some older database versions may not work with the latest Deploy versions. For more information, refer to System Requirements.
- Review any files that you have customized, such as
conf/deployit-security.xml
orconf/logback.xml
. You will need to redo these changes in the new files. - Check whether there are any hotfixes installed in the
hotfix
directory. If hotfixes are installed, contact the Digital.ai Support team before upgrading.
Upgrade Overview
Upgrading Deploy includes the following tasks:
- Obtain a new version of the Deploy software and, if necessary, a new license from Digital.ai.
- Read the release notes of the version of Deploy you are upgrading to so that you are aware of the new functionality and possible upgrade considerations.
- Stop the current version of Deploy if it is running and ensure that there are no active tasks.
- Extract the new Deploy release into a directory for the new version of Deploy (so the old version will still be available in case of problems).
- Copy data from the old installation directory to the new installation directory.
- Redo custom changes that you made to configuration files and startup scripts.
- Start the new version of Deploy so that automatic upgraders can run.
For more information, see the release notes for each version here in the Digital.ai Official Documentation site.
Review the following considerations before upgrading.
Masters, Workers and Satellite
You can use the procedures in this topic to upgrade Deploy masters, workers and satellites that exist in a typical production environment. Make sure that all masters, workers and satellites are upgraded to share the same version. For more information about masters, workers, and satellite configurations refer to the following topics:
Upgrading and Downgrading
After you upgrade to a new version of Deploy, you cannot downgrade to an older version. If you upgrade to a release candidate (RC), alpha, or beta version, you cannot upgrade to a newer version or downgrade to an older version. Ensure that you always create a backup of your repository before you upgrade to a new version of Deploy.
Skipping Versions
When upgrading, you can skip Deploy versions. Deploy will sequentially apply upgrades for the intermediate versions. However, you may be required to take manual actions for the intermediate versions; you can find these in the release notes.
Upgrading the Repository
If a repository upgrade is required, Deploy will detect that it is running against an old repository and will automatically execute an upgrade when it is first started. The server log will contain extensive logging of the repository upgrade process. Save this log for future reference.
Important: New functionality in Deploy or plugins may require database schema changes. As a result, the application requires additional privileges to perform the changes to the schema. These privileges include:
- ALTER, CREATE, and DROP privileges for tables, views, indexes, and triggers
- REFERENCES privilege (if applicable)
- INSERT, SELECT, UPDATE, and DELETE privileges (like in a normal operation)
Upgrading the Database
Some database versions may not be supported in the newer versions. You need to upgrade the database server. Same for the server OS, Java Runtime. In others words, you must check your environment supports the new version of Deploy.
Upgrading Plugins
A plugin version is related to the version of Deploy with which it is compatible. For example, the Kubernetes plugin version 10.1.0 requires Deploy 10.1.0 or later, unless otherwise specified in the release notes.
The new version of Deploy may not be compatible with the current version of your plugins. If this is the case, updated versions of plugins must be installed during the upgrade process.
Deploy 10.1.0 or later includes a new Plugin Manager to better manage plugins. In addition to the new UI, the directory structure has undergone several changes. All the officially supported plugins by Digital.ai must be located in the plugins/xld-official directory
and all other plugins in the plugins/__local__ directory
.
When upgrading over 10.1.0 from a lower version of Deploy, plugins must be copied into correct directories from the original plugins directory (this will be done automatically if automated copy file option is chosen, or manually otherwise).
Deploy will not prevent you from downgrading a plugin to an older version, but doing so is not recommended.
Deprecations
Each new version may deprecate some functionality or features in favor of newer ways of working. If functionality is marked as deprecated for a specific version, the old functionality is still available (so you can still upgrade hassle-free), but it will be removed in the next version.
The release notes may include information about how to migrate to the new way of working. This gives you the time and opportunity to migrate to the new situation before upgrading to a still newer version that will no longer have the old functionality. Be sure to read the deprecation information for each release you're upgrading to, so you know what will change in upcoming versions.
Upgrade Procedure
Choose one of the following options to upgrade Digital.ai Deploy:
Note: The default option of the akka.cluster.downing-provider-class
property in the deploy-cluster.yaml
file —akka.cluster.AutoDowning
—is removed in Deploy 10.2 and later versions. For more information, see Optional cluster settings
The following configuration properties of deploy-cluster.yaml
are modified in Deploy 10.2 and later versions:
-
The default option of the
akka.cluster.downing-provider-class
property —akka.cluster.AutoDowning
—is removed -
The
akka.remote.netty.tcp.hostname
andakka.remote.netty.tcp.port
properties are removed and replaced by the following properties:Parameter Default value akka.remote.artery.canonical.hostname
"127.0.0.1" akka.remote.canonical.port
25520
For more information, see Optional cluster settings
Upgrade using the automated file copy option
To upgrade from Deploy version 8.0.x or higher to a current version using the -previous-installation
option:
-
Extract the server archive for the new version of Deploy. It creates an installation directory called, for example,
xl-deploy-10.2-server
. -
Log in to your existing Deploy instance as an administrator, click Explorer, expand Monitoring, double click Deployment tasks, and select All Tasks.
- If there are any tasks with a state of Failing or Failed, cancel them.
- If there are any tasks with a state of Executing, wait for them to complete or cancel them.
- To open a task from Monitoring, double-click it.
- Ensure that no new tasks are started by enabling maintenance mode.
-
Shut down the existing Deploy server.
Note: If you are running the Deploy server as a service and you want to use it after the upgrade, you must uninstall the existing Deploy service. You must re-install the Deploy as a service from the new location after the upgrade.
-
From the
XL_DEPLOY_SERVER_HOME/bin
location of the new installation (e.g.,xl-deploy-10.2.0-server/bin
), run one of the following commands, depending on your operating system:For Unix-based systems:
./run.sh -setup -previous-installation `XL_DEPLOY_SERVER_HOME_EXISTING`
For Microsoft Windows:
run.cmd -setup -previous-installation `XL_DEPLOY_SERVER_HOME_EXISTING`
Note:
XL_DEPLOY_SERVER_HOME_EXISTING
is the path of the old installation directory. For example: For Unix-based systems:"/home/.../xl-deploy-10.2.0-server"
For Microsoft Windows:"C:......\xl-deploy-10.2.0-server"
The following message displays:
Do you want to copy files to the new installation?
Files to be copied [conf/deployit-license.lic, conf/deployit.conf, conf/deployit-defaults.properties, conf/xl-deploy.conf, conf/central-config.version, conf/command-whitelist.json, conf/db-anonymize.json, conf/repository-keystore.jceks, centralConfiguration/xld-client-gui.yaml, centralConfiguration/xld-command-whitelist.yaml, centralConfiguration/xld-db-anonymizer.yaml, centralConfiguration/xld-secret-complexity.yaml, centralConfiguration/xld-websockets.yaml] -
Type
yes
. Your response is registered. Files listed in theconf
directory will be copied the new installation. The following prompt displays:Do you want to copy directory [XL_DEPLOY_SERVER_HOME_EXISTING/ext] to the new installation?
-
Type
yes
. Your response is registered. The contents of theext
directory will be copied to the new installation. -
The
plugins
directory is parsed. Depending on the differences between the existingplugins
and the newplugins
directory, the following behavior occurs:- If a plugin exists in the previous installation, but is not found in the new installation, you are prompted to copy it to the new installation. Type
yes
to copy the plugin to the new installation orno
to not copy it. - If a plugin exists in the previous installation but a new version of it is available in the new installation, the following output is provided for each plugin:
Plugin [plugin-name] has been updated [9.0.0 -> 10.2.0]. Not copying it.
- When upgrading over 10.1.0, the automated file copy option will copy files from the
plugins
directory into eitherplugins/xld-official
(if a plugin is one of the officially supported Deploy plugins) orplugins/__local__
(if a plugin was developed by a 3rd party and is not among the list of officially supported plugins). Both above points still apply during automatic copying of plugins.
- If a plugin exists in the previous installation, but is not found in the new installation, you are prompted to copy it to the new installation. Type
-
The following message displays:
Going to copy configuration from previous installation [XL_DEPLOY_SERVER_HOME_EXISTING]
User response was: [yes]. Copying files [conf/deployit-license.lic, conf/deployit.conf, conf/deployit-defaults.properties, conf/repository-keystore.jceks].A status for each of the copied files in the
conf
directory is provided. For example:File [conf/deployit.conf] was copied to the new installation.
-
The contents of the
ext
directory are copied to the new installation. -
Once all copying is successful, the following message displays:
Copied selected files from previous installation.
=> UPGRADE FILES MANUALLY
The following files could not be upgraded automatically and were not copied.
- Database driver inside the lib directory -
Copy the
repository
directory from the old installation directory to the new installation directory.
This step differs depending on the upgrade scenarios. If you are upgrading from Deploy 10.0 and later versions to Deploy 10.2 and Deploy 10.2 to later versions:
Copy the Artifacts folder under the repository
directory from the old installation directory to the new installation directory.
-
Assuming you are using an external database for your repository, copy your database driver to the new installation. Typically, the database driver is stored in your
lib
directory. -
If you have changed other files in the
conf
directory, such asdeployit-security.xml
orlogback.xml
, do not copy the changed files to the new installation directory. Instead, manually reapply the changes to the files that were provided in the new version of Deploy. -
Copy the contents of the
importablePackages
directory from the old installation directory to the new installation directory. -
If you have changed the Deploy server startup script(s) in the
bin
directory, do not copy the changed script(s) to the new installation directory. Instead, manually reapply the changes to the files that were provided in the new version of Deploy.
Note: There are alsoinstall-service.sh
andinstall-service.cmd
scripts for running Deploy as a service. If you customized therun
orinstall-service
scripts in the old installation, you must redo these changes in theinstall-service
script in the new installation. -
Start the Deploy server interactively (instead of starting as a background process or service) to allow automatic repository upgraders to run.
Note: The upgrade process may ask questions or ask for confirmation. -
If you normally run the Deploy server as a service, shut it down and restart it as you normally do.
Upgrade by manually copying files
To upgrade from Deploy version 8.0.x or higher to a current version, manually copying files from the old installation to the new installation:
- Extract the server archive for the new version of Deploy. It creates an installation directory called, for example,
xl-deploy-10.2.0-server
. - Log in to your existing Deploy instance as an administrator, click Explorer, expand Monitoring, double click Deployment tasks, and select All Tasks.
- If there are any tasks with a state of Failing or Failed, cancel them.
- If there are any tasks with a state of Executing, wait for them to complete or cancel them.
- To open a task from Monitoring, double-click it.
- Ensure that no new tasks are started by enabling maintenance mode.
- Shut down the Deploy server. Note: If you are running the Deploy server as a service and you want to use it after the upgrade, you must uninstall the existing Deploy service. You must re-install the Deploy as a service from the new location after the upgrade.
- Copy the
repository
directory from the old installation directory to the new installation directory.
This step differs depending on the upgrade scenarios. If you are migrating from Deploy 9.5 and later versions to Deploy 10.2 and Deploy 10.2 to later versions:
Copy the Artifacts folder under the repository
directory from the old installation directory to the new installation directory.
-
Copy the contents of the
importablePackages
directory from the old installation directory to the new installation directory. -
Copy the contents of the
plugins
directory from the old installation directory to the new installation directory (unless new versions of your plugins were provided with the new Deploy version).Note: With Deploy 10.1.0 and later, plugins from the plugins directory must be copied into
plugins/xld-official
orplugins/__local__
directory. The official supported plugins documentation contains a list of all plugins which must be copied into theplugins/xld-official
directory. For more information about plugins, see Base Plugins and the Deployed Object. Any other third party plugins not mentioned in the official documentation must be copied into theplugins/__local__
directory. -
Copy the contents of the
ext
directory from the old installation directory to the new installation directory. -
If you added libraries to Deploy's
lib
directory (such as database drivers), copy the additional libraries from the old installation directory to the new installation directory. -
Verify that libraries in the
lib
directory do not also appear in theplugins
directory, even if their versions are different.For example, if
lib
containsguava-27.1.jar
, then theplugins
directory should not contain anyguava-x.x.jar
file (such asguava-20.0.jar
). In this case, you must remove the library from theplugins
directory. -
Copy the
conf/deployit-license.lic
file from the old installation directory to the new installation directory. -
Copy the following files from existing
conf
directory to the new installation'sconf
directory:deployit.conf
deployit-defaults.properties
repository-keystore.jceks
file (if it exists) from the old installation directory to the new installation directory.
-
If you have changed other files in the
conf
directory, such asdeployit-security.xml
orlogback.xml
, do not copy the changed files to the new installation directory. Instead, manually reapply the changes to the files that were provided in the new version of Deploy. -
If you have changed the Deploy server startup script(s) in the
bin
directory, do not copy the changed script(s) to the new installation directory. Instead, manually reapply the changes to the files that were provided in the new version of Deploy. Note: There are alsoinstall-service.sh
andinstall-service.cmd
scripts for running Deploy as a service. If you customized therun
orinstall-service
scripts in the old installation, you must redo these changes in theinstall-service
script in the new installation. -
Start the Deploy server interactively (instead of starting as a background process or service) to allow automatic repository upgraders to run. Note: The upgrade process may ask questions or ask for confirmation.
-
If you normally run the Deploy server as a service, shut it down and restart it as you normally do.
Verify Migration of Configuration Files
In Deploy 10.1 and 10.2 versions, the Deploy configuration files are migrated to the centralConfiguration
directory. For more information about the Central Configuration feature, see Central Configuration.
After copying the files (automated file copy or manually), you must verify the migration of the configuration files to the centralConfiguration
directory. For more information about manually copying the centralConfiguration
directory, see Central Configuration as a Standalone Service
Configuration Files Migrated in Deploy 10.1
In Deploy 10.1, the following configuration files are migrated to the Central Configuration directory:
xld-client-gui
xld-command-whitelist
xld-db-anonymizer
xld-secret-complexity
xld-websockets
Configuration Files Migrated in Deploy 10.2
In Deploy 10.2, the following configuration files are migrated to the Central Configuration directory:
deploy-artifact-resolver
deploy-cluster
deploy-client
type-defaults.properties
deploy-satellite
deploy-task
deploy-jmx
deploy-metrics
deploy-oidc
deploy-plugins
deploy-repository
deploy-server
Note:
- In Deploy 10.2, all the configuration files migrated to the Central Configuration directory have the prefix—deploy. The configuration files that were migrated to Central Configuration directory in 10.1 are renamed to reflect this change.
- The
deploy-client-gui.yaml
file is no longer available, and is subsumed bydeploy-client.yaml
file. - The
deployit-defaults.properties
file is renamed astype-defaults.properties
. - If you use any regex pattern-based property such as
file.File.textFileNamesRegex
, Deploy escapes the backslash character\
so that it is not lost in server restarts. Should you modify these properties with any other custom values, you must make sure to escape the\
character with another backslash.- For example,
file.File.textFileNamesRegex=.+\.(cfg | conf | config | ini | properties | props | txt | xml)
must have two backslashes as shown in the following example:file.File.textFileNamesRegex=.+\\.(cfg | conf | config | ini | properties | props | txt | xml)
.
- For example,
For more information, see Migration of Configuration Files in the Central Configuration Overview topic.
Verify Configuration Files
If you have performed a fresh installation of Digital.ai Deploy 10.1 or Deploy 10.2, do the following:
-
Verify whether the configuration files for the release are available in the
centralConfiguration
directory. -
Configure the configuration files in the directory.
-
To refresh the configuration files without restarting server, invoke the refresh Spring Boot Actuator endpoint manually by forcing the client to refresh and generate the new value:
$ curl -u admin:<admin_password> XLD_URL/actuator/refresh -d {} -H "Content-Type: application/json"
Verify Migration of Configuration Files
This section describes the steps that you need to perform after you upgrade to the newer version of Digital.ai Deploy versions —Deploy 10.0 to Deploy 10.1 and Deploy 10.1 to Deploy 10.2—to ensure the configuration files are migrated to the centralConfiguration
directory.
Deploy 10.0 to Deploy 10.1 or Later
- In the Deploy 10.1, verify the configuration files in the
centralConfiguration
directory (XL_DEPLOY_SERVER_HOME/centralConfiguration
). - Copy the configuration files from the older server (Deploy 10.0) to the new server (Deploy 10.1). See Upgrade Procedures.
- Start the Deploy server.
- Verify the migration of the configuration files (the
centralConfiguration
directory) post upgrade. - Restart the server.
Deploy 10.1 to Deploy 10.2 or Later
- In Deploy 10.2, verify the centralConfiguration directory (
XL_DEPLOY_SERVER_HOME/centralConfiguration
). - Copy the configuration files from the older server (Deploy 10.1) to the new server (Deploy 10.2). See Upgrade Procedures.
- Start the Deploy server.
- Verify the migration of the configuration files (the
centralConfiguration
directory) post upgrade. - Restart the server.
Note: A restart is required after the upgrade, as some of the configuration files do not get populated immediately.
Run Central Configuration as a Standalone Service
After you have upgrade the Digital.ai Deploy solution, you can run the Central Configuration as a standalone service on a Docker container or Docker volume. For more information, see Central Configuration Service as a Separate Service.
Upgrade the Deploy CLI
To upgrade a Deploy command-line interface (CLI) installation:
-
Create a directory for the new Deploy CLI installation, including the new Deploy CLI version number in the directory name.
-
Extract the CLI archive in this directory.
-
Copy the contents of the
plugins
directory from the previous installation to the new installation directory (unless new versions of your plugins were provided with the new Deploy version). -
Copy the contents of the
ext
directory from the previous installation to the new installation directory.Note: Do not copy the content of the
hotfix
directory unless instructed to do so (because hotfixes are version-specific). -
If you have made any changes to the Deploy CLI startup scripts (
cli.sh
orcli.cmd
), copy these from thebin
directory in the previous installation to the new installation directory.