Upgrade
Contents
Upgrade#
Here is the impact when upgrading OpenMLDB:
If the table is single-replica, users can choose:
add an extra replica before upgrading and delete it afterwards (achieved by
pre-upgradeandpost-upgrade). Then it has the same behavior as the multi-replica caseif it is acceptable that the table may be unavailable during the upgrade, users can specify
--allow_single_replicaduringpre-upgrade, which can avoid OOM caused by adding a replica if memory is limited
If the table is multi-replica, we will migrate the leader partitions in the tablet to be upgraded to other tablets, and migrate back after the upgrade. If there is write traffic during the upgrade, there may be data loss.
Note
We’ll use the normal mode(background) to start the components. If you want to start them in daemon mode, please use bash bin/start.sh start <component> mon. In daemon mode, bin/<component>.pid is the mon pid,bin/<component>.pid.child is the component pid. The mon process is not the system service, if the mon process crashed, the component process becomes the normal background process.
1. Upgrade Nameserver#
Stop nameserver
bash bin/start.sh stop nameserver
Backup the old
bindirectoryReplace with the new bin
Start the new nameserver
bash bin/start.sh start nameserver
Repeat the above steps for the remaining nameservers
2. Upgrade Tablets#
2.1. Steps of Upgrading Tablets#
pre-upgrade: to reduce the interruption to the online service before the upgrade (refer to Operation Tool)python tools/openmldb_ops.py --openmldb_bin_path=./bin/openmldb --zk_cluster=172.24.4.40:30481 --zk_root_path=/openmldb --cmd=pre-upgrade --endpoints=127.0.0.1:10921
If the unavailability of single-replica tables is ok, users can add
--allow_single_replicato avoid adding a new replica.Stop tablet
bash bin/start.sh stop tablet
Backup the old
bindirectoryReplace with the new bin
Start tablet
bash bin/start.sh start tablet
If
auto_failoveris off, we have to manuallyrecoverdatato restore data.python tools/openmldb_ops.py --openmldb_bin_path=./bin/openmldb --zk_cluster=172.24.4.40:30481 --zk_root_path=/openmldb --cmd=recoverdata
post-upgrade: revert all the actions done inpre-upgradepython tools/openmldb_ops.py --openmldb_bin_path=./bin/openmldb --zk_cluster=172.24.4.40:30481 --zk_root_path=/openmldb --cmd=post-upgrade --endpoints=127.0.0.1:10921
2.2. Confirmation of Upgrade Result#
showopstatuscommand checks whether there are operations that arekFailed, and check the log to troubleshoot the causepython tools/openmldb_ops.py --openmldb_bin_path=./bin/openmldb --zk_cluster=172.24.4.40:30481 --zk_root_path=/openmldb --cmd=showopstatus --filter=kFailed
showtablestatusto see if the statuses of all tables are okpython tools/openmldb_ops.py --openmldb_bin_path=./bin/openmldb --zk_cluster=172.24.4.40:30481 --zk_root_path=/openmldb --cmd=showtablestatus
After a tablet node is upgraded, repeat the above steps for other tablets.
After all tablets are upgraded, resume write operations, and run the showtablestatus command to check whether the Rows number has increased.
3. Upgrade APIServer#
Stop apiserver
bash bin/start.sh stop apiserver
Backup the old
bindirectoryReplace with the new
bindirectoryStart the new apiserver
bash bin/start.sh start apiserver
4. Upgrade Taskmanager#
Upgrade OpenMLDB Spark Distribution: download the new version of spark distribution and replace with the old one located in
$SPARK_HOMEStop taskmanager
bash bin/start.sh stop taskmanager
Backup the old
binandtaskmanagerdirectoriesReplace with the new
binandtaskmanagerdirectoriesStart the new taskmanager
bash bin/start.sh start taskmanager
5. Upgrade the SDKs#
Upgrade Java SDK#
Update the java sdk version number in the pom file, including
openmldb-jdbcandopenmldb-native
Upgrade Python SDK#
install the new python sdk
pip install openmldb=={NEW_VERSION}