2021-06-11T06:15:22.572 INFO:root:teuthology version: 1.1.0-f359b10d 2021-06-11T06:15:22.663 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging 2021-06-11T06:15:22.664 INFO:teuthology.lock.ops:Updating [ubuntu@smithi136.front.sepia.ceph.com]: reset os type and version on server 2021-06-11T06:15:22.664 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2021-06-11T06:15:22.678 INFO:teuthology.lock.ops:Node 'ubuntu@smithi136.front.sepia.ceph.com' reimaging is complete 2021-06-11T06:15:22.678 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi143.front.sepia.ceph.com' reimaging 2021-06-11T06:15:22.678 INFO:teuthology.lock.ops:Updating [ubuntu@smithi143.front.sepia.ceph.com]: reset os type and version on server 2021-06-11T06:15:22.679 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2021-06-11T06:15:22.693 INFO:teuthology.lock.ops:Node 'ubuntu@smithi143.front.sepia.ceph.com' reimaging is complete 2021-06-11T06:15:22.882 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 8.2 2021-06-11T06:15:22.890 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of centos 8.2 2021-06-11T06:15:23.233 INFO:teuthology.orchestra.console:Power off smithi136 2021-06-11T06:15:23.269 INFO:teuthology.orchestra.console:Power off smithi143 2021-06-11T06:15:35.720 INFO:teuthology.orchestra.console:Power off for smithi136 completed 2021-06-11T06:15:35.745 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2021-06-11T06:15:35.822 INFO:teuthology.orchestra.console:Power on smithi136 2021-06-11T06:15:35.849 INFO:teuthology.orchestra.console:Power on smithi143 2021-06-11T06:15:40.079 INFO:teuthology.orchestra.console:Power on for smithi136 completed 2021-06-11T06:15:40.097 INFO:teuthology.orchestra.console:Power on for smithi143 completed 2021-06-11T06:15:40.181 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2021-06-11T06:15:40.197 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2021-06-11T06:19:47.056 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-06-11T06:20:07.814 INFO:teuthology.provision.fog.smithi143:Node is ready 2021-06-11T06:20:07.834 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2021-06-11T06:20:07.890 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2021-06-11T06:20:08.236 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2021-06-11T06:20:27.522 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-06-11T06:20:27.811 INFO:teuthology.provision.fog.smithi136:Node is ready 2021-06-11T06:20:27.826 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com 2021-06-11T06:20:27.881 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2021-06-11T06:20:28.227 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2021-06-11T06:20:28.350 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2021-06-11T06:20:28.351 INFO:teuthology.lock.ops:New key found. Updating... 2021-06-11T06:20:28.366 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2021-06-11T06:20:28.367 INFO:teuthology.lock.ops:New key found. Updating... 2021-06-11T06:20:28.383 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2021-06-11T06:20:28.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-11T06:20:28.651 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2021-06-11T06:20:28.704 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Linux" 2021-06-11T06:20:28.705 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8 (Core)" 2021-06-11T06:20:28.705 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2021-06-11T06:20:28.705 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2021-06-11T06:20:28.705 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8" 2021-06-11T06:20:28.705 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2021-06-11T06:20:28.706 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-06-11T06:20:28.706 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2021-06-11T06:20:28.706 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-06-11T06:20:28.706 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.centos.org/" 2021-06-11T06:20:28.707 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-06-11T06:20:28.707 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-06-11T06:20:28.707 INFO:teuthology.orchestra.run.smithi136.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-06-11T06:20:28.707 INFO:teuthology.orchestra.run.smithi136.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-06-11T06:20:28.707 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-06-11T06:20:28.708 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-06-11T06:20:28.708 INFO:teuthology.orchestra.run.smithi136.stdout: 2021-06-11T06:20:28.709 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2021-06-11T06:20:28.724 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2021-06-11T06:20:28.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-11T06:20:28.996 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2021-06-11T06:20:29.051 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Linux" 2021-06-11T06:20:29.051 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8 (Core)" 2021-06-11T06:20:29.051 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2021-06-11T06:20:29.052 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2021-06-11T06:20:29.052 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8" 2021-06-11T06:20:29.052 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2021-06-11T06:20:29.053 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-06-11T06:20:29.053 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2021-06-11T06:20:29.053 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-06-11T06:20:29.053 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.centos.org/" 2021-06-11T06:20:29.053 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-06-11T06:20:29.054 INFO:teuthology.orchestra.run.smithi143.stdout: 2021-06-11T06:20:29.054 INFO:teuthology.orchestra.run.smithi143.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-06-11T06:20:29.054 INFO:teuthology.orchestra.run.smithi143.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-06-11T06:20:29.054 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-06-11T06:20:29.055 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-06-11T06:20:29.055 INFO:teuthology.orchestra.run.smithi143.stdout: 2021-06-11T06:20:29.055 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2021-06-11T06:20:29.130 INFO:teuthology.dispatcher.supervisor:Running job 6166202 2021-06-11T06:20:29.130 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/bin/teuthology -v --owner scheduled_ideepika@teuthology --archive /home/teuthworker/archive/ideepika-2021-06-11_06:09:22-rados-wip-yuri7-testing-2021-06-08-0747-octopus-distro-basic-smithi/6166202 --name ideepika-2021-06-11_06:09:22-rados-wip-yuri7-testing-2021-06-08-0747-octopus-distro-basic-smithi --description rados/cephadm/upgrade/{1-start-distro/1-start-centos_8 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2} -- /home/teuthworker/archive/ideepika-2021-06-11_06:09:22-rados-wip-yuri7-testing-2021-06-08-0747-octopus-distro-basic-smithi/6166202/orig.config.yaml 2021-06-11T06:20:29.133 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ideepika-2021-06-11_06:09:22-rados-wip-yuri7-testing-2021-06-08-0747-octopus-distro-basic-smithi/6166202 2021-06-11T06:20:29.134 INFO:teuthology.dispatcher.supervisor:Job PID: 15652 2021-06-11T06:20:29.134 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-06-11T18:21:13.528 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-06-11T18:21:13.666 INFO:teuthology.kill:Killing Pids: {15652} 2021-06-11T18:21:14.801 INFO:teuthology.kill:Nuking machines: ['smithi136', 'smithi143'] 2021-06-11T18:21:15.735 INFO:teuthology.kill:2021-06-11 18:21:15,735.735 INFO:teuthology.nuke:targets: 2021-06-11T18:21:15.736 INFO:teuthology.kill: smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvnIbBsPk+CtfuFeHyNAniDNJ1CcH6gFuRrMAEsKcsdtNIneuEWswHmooJK0x7hx+Gf8UwHH85qgkFxDMcOAbn9JTn86qcvkUkdV/1dnUQ0Q1OLSeMvMquqPrSdMIn7+s7GtJsudmrzydL9Atq8pJ2PXUMMibSFGiYJ2yH1XwTrKvr/JHvKB1ZcBhSe54nJyiGyQhwT7PgPoQlheEZIKLlHO9VMOKBJnXBszVutjfA/MYzPbHBvle1f1ACtlAFfVTHGkP3GwYAiuEp9+arLKnMojrv2CBcIVNAUPT6hN2DmAvjvW1U261t0MweXjK5IgaPD+xhLHvTzKmLMINJ5DLML2u1ib3AI8ngC/5PbLaruzmDZ0fuzXMr+HE99TWK32OQaMa9KbJXW1qr/NPKDHly5W0JDm0KcQ6Q+2r8VhJttfuo7p/8PMbp0J1yFrUck1gemGOjNN6Z3EvppXE/5QOenmdZWWGJ4zUa84JODu8DL8WuFqyVK28FXFOR86UBopU= 2021-06-11T18:21:15.737 INFO:teuthology.kill: smithi143.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkpeaSReXck4pLb0qW0O2oOzsszhuvLzRpMNqOi4tAmH2pP0QVaGaCa4TgIdxmavKil2hS92hv5OXIOxEGhi2G/ddkHjTlzZtBQ2Grqww5FdsvUdbhXGiK+5p2wk+1AxoHHqGud4megBHreBPxa+eHPyIgVxUQos0MMKmlMj/kcE3fJts1Sll/rYymgQFKUsxOVppfa4aM+yC5edwSCeriQ0ktn4apZoqCn9ZYoTlD0gofYuFvc58yxkIETWuaVfA/SYswg0IWmBtySjm23BFtR6K1O7r4mEPxxRuP2vmIejmc9HFDTo129qOZETQyhPk6lRTXrHt+yqIceyd7LOLnnyoxXp7GNph0RdanJZF0NohONwGqtF8Uo0UjMuWTRSDypZg/9rf0i+pzVQxQkiiZmR9giJXOLqBVIG6TaMdYErU9+hUTn6AmEWd+yzLvTvz5xblCS990L7j4kpA0MY+iyxwsLyYs0Px4nH+P26lVq42sfh68XXtJ4dNsZ3gZN/U= 2021-06-11T18:21:15.737 INFO:teuthology.kill:2021-06-11 18:21:15,735.735 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-11T18:21:15.738 INFO:teuthology.kill:2021-06-11 18:21:15,738.738 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-11T18:21:15.800 INFO:teuthology.kill:2021-06-11 18:21:15,800.800 INFO:teuthology.orchestra.console:Power off smithi143 2021-06-11T18:21:15.815 INFO:teuthology.kill:2021-06-11 18:21:15,815.815 INFO:teuthology.orchestra.console:Power off smithi136 2021-06-11T18:21:24.177 INFO:teuthology.kill:2021-06-11 18:21:24,176.176 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2021-06-11T18:21:24.182 INFO:teuthology.kill:2021-06-11 18:21:24,182.182 INFO:teuthology.orchestra.console:Power off for smithi136 completed 2021-06-11T18:21:24.403 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2021-06-11T18:21:24.403 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2021-06-11T18:21:24.404 INFO:teuthology.misc:Compressing logs... 2021-06-11T18:21:24.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-06-11T18:22:24.467 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/misc.py", line 1378, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/remote.py", line 509, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-06-11T18:22:24.521 INFO:teuthology.kill:No teuthology processes running 2021-06-11T18:22:25.615 INFO:teuthology.kill:Nuking machines: ['smithi136', 'smithi143'] 2021-06-11T18:22:26.542 INFO:teuthology.kill:2021-06-11 18:22:26,542.542 INFO:teuthology.nuke:targets: 2021-06-11T18:22:26.543 INFO:teuthology.kill: smithi136.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvnIbBsPk+CtfuFeHyNAniDNJ1CcH6gFuRrMAEsKcsdtNIneuEWswHmooJK0x7hx+Gf8UwHH85qgkFxDMcOAbn9JTn86qcvkUkdV/1dnUQ0Q1OLSeMvMquqPrSdMIn7+s7GtJsudmrzydL9Atq8pJ2PXUMMibSFGiYJ2yH1XwTrKvr/JHvKB1ZcBhSe54nJyiGyQhwT7PgPoQlheEZIKLlHO9VMOKBJnXBszVutjfA/MYzPbHBvle1f1ACtlAFfVTHGkP3GwYAiuEp9+arLKnMojrv2CBcIVNAUPT6hN2DmAvjvW1U261t0MweXjK5IgaPD+xhLHvTzKmLMINJ5DLML2u1ib3AI8ngC/5PbLaruzmDZ0fuzXMr+HE99TWK32OQaMa9KbJXW1qr/NPKDHly5W0JDm0KcQ6Q+2r8VhJttfuo7p/8PMbp0J1yFrUck1gemGOjNN6Z3EvppXE/5QOenmdZWWGJ4zUa84JODu8DL8WuFqyVK28FXFOR86UBopU= 2021-06-11T18:22:26.543 INFO:teuthology.kill: smithi143.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkpeaSReXck4pLb0qW0O2oOzsszhuvLzRpMNqOi4tAmH2pP0QVaGaCa4TgIdxmavKil2hS92hv5OXIOxEGhi2G/ddkHjTlzZtBQ2Grqww5FdsvUdbhXGiK+5p2wk+1AxoHHqGud4megBHreBPxa+eHPyIgVxUQos0MMKmlMj/kcE3fJts1Sll/rYymgQFKUsxOVppfa4aM+yC5edwSCeriQ0ktn4apZoqCn9ZYoTlD0gofYuFvc58yxkIETWuaVfA/SYswg0IWmBtySjm23BFtR6K1O7r4mEPxxRuP2vmIejmc9HFDTo129qOZETQyhPk6lRTXrHt+yqIceyd7LOLnnyoxXp7GNph0RdanJZF0NohONwGqtF8Uo0UjMuWTRSDypZg/9rf0i+pzVQxQkiiZmR9giJXOLqBVIG6TaMdYErU9+hUTn6AmEWd+yzLvTvz5xblCS990L7j4kpA0MY+iyxwsLyYs0Px4nH+P26lVq42sfh68XXtJ4dNsZ3gZN/U= 2021-06-11T18:22:26.566 INFO:teuthology.kill:2021-06-11 18:22:26,565.565 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-11T18:22:26.567 INFO:teuthology.kill:2021-06-11 18:22:26,567.567 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-11T18:22:26.624 INFO:teuthology.kill:2021-06-11 18:22:26,624.624 INFO:teuthology.orchestra.console:Power off smithi136 2021-06-11T18:22:26.638 INFO:teuthology.kill:2021-06-11 18:22:26,638.638 INFO:teuthology.orchestra.console:Power off smithi143 2021-06-11T18:22:26.780 INFO:teuthology.kill:2021-06-11 18:22:26,780.780 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2021-06-11T18:22:26.792 INFO:teuthology.kill:2021-06-11 18:22:26,792.792 INFO:teuthology.orchestra.console:Power off for smithi136 completed 2021-06-11T18:22:26.933 INFO:teuthology.kill:2021-06-11 18:22:26,932.932 INFO:teuthology.lock.ops:unlocked smithi136.front.sepia.ceph.com 2021-06-11T18:22:26.942 INFO:teuthology.kill:2021-06-11 18:22:26,942.942 INFO:teuthology.lock.ops:unlocked smithi143.front.sepia.ceph.com 2021-06-11T18:24:27.227 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-06-11T18:24:27.297 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-06-11T18:24:27.297 INFO:teuthology.nuke:Checking targets against current locks 2021-06-11T18:24:27.411 INFO:teuthology.nuke:Not nuking smithi143.front.sepia.ceph.com because description doesn't match 2021-06-11T18:24:27.412 INFO:teuthology.nuke:Not nuking smithi136.front.sepia.ceph.com because description doesn't match