2021-05-07T18:39:13.935 INFO:root:teuthology version: 1.1.0-19220a3b 2021-05-07T18:39:14.036 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi016.front.sepia.ceph.com' reimaging 2021-05-07T18:39:14.037 INFO:teuthology.lock.ops:Updating [ubuntu@smithi016.front.sepia.ceph.com]: reset os type and version on server 2021-05-07T18:39:14.038 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2021-05-07T18:39:14.053 INFO:teuthology.lock.ops:Node 'ubuntu@smithi016.front.sepia.ceph.com' reimaging is complete 2021-05-07T18:39:14.053 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi084.front.sepia.ceph.com' reimaging 2021-05-07T18:39:14.054 INFO:teuthology.lock.ops:Updating [ubuntu@smithi084.front.sepia.ceph.com]: reset os type and version on server 2021-05-07T18:39:14.054 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2021-05-07T18:39:14.070 INFO:teuthology.lock.ops:Node 'ubuntu@smithi084.front.sepia.ceph.com' reimaging is complete 2021-05-07T18:39:14.264 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of rhel 8.3 2021-05-07T18:39:14.275 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of rhel 8.3 2021-05-07T18:39:14.596 INFO:teuthology.orchestra.console:Power off smithi016 2021-05-07T18:39:14.612 INFO:teuthology.orchestra.console:Power off smithi084 2021-05-07T18:39:22.965 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2021-05-07T18:39:23.066 INFO:teuthology.orchestra.console:Power on smithi016 2021-05-07T18:39:27.087 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2021-05-07T18:39:27.189 INFO:teuthology.orchestra.console:Power on smithi084 2021-05-07T18:39:31.427 INFO:teuthology.orchestra.console:Power on for smithi016 completed 2021-05-07T18:39:31.438 INFO:teuthology.orchestra.console:Power on for smithi084 completed 2021-05-07T18:39:31.529 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2021-05-07T18:39:31.540 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2021-05-07T18:43:35.425 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-07T18:43:45.520 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-05-07T18:43:45.838 INFO:teuthology.provision.fog.smithi016:Node is ready 2021-05-07T18:43:45.853 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2021-05-07T18:43:45.908 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2021-05-07T18:43:46.232 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2021-05-07T18:43:55.915 INFO:teuthology.provision.fog.smithi084:Node is ready 2021-05-07T18:43:55.936 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2021-05-07T18:43:55.993 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2021-05-07T18:43:56.353 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2021-05-07T18:43:56.484 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2021-05-07T18:43:56.484 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-07T18:43:56.501 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2021-05-07T18:43:56.501 INFO:teuthology.lock.ops:New key found. Updating... 2021-05-07T18:43:56.515 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2021-05-07T18:43:56.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-07T18:43:56.813 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2021-05-07T18:43:56.868 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux" 2021-05-07T18:43:56.868 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8.3 (Ootpa)" 2021-05-07T18:43:56.869 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2021-05-07T18:43:56.869 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2021-05-07T18:43:56.869 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8.3" 2021-05-07T18:43:56.869 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2021-05-07T18:43:56.869 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-05-07T18:43:56.870 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2021-05-07T18:43:56.870 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-05-07T18:43:56.870 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2021-05-07T18:43:56.870 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-05-07T18:43:56.871 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-05-07T18:43:56.871 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-05-07T18:43:56.871 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-05-07T18:43:56.871 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-05-07T18:43:56.871 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-05-07T18:43:56.873 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2021-05-07T18:43:56.889 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2021-05-07T18:43:56.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-05-07T18:43:57.172 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2021-05-07T18:43:57.226 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux" 2021-05-07T18:43:57.226 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.3 (Ootpa)" 2021-05-07T18:43:57.226 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel" 2021-05-07T18:43:57.226 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora" 2021-05-07T18:43:57.227 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.3" 2021-05-07T18:43:57.227 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2021-05-07T18:43:57.227 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-05-07T18:43:57.227 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2021-05-07T18:43:57.228 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-05-07T18:43:57.228 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/" 2021-05-07T18:43:57.228 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-05-07T18:43:57.228 INFO:teuthology.orchestra.run.smithi084.stdout: 2021-05-07T18:43:57.228 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-05-07T18:43:57.229 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-05-07T18:43:57.229 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-05-07T18:43:57.229 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-05-07T18:43:57.229 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2021-05-07T18:43:57.315 INFO:teuthology.dispatcher.supervisor:Running job 6104785 2021-05-07T18:43:57.315 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_19220a3bd6e252c6e8260827019668a766d85490/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-05-07_18:25:10-upgrade:pacific-x:stress-split-wip-sage3-testing-2021-05-07-1141-distro-basic-smithi/6104785 --name sage-2021-05-07_18:25:10-upgrade:pacific-x:stress-split-wip-sage3-testing-2021-05-07-1141-distro-basic-smithi --description upgrade:pacific-x:stress-split/{0-distro/rhel_8.3_kubic_stable 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/sage-2021-05-07_18:25:10-upgrade:pacific-x:stress-split-wip-sage3-testing-2021-05-07-1141-distro-basic-smithi/6104785/orig.config.yaml 2021-05-07T18:43:57.318 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-05-07_18:25:10-upgrade:pacific-x:stress-split-wip-sage3-testing-2021-05-07-1141-distro-basic-smithi/6104785 2021-05-07T18:43:57.319 INFO:teuthology.dispatcher.supervisor:Job PID: 3917 2021-05-07T18:43:57.320 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-05-07T19:03:58.640 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-05-07T19:03:58.759 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-05-07T19:03:58.759 INFO:teuthology.nuke:Checking targets against current locks 2021-05-07T19:03:58.844 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-07T19:03:58.847 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-05-07T19:03:58.902 INFO:teuthology.orchestra.console:Power off smithi016 2021-05-07T19:03:58.915 INFO:teuthology.orchestra.console:Power off smithi084 2021-05-07T19:04:03.162 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2021-05-07T19:04:03.166 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2021-05-07T19:04:03.295 ERROR:teuthology.lock.ops:failed to unlock smithi016.front.sepia.ceph.com. reason: Cannot unlock an already-unlocked node 2021-05-07T19:04:03.297 ERROR:teuthology.lock.ops:failed to unlock smithi084.front.sepia.ceph.com. reason: Cannot unlock an already-unlocked node