2023-06-15T16:36:10.556 INFO:root:teuthology version: 0.0.1.dev124+g961f4fb 2023-06-15T16:36:10.732 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging 2023-06-15T16:36:10.733 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server 2023-06-15T16:36:10.733 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-06-15T16:36:10.760 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2023-06-15T16:36:10.761 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2023-06-15T16:36:10.761 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-06-15T16:36:10.917 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 8.stream 2023-06-15T16:36:10.931 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 8.stream 2023-06-15T16:36:11.204 INFO:teuthology.orchestra.console:Power off smithi115 2023-06-15T16:36:11.219 INFO:teuthology.orchestra.console:Power off smithi017 2023-06-15T16:36:11.359 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2023-06-15T16:36:11.367 INFO:teuthology.orchestra.console:Power off for smithi017 completed 2023-06-15T16:36:11.461 INFO:teuthology.orchestra.console:Power on smithi115 2023-06-15T16:36:11.472 INFO:teuthology.orchestra.console:Power on smithi017 2023-06-15T16:36:15.724 INFO:teuthology.orchestra.console:Power on for smithi115 completed 2023-06-15T16:36:15.825 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2023-06-15T16:36:19.844 INFO:teuthology.orchestra.console:Power on for smithi017 completed 2023-06-15T16:36:19.945 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2023-06-15T16:39:09.168 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-06-15T16:39:18.228 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-06-15T16:39:20.176 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-06-15T16:39:27.312 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-06-15T16:39:29.232 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-06-15T16:39:36.368 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-06-15T16:39:38.288 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-06-15T16:39:47.344 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-06-15T16:39:56.400 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-06-15T16:40:42.413 WARNING:teuthology.provision.fog:timed out 2023-06-15T16:40:48.832 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-15T16:40:49.116 INFO:teuthology.provision.fog.smithi017:Node is ready 2023-06-15T16:40:49.137 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2023-06-15T16:40:49.197 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2023-06-15T16:40:49.616 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2023-06-15T16:40:49.616 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8" 2023-06-15T16:40:49.617 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2023-06-15T16:40:49.617 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2023-06-15T16:40:49.617 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8" 2023-06-15T16:40:49.617 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-06-15T16:40:49.618 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-15T16:40:49.618 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-06-15T16:40:49.618 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-15T16:40:49.618 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2023-06-15T16:40:49.619 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-15T16:40:49.619 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-15T16:40:49.619 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-15T16:40:49.620 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2023-06-15T16:41:02.416 WARNING:teuthology.provision.fog:timed out 2023-06-15T16:41:08.626 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-15T16:41:08.878 INFO:teuthology.provision.fog.smithi115:Node is ready 2023-06-15T16:41:08.897 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2023-06-15T16:41:08.957 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2023-06-15T16:41:09.335 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2023-06-15T16:41:09.336 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8" 2023-06-15T16:41:09.336 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2023-06-15T16:41:09.336 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2023-06-15T16:41:09.336 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8" 2023-06-15T16:41:09.336 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2023-06-15T16:41:09.336 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-15T16:41:09.337 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-06-15T16:41:09.337 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-15T16:41:09.337 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2023-06-15T16:41:09.337 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-15T16:41:09.337 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-15T16:41:09.337 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-15T16:41:09.337 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2023-06-15T16:41:09.499 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2023-06-15T16:41:09.499 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-15T16:41:09.524 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2023-06-15T16:41:09.524 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-15T16:41:09.551 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2023-06-15T16:41:09.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-06-15T16:41:09.821 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2023-06-15T16:41:09.881 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2023-06-15T16:41:09.882 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8" 2023-06-15T16:41:09.882 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2023-06-15T16:41:09.882 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2023-06-15T16:41:09.882 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8" 2023-06-15T16:41:09.883 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-06-15T16:41:09.883 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-15T16:41:09.883 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-06-15T16:41:09.883 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-15T16:41:09.883 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2023-06-15T16:41:09.883 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-15T16:41:09.883 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-15T16:41:09.884 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-15T16:41:09.884 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-06-15T16:41:09.916 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2023-06-15T16:41:09.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-06-15T16:41:10.110 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2023-06-15T16:41:10.169 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2023-06-15T16:41:10.169 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8" 2023-06-15T16:41:10.169 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2023-06-15T16:41:10.169 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2023-06-15T16:41:10.169 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8" 2023-06-15T16:41:10.170 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2023-06-15T16:41:10.170 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-15T16:41:10.170 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-06-15T16:41:10.170 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-15T16:41:10.170 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2023-06-15T16:41:10.172 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-15T16:41:10.172 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-15T16:41:10.172 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-15T16:41:10.173 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-06-15T16:41:10.309 INFO:teuthology.dispatcher.supervisor:Running job 7305514 2023-06-15T16:41:10.309 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_961f4fb51318c373681de5844aadbc6dc0e58abc/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-15_15:17:25-fs-wip-yuri4-testing-2023-06-14-0910-quincy-distro-default-smithi/7305514 --name yuriw-2023-06-15_15:17:25-fs-wip-yuri4-testing-2023-06-14-0910-quincy-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-06-15_15:17:25-fs-wip-yuri4-testing-2023-06-14-0910-quincy-distro-default-smithi/7305514/orig.config.yaml 2023-06-15T16:41:10.313 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-15_15:17:25-fs-wip-yuri4-testing-2023-06-14-0910-quincy-distro-default-smithi/7305514 2023-06-15T16:41:10.314 INFO:teuthology.dispatcher.supervisor:Job PID: 8805 2023-06-15T16:41:10.315 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-15T17:11:12.875 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-15T17:11:12.992 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-15T17:11:12.993 INFO:teuthology.nuke:Checking targets against current locks 2023-06-15T17:11:13.044 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-15T17:11:13.073 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-15T17:11:13.128 INFO:teuthology.orchestra.console:Power off smithi017 2023-06-15T17:11:13.146 INFO:teuthology.orchestra.console:Power off smithi115 2023-06-15T17:11:13.280 INFO:teuthology.orchestra.console:Power off for smithi017 completed 2023-06-15T17:11:13.292 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2023-06-15T17:11:13.428 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com 2023-06-15T17:11:13.436 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com