2023-06-15T18:03:48.447 INFO:root:teuthology version: 0.0.1.dev124+g961f4fb 2023-06-15T18:03:48.612 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2023-06-15T18:03:48.613 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2023-06-15T18:03:48.613 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-06-15T18:03:48.630 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-06-15T18:03:48.630 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-06-15T18:03:48.630 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-06-15T18:03:48.782 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of centos 8.stream 2023-06-15T18:03:48.806 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of centos 8.stream 2023-06-15T18:03:49.026 INFO:teuthology.orchestra.console:Power off smithi006 2023-06-15T18:03:49.045 INFO:teuthology.orchestra.console:Power off smithi033 2023-06-15T18:03:49.178 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2023-06-15T18:03:49.188 INFO:teuthology.orchestra.console:Power off for smithi033 completed 2023-06-15T18:03:49.280 INFO:teuthology.orchestra.console:Power on smithi006 2023-06-15T18:03:49.290 INFO:teuthology.orchestra.console:Power on smithi033 2023-06-15T18:03:53.545 INFO:teuthology.orchestra.console:Power on for smithi033 completed 2023-06-15T18:03:53.646 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-06-15T18:03:57.649 INFO:teuthology.orchestra.console:Power on for smithi006 completed 2023-06-15T18:03:57.751 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2023-06-15T18:06:43.056 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-06-15T18:06:52.112 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-06-15T18:07:01.168 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-06-15T18:07:13.986 ERROR:teuthology.orchestra.connection:Error authenticating with smithi006.front.sepia.ceph.com: Authentication failed. 2023-06-15T18:07:25.556 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-06-15T18:07:34.612 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-06-15T18:07:43.198 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-15T18:07:58.437 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-06-15T18:07:58.462 INFO:teuthology.orchestra.run.smithi033.stdout:smithi193 2023-06-15T18:07:58.524 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-06-15T18:07:59.035 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2023-06-15T18:07:59.035 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8" 2023-06-15T18:07:59.036 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2023-06-15T18:07:59.036 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2023-06-15T18:07:59.036 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8" 2023-06-15T18:07:59.037 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-06-15T18:07:59.037 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-15T18:07:59.037 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-06-15T18:07:59.037 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-15T18:07:59.037 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2023-06-15T18:07:59.037 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-15T18:07:59.037 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-15T18:07:59.038 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-15T18:07:59.038 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2023-06-15T18:08:14.989 WARNING:teuthology.provision.fog:timed out 2023-06-15T18:08:39.536 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-06-15T18:08:48.596 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-06-15T18:08:54.918 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-15T18:09:10.145 INFO:teuthology.provision.fog.smithi006:Node is ready 2023-06-15T18:09:10.170 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2023-06-15T18:09:10.233 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2023-06-15T18:09:10.661 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2023-06-15T18:09:10.661 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8" 2023-06-15T18:09:10.662 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2023-06-15T18:09:10.662 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2023-06-15T18:09:10.662 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8" 2023-06-15T18:09:10.662 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-06-15T18:09:10.662 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-15T18:09:10.662 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-06-15T18:09:10.662 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-15T18:09:10.663 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2023-06-15T18:09:10.663 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-15T18:09:10.663 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-15T18:09:10.663 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-15T18:09:10.663 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2023-06-15T18:09:10.819 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2023-06-15T18:09:10.820 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-15T18:09:10.848 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2023-06-15T18:09:10.848 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-15T18:09:10.873 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2023-06-15T18:09:10.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-06-15T18:09:11.066 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-06-15T18:09:11.125 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2023-06-15T18:09:11.125 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8" 2023-06-15T18:09:11.125 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2023-06-15T18:09:11.126 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2023-06-15T18:09:11.126 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8" 2023-06-15T18:09:11.126 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-06-15T18:09:11.126 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-15T18:09:11.126 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-06-15T18:09:11.126 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-15T18:09:11.126 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2023-06-15T18:09:11.127 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-15T18:09:11.127 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-15T18:09:11.127 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-15T18:09:11.127 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-06-15T18:09:11.147 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2023-06-15T18:09:11.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-06-15T18:09:11.416 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-06-15T18:09:11.476 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2023-06-15T18:09:11.476 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8" 2023-06-15T18:09:11.476 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2023-06-15T18:09:11.477 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2023-06-15T18:09:11.477 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8" 2023-06-15T18:09:11.477 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-06-15T18:09:11.477 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-15T18:09:11.477 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-06-15T18:09:11.478 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-15T18:09:11.478 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2023-06-15T18:09:11.478 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-15T18:09:11.478 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-15T18:09:11.478 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-15T18:09:11.479 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-06-15T18:09:11.606 INFO:teuthology.dispatcher.supervisor:Running job 7305634 2023-06-15T18:09:11.606 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_961f4fb51318c373681de5844aadbc6dc0e58abc/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-15_15:17:25-fs-wip-yuri4-testing-2023-06-14-0910-quincy-distro-default-smithi/7305634 --name yuriw-2023-06-15_15:17:25-fs-wip-yuri4-testing-2023-06-14-0910-quincy-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-06-15_15:17:25-fs-wip-yuri4-testing-2023-06-14-0910-quincy-distro-default-smithi/7305634/orig.config.yaml 2023-06-15T18:09:11.610 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-15_15:17:25-fs-wip-yuri4-testing-2023-06-14-0910-quincy-distro-default-smithi/7305634 2023-06-15T18:09:11.611 INFO:teuthology.dispatcher.supervisor:Job PID: 6905 2023-06-15T18:09:11.611 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-15T20:53:17.911 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-15T20:53:18.102 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-15T20:53:18.102 INFO:teuthology.nuke:Checking targets against current locks 2023-06-15T20:53:18.159 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-15T20:53:18.172 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-15T20:53:18.230 INFO:teuthology.orchestra.console:Power off smithi006 2023-06-15T20:53:18.245 INFO:teuthology.orchestra.console:Power off smithi033 2023-06-15T20:53:18.383 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2023-06-15T20:53:18.386 INFO:teuthology.orchestra.console:Power off for smithi033 completed 2023-06-15T20:53:18.545 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com 2023-06-15T20:53:18.551 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com