2023-06-15T17:43:43.926 INFO:root:teuthology version: 0.0.1.dev124+g961f4fb 2023-06-15T17:43:44.090 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2023-06-15T17:43:44.091 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2023-06-15T17:43:44.091 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-06-15T17:43:44.116 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-06-15T17:43:44.117 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-06-15T17:43:44.117 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-06-15T17:43:44.274 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 8.stream 2023-06-15T17:43:44.292 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream 2023-06-15T17:43:44.544 INFO:teuthology.orchestra.console:Power off smithi161 2023-06-15T17:43:44.562 INFO:teuthology.orchestra.console:Power off smithi153 2023-06-15T17:43:44.701 INFO:teuthology.orchestra.console:Power off for smithi161 completed 2023-06-15T17:43:44.713 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2023-06-15T17:43:44.803 INFO:teuthology.orchestra.console:Power on smithi161 2023-06-15T17:43:44.814 INFO:teuthology.orchestra.console:Power on smithi153 2023-06-15T17:43:49.060 INFO:teuthology.orchestra.console:Power on for smithi161 completed 2023-06-15T17:43:49.161 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-06-15T17:43:53.181 INFO:teuthology.orchestra.console:Power on for smithi153 completed 2023-06-15T17:43:53.282 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2023-06-15T17:47:27.984 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-06-15T17:47:37.040 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-06-15T17:47:46.096 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-06-15T17:47:53.844 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-06-15T17:47:55.152 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-06-15T17:48:02.932 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-06-15T17:48:04.208 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-06-15T17:48:12.016 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-06-15T17:48:13.264 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-06-15T17:48:21.072 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-06-15T17:49:19.320 WARNING:teuthology.provision.fog:timed out 2023-06-15T17:49:25.618 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-15T17:49:25.861 INFO:teuthology.provision.fog.smithi153:Node is ready 2023-06-15T17:49:25.881 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2023-06-15T17:49:25.942 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2023-06-15T17:49:26.358 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2023-06-15T17:49:26.359 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8" 2023-06-15T17:49:26.359 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2023-06-15T17:49:26.359 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2023-06-15T17:49:26.360 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8" 2023-06-15T17:49:26.360 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2023-06-15T17:49:26.360 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-15T17:49:26.361 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-06-15T17:49:26.361 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-15T17:49:26.361 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2023-06-15T17:49:26.362 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-15T17:49:26.362 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-15T17:49:26.362 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-15T17:49:26.363 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2023-06-15T17:49:27.078 WARNING:teuthology.provision.fog:timed out 2023-06-15T17:49:33.379 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-15T17:49:33.607 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-06-15T17:49:33.666 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2023-06-15T17:49:33.726 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2023-06-15T17:49:34.135 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-06-15T17:49:34.135 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2023-06-15T17:49:34.135 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-06-15T17:49:34.136 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-06-15T17:49:34.136 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2023-06-15T17:49:34.136 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-06-15T17:49:34.136 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-15T17:49:34.136 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-06-15T17:49:34.136 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-15T17:49:34.137 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-06-15T17:49:34.137 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-15T17:49:34.137 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-15T17:49:34.137 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-15T17:49:34.137 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-06-15T17:49:34.293 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2023-06-15T17:49:34.294 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-15T17:49:34.321 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-06-15T17:49:34.321 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-15T17:49:34.347 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2023-06-15T17:49:34.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-06-15T17:49:34.550 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-06-15T17:49:34.610 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2023-06-15T17:49:34.610 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8" 2023-06-15T17:49:34.610 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2023-06-15T17:49:34.610 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2023-06-15T17:49:34.610 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8" 2023-06-15T17:49:34.611 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2023-06-15T17:49:34.611 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-15T17:49:34.611 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-06-15T17:49:34.611 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-15T17:49:34.611 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2023-06-15T17:49:34.611 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-15T17:49:34.611 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-15T17:49:34.612 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-15T17:49:34.612 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-06-15T17:49:34.638 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-06-15T17:49:34.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-06-15T17:49:34.791 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-06-15T17:49:34.850 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-06-15T17:49:34.850 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2023-06-15T17:49:34.850 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-06-15T17:49:34.851 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-06-15T17:49:34.851 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2023-06-15T17:49:34.851 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-06-15T17:49:34.851 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-15T17:49:34.852 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-06-15T17:49:34.852 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-15T17:49:34.852 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-06-15T17:49:34.852 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-15T17:49:34.853 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-15T17:49:34.853 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-15T17:49:34.854 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-06-15T17:49:35.097 INFO:teuthology.dispatcher.supervisor:Running job 7305608 2023-06-15T17:49:35.098 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_961f4fb51318c373681de5844aadbc6dc0e58abc/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-15_15:17:25-fs-wip-yuri4-testing-2023-06-14-0910-quincy-distro-default-smithi/7305608 --name yuriw-2023-06-15_15:17:25-fs-wip-yuri4-testing-2023-06-14-0910-quincy-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-06-15_15:17:25-fs-wip-yuri4-testing-2023-06-14-0910-quincy-distro-default-smithi/7305608/orig.config.yaml 2023-06-15T17:49:35.102 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-15_15:17:25-fs-wip-yuri4-testing-2023-06-14-0910-quincy-distro-default-smithi/7305608 2023-06-15T17:49:35.103 INFO:teuthology.dispatcher.supervisor:Job PID: 15519 2023-06-15T17:49:35.103 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-15T19:09:42.138 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-15T19:09:42.271 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-15T19:09:42.272 INFO:teuthology.nuke:Checking targets against current locks 2023-06-15T19:09:42.321 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-15T19:09:42.345 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-15T19:09:42.398 INFO:teuthology.orchestra.console:Power off smithi153 2023-06-15T19:09:42.439 INFO:teuthology.orchestra.console:Power off smithi161 2023-06-15T19:09:42.549 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2023-06-15T19:09:42.578 INFO:teuthology.orchestra.console:Power off for smithi161 completed 2023-06-15T19:09:42.713 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com 2023-06-15T19:09:42.727 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com