2023-06-13T16:26:24.594 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-13T16:26:24.799 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging 2023-06-13T16:26:24.801 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server 2023-06-13T16:26:24.801 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-06-13T16:26:24.831 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging 2023-06-13T16:26:24.831 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server 2023-06-13T16:26:24.831 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-06-13T16:26:24.856 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2023-06-13T16:26:24.856 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2023-06-13T16:26:24.856 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-06-13T16:26:24.987 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 9.stream 2023-06-13T16:26:25.026 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of centos 9.stream 2023-06-13T16:26:25.042 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 9.stream 2023-06-13T16:26:25.240 INFO:teuthology.orchestra.console:Power off smithi052 2023-06-13T16:26:25.261 INFO:teuthology.orchestra.console:Power off smithi067 2023-06-13T16:26:25.277 INFO:teuthology.orchestra.console:Power off smithi119 2023-06-13T16:26:33.650 INFO:teuthology.orchestra.console:Power off for smithi052 completed 2023-06-13T16:26:33.658 INFO:teuthology.orchestra.console:Power off for smithi067 completed 2023-06-13T16:26:33.663 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2023-06-13T16:26:33.752 INFO:teuthology.orchestra.console:Power on smithi052 2023-06-13T16:26:33.762 INFO:teuthology.orchestra.console:Power on smithi067 2023-06-13T16:26:33.771 INFO:teuthology.orchestra.console:Power on smithi119 2023-06-13T16:26:42.147 INFO:teuthology.orchestra.console:Power on for smithi052 completed 2023-06-13T16:26:42.153 INFO:teuthology.orchestra.console:Power on for smithi067 completed 2023-06-13T16:26:42.168 INFO:teuthology.orchestra.console:Power on for smithi119 completed 2023-06-13T16:26:42.248 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish 2023-06-13T16:26:42.254 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish 2023-06-13T16:26:42.269 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2023-06-13T16:29:16.212 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-06-13T16:29:16.213 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-06-13T16:29:16.214 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-13T16:29:25.296 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-06-13T16:29:25.297 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-13T16:29:25.297 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-06-13T16:29:34.384 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-06-13T16:29:34.385 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-13T16:29:34.385 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-06-13T16:29:43.476 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-13T16:29:43.477 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-06-13T16:29:43.478 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-06-13T16:29:52.560 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-06-13T16:29:52.564 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-13T16:29:52.565 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-06-13T16:30:01.616 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-06-13T16:30:01.648 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-13T16:30:01.649 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-06-13T16:30:10.705 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-06-13T16:30:10.708 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-06-13T16:30:35.120 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-06-13T16:30:35.121 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-06-13T16:30:44.176 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-06-13T16:30:44.208 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.67 2023-06-13T16:30:51.163 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-13T16:30:52.771 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-13T16:31:07.652 WARNING:teuthology.provision.fog:timed out 2023-06-13T16:31:14.027 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-13T16:31:14.365 INFO:teuthology.provision.fog.smithi052:Node is ready 2023-06-13T16:31:14.381 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com 2023-06-13T16:31:14.437 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052 2023-06-13T16:31:14.844 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2023-06-13T16:31:14.844 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2023-06-13T16:31:14.845 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2023-06-13T16:31:14.845 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2023-06-13T16:31:14.845 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2023-06-13T16:31:14.846 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2023-06-13T16:31:14.846 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2023-06-13T16:31:14.846 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2023-06-13T16:31:14.846 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2023-06-13T16:31:14.847 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-06-13T16:31:14.847 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2023-06-13T16:31:14.848 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-13T16:31:14.848 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-06-13T16:31:14.848 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-13T16:31:14.850 INFO:teuthology.provision.fog.smithi052:Deploy complete! 2023-06-13T16:31:16.606 INFO:teuthology.provision.fog.smithi119:Node is ready 2023-06-13T16:31:16.664 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com 2023-06-13T16:31:16.722 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119 2023-06-13T16:31:17.142 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2023-06-13T16:31:17.142 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2023-06-13T16:31:17.142 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2023-06-13T16:31:17.143 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2023-06-13T16:31:17.143 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2023-06-13T16:31:17.143 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2023-06-13T16:31:17.143 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2023-06-13T16:31:17.144 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-06-13T16:31:17.144 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2023-06-13T16:31:17.144 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-06-13T16:31:17.145 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2023-06-13T16:31:17.145 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-13T16:31:17.145 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-06-13T16:31:17.145 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-13T16:31:17.146 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2023-06-13T16:31:18.184 INFO:teuthology.provision.fog.smithi067:Node is ready 2023-06-13T16:31:18.204 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com 2023-06-13T16:31:18.265 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067 2023-06-13T16:31:18.696 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2023-06-13T16:31:18.697 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2023-06-13T16:31:18.697 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2023-06-13T16:31:18.697 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2023-06-13T16:31:18.698 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2023-06-13T16:31:18.698 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2023-06-13T16:31:18.698 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2023-06-13T16:31:18.699 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-06-13T16:31:18.699 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2023-06-13T16:31:18.699 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-06-13T16:31:18.700 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2023-06-13T16:31:18.701 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-13T16:31:18.701 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-06-13T16:31:18.701 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-13T16:31:18.701 INFO:teuthology.provision.fog.smithi067:Deploy complete! 2023-06-13T16:31:18.906 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com 2023-06-13T16:31:18.907 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-13T16:31:18.933 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com 2023-06-13T16:31:18.933 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-13T16:31:18.949 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2023-06-13T16:31:18.950 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-13T16:31:18.976 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server 2023-06-13T16:31:18.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-06-13T16:31:19.203 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2023-06-13T16:31:19.260 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2023-06-13T16:31:19.260 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2023-06-13T16:31:19.261 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2023-06-13T16:31:19.261 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2023-06-13T16:31:19.261 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2023-06-13T16:31:19.262 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2023-06-13T16:31:19.262 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2023-06-13T16:31:19.262 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2023-06-13T16:31:19.262 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2023-06-13T16:31:19.262 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-06-13T16:31:19.262 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2023-06-13T16:31:19.262 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-13T16:31:19.263 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-06-13T16:31:19.263 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-13T16:31:19.263 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-06-13T16:31:19.283 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server 2023-06-13T16:31:19.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-06-13T16:31:19.514 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2023-06-13T16:31:19.569 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2023-06-13T16:31:19.570 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2023-06-13T16:31:19.570 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2023-06-13T16:31:19.570 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2023-06-13T16:31:19.570 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2023-06-13T16:31:19.570 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2023-06-13T16:31:19.571 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2023-06-13T16:31:19.571 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-06-13T16:31:19.571 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2023-06-13T16:31:19.571 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-06-13T16:31:19.571 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2023-06-13T16:31:19.571 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-13T16:31:19.571 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-06-13T16:31:19.571 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-13T16:31:19.572 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-06-13T16:31:19.591 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2023-06-13T16:31:19.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-06-13T16:31:19.801 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2023-06-13T16:31:19.857 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2023-06-13T16:31:19.858 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2023-06-13T16:31:19.858 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2023-06-13T16:31:19.858 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2023-06-13T16:31:19.858 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2023-06-13T16:31:19.858 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2023-06-13T16:31:19.859 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2023-06-13T16:31:19.859 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-06-13T16:31:19.859 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2023-06-13T16:31:19.859 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-06-13T16:31:19.859 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2023-06-13T16:31:19.859 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-13T16:31:19.859 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-06-13T16:31:19.860 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-13T16:31:19.860 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-06-13T16:31:19.992 INFO:teuthology.dispatcher.supervisor:Running job 7302174 2023-06-13T16:31:19.992 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-13_14:55:01-fs-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi/7302174 --name yuriw-2023-06-13_14:55:01-fs-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} -- /home/teuthworker/archive/yuriw-2023-06-13_14:55:01-fs-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi/7302174/orig.config.yaml 2023-06-13T16:31:19.997 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-13_14:55:01-fs-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi/7302174 2023-06-13T16:31:19.998 INFO:teuthology.dispatcher.supervisor:Job PID: 11678 2023-06-13T16:31:19.998 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-13T16:47:21.358 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120