2024-03-21T13:45:44.575 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-21T13:45:44.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T13:45:44.728 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe0e300ec10>, signals=[15]) 2024-03-21T13:45:44.729 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging 2024-03-21T13:45:44.729 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T13:45:44.729 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-03-21T13:45:44.754 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging 2024-03-21T13:45:44.755 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T13:45:44.755 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-03-21T13:45:44.899 DEBUG:teuthology.provision.fog.smithi176:Requesting image smithi_centos_9.stream (ID 10) 2024-03-21T13:45:44.904 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_centos_9.stream (ID 10) 2024-03-21T13:45:44.961 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of centos 9.stream 2024-03-21T13:45:44.965 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of centos 9.stream 2024-03-21T13:45:45.306 INFO:teuthology.orchestra.console.smithi176:Power off 2024-03-21T13:45:45.306 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T13:45:45.320 INFO:teuthology.orchestra.console.smithi177:Power off 2024-03-21T13:45:45.321 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T13:45:45.329 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off 2024-03-21T13:45:45.330 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T13:45:45.343 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2024-03-21T13:45:45.344 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T13:45:45.366 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-03-21T13:45:45.368 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2024-03-21T13:45:45.467 INFO:teuthology.orchestra.console.smithi177:Power off completed 2024-03-21T13:45:45.469 INFO:teuthology.orchestra.console.smithi176:Power off completed 2024-03-21T13:45:45.568 INFO:teuthology.orchestra.console.smithi177:Power on 2024-03-21T13:45:45.568 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T13:45:45.576 INFO:teuthology.orchestra.console.smithi176:Power on 2024-03-21T13:45:45.576 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T13:45:45.596 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On 2024-03-21T13:45:45.597 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T13:45:45.607 DEBUG:teuthology.orchestra.console.smithi176:power on output: Chassis Power Control: Up/On 2024-03-21T13:45:45.608 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T13:45:45.625 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-03-21T13:45:45.632 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2024-03-21T13:45:49.630 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T13:45:49.637 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T13:45:49.740 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-03-21T13:45:49.745 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2024-03-21T13:45:49.841 INFO:teuthology.orchestra.console.smithi177:Power on completed 2024-03-21T13:45:49.942 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish 2024-03-21T13:45:53.746 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T13:45:53.855 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2024-03-21T13:45:53.956 INFO:teuthology.orchestra.console.smithi176:Power on completed 2024-03-21T13:45:54.057 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish 2024-03-21T13:48:36.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:48:39.653 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-21T13:48:45.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:48:48.734 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-21T13:48:54.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:48:57.790 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-21T13:49:03.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:49:06.878 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-21T13:49:10.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:49:12.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:49:13.886 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-03-21T13:49:15.934 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-21T13:49:19.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:49:21.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:49:22.946 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-03-21T13:49:28.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:49:32.030 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-03-21T13:49:38.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:49:40.254 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-21T13:49:41.086 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-03-21T13:49:46.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:49:47.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:49:49.310 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-21T13:49:50.142 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-03-21T13:49:55.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:49:56.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:49:58.322 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T13:49:58.323 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T13:49:59.202 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-03-21T13:50:05.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:50:08.286 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-03-21T13:50:14.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:50:23.704 INFO:teuthology.provision.fog.smithi177:Node is ready 2024-03-21T13:50:23.704 DEBUG:teuthology.orchestra.run.smithi177:> hostname 2024-03-21T13:50:23.722 INFO:teuthology.orchestra.run.smithi177.stdout:smithi046 2024-03-21T13:50:23.722 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi046 /etc/hosts 2024-03-21T13:50:23.780 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-03-21T13:50:23.780 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2024-03-21T13:50:23.916 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi046/smithi177/g' /etc/hosts 2024-03-21T13:50:23.949 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.46/172.21.15.177/g' /etc/hosts 2024-03-21T13:50:24.016 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi046/smithi177/g' /etc/hostname 2024-03-21T13:50:24.084 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2024-03-21T13:50:24.154 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-03-21T13:50:24.208 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-03-21T13:50:24.209 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-03-21T13:50:24.209 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-03-21T13:50:24.209 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-03-21T13:50:24.209 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-03-21T13:50:24.209 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-03-21T13:50:24.209 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T13:50:24.209 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-03-21T13:50:24.209 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-03-21T13:50:24.209 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T13:50:24.209 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-03-21T13:50:24.209 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T13:50:24.209 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T13:50:24.210 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T13:50:24.210 INFO:teuthology.provision.fog.smithi177:Deploy complete! 2024-03-21T13:50:24.212 DEBUG:teuthology.parallel:result is None 2024-03-21T13:50:32.738 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-03-21T13:50:38.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:50:41.822 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-03-21T13:50:47.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:50:50.882 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-03-21T13:50:56.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:50:57.194 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T13:50:57.195 DEBUG:teuthology.orchestra.run.smithi176:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T13:51:12.622 INFO:teuthology.provision.fog.smithi176:Node is ready 2024-03-21T13:51:12.623 DEBUG:teuthology.orchestra.run.smithi176:> hostname 2024-03-21T13:51:12.680 INFO:teuthology.orchestra.run.smithi176.stdout:smithi046 2024-03-21T13:51:12.681 DEBUG:teuthology.orchestra.run.smithi176:> grep smithi046 /etc/hosts 2024-03-21T13:51:12.738 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-03-21T13:51:12.738 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176 2024-03-21T13:51:12.874 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi046/smithi176/g' /etc/hosts 2024-03-21T13:51:12.904 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/172.21.15.46/172.21.15.176/g' /etc/hosts 2024-03-21T13:51:12.973 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi046/smithi176/g' /etc/hostname 2024-03-21T13:51:13.041 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176 2024-03-21T13:51:13.110 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-03-21T13:51:13.164 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2024-03-21T13:51:13.165 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2024-03-21T13:51:13.165 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2024-03-21T13:51:13.165 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2024-03-21T13:51:13.165 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2024-03-21T13:51:13.165 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2024-03-21T13:51:13.165 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T13:51:13.165 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2024-03-21T13:51:13.165 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2024-03-21T13:51:13.165 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T13:51:13.165 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2024-03-21T13:51:13.165 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T13:51:13.165 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T13:51:13.165 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T13:51:13.166 INFO:teuthology.provision.fog.smithi176:Deploy complete! 2024-03-21T13:51:13.166 DEBUG:teuthology.parallel:result is None 2024-03-21T13:51:13.338 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com 2024-03-21T13:51:13.339 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T13:51:13.366 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com 2024-03-21T13:51:13.366 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T13:51:13.384 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server 2024-03-21T13:51:13.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-03-21T13:51:13.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:51:13.474 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-03-21T13:51:13.540 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-03-21T13:51:13.540 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2024-03-21T13:51:13.595 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2024-03-21T13:51:13.595 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-03-21T13:51:13.653 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2024-03-21T13:51:13.653 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2024-03-21T13:51:13.653 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2024-03-21T13:51:13.653 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2024-03-21T13:51:13.653 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2024-03-21T13:51:13.653 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2024-03-21T13:51:13.653 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T13:51:13.653 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2024-03-21T13:51:13.653 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2024-03-21T13:51:13.654 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T13:51:13.654 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2024-03-21T13:51:13.654 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T13:51:13.654 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T13:51:13.654 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T13:51:13.654 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-03-21T13:51:13.683 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server 2024-03-21T13:51:13.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-03-21T13:51:13.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T13:51:13.771 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-03-21T13:51:13.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-03-21T13:51:13.945 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-03-21T13:51:13.999 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-03-21T13:51:14.000 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-03-21T13:51:14.054 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-03-21T13:51:14.054 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-03-21T13:51:14.054 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-03-21T13:51:14.054 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-03-21T13:51:14.055 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-03-21T13:51:14.055 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-03-21T13:51:14.055 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T13:51:14.055 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-03-21T13:51:14.055 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-03-21T13:51:14.055 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T13:51:14.055 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-03-21T13:51:14.055 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T13:51:14.055 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T13:51:14.055 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T13:51:14.056 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-03-21T13:51:14.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T13:51:14.186 INFO:teuthology.dispatcher.supervisor:Running job 7613760 2024-03-21T13:51:14.186 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613760 --name teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613760/orig.config.yaml 2024-03-21T13:51:14.189 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613760 2024-03-21T13:51:14.190 INFO:teuthology.dispatcher.supervisor:Job PID: 1171309 2024-03-21T13:51:14.190 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-21T13:53:14.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T13:55:14.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T13:57:14.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T13:59:14.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:01:14.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:03:15.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:05:15.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:07:15.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:09:15.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:11:15.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:13:16.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:15:16.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:17:16.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:19:16.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:21:16.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:23:16.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:25:17.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:27:17.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:29:17.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:31:17.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:33:17.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:35:17.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:37:18.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:39:18.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:41:18.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:43:18.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:45:18.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:47:18.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:49:19.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:51:19.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:53:19.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:55:19.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:57:19.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T14:59:19.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:01:20.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:03:20.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:05:20.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:07:20.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:09:20.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:11:20.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:13:21.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:15:21.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:17:21.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:19:21.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:21:21.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:23:22.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:25:22.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:27:22.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:29:22.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:31:22.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:33:22.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:35:23.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:37:23.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:39:23.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:41:23.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:43:23.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:45:23.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:47:24.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:49:24.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:51:24.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:53:24.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:55:24.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:57:24.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T15:59:24.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:01:25.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:03:25.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:05:25.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:07:25.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:09:25.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:11:26.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:13:26.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:15:26.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:17:26.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:19:26.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:21:26.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:23:27.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:25:27.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:27:27.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:29:27.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:31:27.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:33:27.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:35:28.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:37:28.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:39:28.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:41:28.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:43:28.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:45:28.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:47:29.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:49:29.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:51:29.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:53:29.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:55:29.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:57:30.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:59:30.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:01:30.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:03:30.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:05:30.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:07:30.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:09:31.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:11:31.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:13:31.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:15:31.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:17:31.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:19:31.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:21:32.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:23:32.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:25:32.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:27:32.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:29:32.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:31:32.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:33:33.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:35:33.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:37:33.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:39:33.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:41:33.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T17:41:33.839 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1