2024-04-08T22:34:22.757 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-08T22:34:22.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T22:34:22.911 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0e99dfec10>, signals=[15]) 2024-04-08T22:34:22.911 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging 2024-04-08T22:34:22.912 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server 2024-04-08T22:34:22.912 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2024-04-08T22:34:22.935 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging 2024-04-08T22:34:22.935 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server 2024-04-08T22:34:22.935 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-04-08T22:34:23.054 DEBUG:teuthology.provision.fog.smithi045:Requesting image smithi_centos_9.stream (ID 10) 2024-04-08T22:34:23.080 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_centos_9.stream (ID 10) 2024-04-08T22:34:23.105 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of centos 9.stream 2024-04-08T22:34:23.123 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 9.stream 2024-04-08T22:34:23.330 INFO:teuthology.orchestra.console.smithi045:Power off 2024-04-08T22:34:23.330 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-08T22:34:23.343 INFO:teuthology.orchestra.console.smithi120:Power off 2024-04-08T22:34:23.343 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-08T22:34:23.356 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2024-04-08T22:34:23.357 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T22:34:23.369 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off 2024-04-08T22:34:23.369 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T22:34:23.379 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2024-04-08T22:34:23.394 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-04-08T22:34:27.385 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T22:34:27.395 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T22:34:27.494 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2024-04-08T22:34:27.504 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-04-08T22:34:31.496 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T22:34:31.504 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T22:34:31.605 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2024-04-08T22:34:31.613 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-04-08T22:34:35.610 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T22:34:35.620 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T22:34:35.721 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2024-04-08T22:34:35.727 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-04-08T22:34:35.825 INFO:teuthology.orchestra.console.smithi045:Power off completed 2024-04-08T22:34:35.828 INFO:teuthology.orchestra.console.smithi120:Power off completed 2024-04-08T22:34:35.926 INFO:teuthology.orchestra.console.smithi045:Power on 2024-04-08T22:34:35.927 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-08T22:34:35.935 INFO:teuthology.orchestra.console.smithi120:Power on 2024-04-08T22:34:35.935 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-08T22:34:35.949 DEBUG:teuthology.orchestra.console.smithi045:power on output: Chassis Power Control: Up/On 2024-04-08T22:34:35.949 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T22:34:35.958 DEBUG:teuthology.orchestra.console.smithi120:power on output: Chassis Power Control: Up/On 2024-04-08T22:34:35.958 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T22:34:35.971 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2024-04-08T22:34:35.979 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-04-08T22:34:39.974 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T22:34:39.981 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T22:34:40.083 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2024-04-08T22:34:40.089 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-04-08T22:34:40.185 INFO:teuthology.orchestra.console.smithi045:Power on completed 2024-04-08T22:34:40.286 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2024-04-08T22:34:44.094 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T22:34:44.203 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-04-08T22:34:44.304 INFO:teuthology.orchestra.console.smithi120:Power on completed 2024-04-08T22:34:44.405 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish 2024-04-08T22:37:10.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:37:14.015 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-04-08T22:37:20.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:37:23.102 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-04-08T22:37:29.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:37:30.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:37:32.158 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-04-08T22:37:33.118 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-08T22:37:38.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:37:39.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:37:41.214 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-04-08T22:37:42.178 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-08T22:37:47.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:37:48.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:37:50.270 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-04-08T22:37:51.262 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-08T22:37:56.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:37:57.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:38:00.318 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-08T22:38:06.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:38:09.406 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-08T22:38:15.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:38:18.466 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-08T22:38:24.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:38:56.310 WARNING:teuthology.provision.fog.smithi045:timed out 2024-04-08T22:39:02.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:39:02.566 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-08T22:39:02.567 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-08T22:39:02.920 INFO:teuthology.provision.fog.smithi045:Node is ready 2024-04-08T22:39:02.920 DEBUG:teuthology.orchestra.run.smithi045:> hostname 2024-04-08T22:39:02.934 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2024-04-08T22:39:02.935 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts 2024-04-08T22:39:02.990 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2024-04-08T22:39:02.990 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2024-04-08T22:39:03.099 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts 2024-04-08T22:39:03.129 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts 2024-04-08T22:39:03.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname 2024-04-08T22:39:03.269 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2024-04-08T22:39:03.339 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2024-04-08T22:39:03.394 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2024-04-08T22:39:03.394 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9" 2024-04-08T22:39:03.394 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2024-04-08T22:39:03.394 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2024-04-08T22:39:03.395 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9" 2024-04-08T22:39:03.395 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9" 2024-04-08T22:39:03.395 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-08T22:39:03.395 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2024-04-08T22:39:03.395 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon" 2024-04-08T22:39:03.395 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-08T22:39:03.395 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2024-04-08T22:39:03.395 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T22:39:03.395 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-08T22:39:03.395 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T22:39:03.396 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2024-04-08T22:39:03.397 DEBUG:teuthology.parallel:result is None 2024-04-08T22:39:24.494 WARNING:teuthology.provision.fog.smithi120:timed out 2024-04-08T22:39:30.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:39:30.755 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-08T22:39:30.755 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-08T22:39:31.083 INFO:teuthology.provision.fog.smithi120:Node is ready 2024-04-08T22:39:31.083 DEBUG:teuthology.orchestra.run.smithi120:> hostname 2024-04-08T22:39:31.098 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com 2024-04-08T22:39:31.098 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120.front.sepia.ceph.com /etc/hosts 2024-04-08T22:39:31.153 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120 2024-04-08T22:39:31.153 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2024-04-08T22:39:31.260 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hosts 2024-04-08T22:39:31.288 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts 2024-04-08T22:39:31.355 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hostname 2024-04-08T22:39:31.422 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2024-04-08T22:39:31.487 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-04-08T22:39:31.542 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-04-08T22:39:31.542 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-04-08T22:39:31.542 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-04-08T22:39:31.542 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-04-08T22:39:31.542 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-04-08T22:39:31.542 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-04-08T22:39:31.542 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-08T22:39:31.543 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-04-08T22:39:31.543 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-04-08T22:39:31.543 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-08T22:39:31.543 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-04-08T22:39:31.543 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T22:39:31.543 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-08T22:39:31.543 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T22:39:31.543 INFO:teuthology.provision.fog.smithi120:Deploy complete! 2024-04-08T22:39:31.544 DEBUG:teuthology.parallel:result is None 2024-04-08T22:39:31.713 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com 2024-04-08T22:39:31.714 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-08T22:39:31.738 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com 2024-04-08T22:39:31.738 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-08T22:39:31.763 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server 2024-04-08T22:39:31.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-04-08T22:39:31.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:39:31.862 DEBUG:teuthology.orchestra.run.smithi045:> true 2024-04-08T22:39:32.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-04-08T22:39:32.040 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2024-04-08T22:39:32.095 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2024-04-08T22:39:32.096 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2024-04-08T22:39:32.150 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2024-04-08T22:39:32.151 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9" 2024-04-08T22:39:32.151 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2024-04-08T22:39:32.151 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2024-04-08T22:39:32.151 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9" 2024-04-08T22:39:32.151 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9" 2024-04-08T22:39:32.151 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-08T22:39:32.151 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2024-04-08T22:39:32.151 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon" 2024-04-08T22:39:32.151 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-08T22:39:32.151 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2024-04-08T22:39:32.151 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T22:39:32.151 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-08T22:39:32.152 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T22:39:32.152 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2024-04-08T22:39:32.171 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server 2024-04-08T22:39:32.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-08T22:39:32.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T22:39:32.259 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-04-08T22:39:32.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-08T22:39:32.325 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-04-08T22:39:32.379 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-04-08T22:39:32.379 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-04-08T22:39:32.434 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-04-08T22:39:32.434 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-04-08T22:39:32.434 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-04-08T22:39:32.434 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-04-08T22:39:32.434 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-04-08T22:39:32.434 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-04-08T22:39:32.435 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-08T22:39:32.435 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-04-08T22:39:32.435 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-04-08T22:39:32.435 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-08T22:39:32.435 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-04-08T22:39:32.435 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T22:39:32.435 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-08T22:39:32.435 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T22:39:32.435 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-04-08T22:39:32.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T22:39:32.549 INFO:teuthology.dispatcher.supervisor:Running job 7646216 2024-04-08T22:39:32.549 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-08_21:08:03-orch-squid-distro-default-smithi/7646216 --name teuthology-2024-04-08_21:08:03-orch-squid-distro-default-smithi --description orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/teuthology-2024-04-08_21:08:03-orch-squid-distro-default-smithi/7646216/orig.config.yaml 2024-04-08T22:39:32.552 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-08_21:08:03-orch-squid-distro-default-smithi/7646216 2024-04-08T22:39:32.552 INFO:teuthology.dispatcher.supervisor:Job PID: 2672918 2024-04-08T22:39:32.552 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-08T22:41:32.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T22:43:32.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T22:45:32.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T22:47:33.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T22:49:33.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T22:51:33.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T22:53:33.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T22:55:33.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T22:57:34.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T22:59:34.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:01:34.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:03:34.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:05:34.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:07:34.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:09:35.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:11:35.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:13:35.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:15:35.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:17:35.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:19:35.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:21:36.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:23:36.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:25:36.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:27:36.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:29:36.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:31:36.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:33:37.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:35:37.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:37:37.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:39:37.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:41:37.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:43:37.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:45:38.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:47:38.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:49:38.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:51:38.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:53:38.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:55:38.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:57:39.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T23:59:39.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:01:39.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:03:39.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:05:39.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:07:40.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:09:40.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:11:40.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:13:40.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:15:40.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:17:40.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:19:41.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:21:41.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:23:41.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:25:41.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:27:41.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:29:41.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:31:42.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:33:42.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:35:42.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:37:42.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:39:42.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:41:42.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:43:43.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:45:43.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:47:43.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:49:43.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:51:43.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:53:43.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:55:44.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:57:44.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T00:59:44.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:01:44.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:03:44.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:05:44.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:07:45.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:09:45.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:11:45.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:13:45.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:15:45.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:17:45.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:19:46.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:21:46.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:23:46.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:25:46.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:27:46.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:29:46.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:31:47.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:33:47.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:35:47.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:37:47.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:39:47.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:41:47.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:43:48.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:45:48.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:47:48.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:49:48.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:51:48.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:53:49.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:55:49.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:57:49.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T01:59:49.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T02:01:49.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T02:03:49.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T02:05:50.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T02:07:50.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T02:09:50.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T02:11:50.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T02:13:50.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T02:15:50.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T02:17:51.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T02:19:51.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T02:21:51.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T02:23:51.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-09T02:23:51.646 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1