2024-03-17T04:39:27.388 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-17T04:39:27.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:39:27.550 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb4b18d4c10>, signals=[15]) 2024-03-17T04:39:27.550 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2024-03-17T04:39:27.550 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2024-03-17T04:39:27.551 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-03-17T04:39:27.571 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2024-03-17T04:39:27.571 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2024-03-17T04:39:27.571 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-03-17T04:39:27.595 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2024-03-17T04:39:27.595 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2024-03-17T04:39:27.596 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-03-17T04:39:27.676 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_centos_9.stream (ID 10) 2024-03-17T04:39:27.700 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_centos_9.stream (ID 10) 2024-03-17T04:39:27.721 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_9.stream (ID 10) 2024-03-17T04:39:27.724 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 9.stream 2024-03-17T04:39:27.743 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of centos 9.stream 2024-03-17T04:39:27.770 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 9.stream 2024-03-17T04:39:28.002 INFO:teuthology.orchestra.console.smithi032:Power off 2024-03-17T04:39:28.003 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-17T04:39:28.016 INFO:teuthology.orchestra.console.smithi191:Power off 2024-03-17T04:39:28.016 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-17T04:39:28.027 INFO:teuthology.orchestra.console.smithi008:Power off 2024-03-17T04:39:28.028 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-17T04:39:28.035 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2024-03-17T04:39:28.036 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T04:39:28.043 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-03-17T04:39:28.043 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T04:39:28.051 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2024-03-17T04:39:28.051 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T04:39:28.058 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2024-03-17T04:39:28.064 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-03-17T04:39:28.070 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-03-17T04:39:28.160 INFO:teuthology.orchestra.console.smithi032:Power off completed 2024-03-17T04:39:28.164 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-03-17T04:39:28.171 INFO:teuthology.orchestra.console.smithi008:Power off completed 2024-03-17T04:39:28.261 INFO:teuthology.orchestra.console.smithi032:Power on 2024-03-17T04:39:28.261 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-17T04:39:28.269 INFO:teuthology.orchestra.console.smithi191:Power on 2024-03-17T04:39:28.269 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-17T04:39:28.276 INFO:teuthology.orchestra.console.smithi008:Power on 2024-03-17T04:39:28.276 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-17T04:39:28.284 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On 2024-03-17T04:39:28.284 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T04:39:28.295 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2024-03-17T04:39:28.295 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T04:39:28.303 DEBUG:teuthology.orchestra.console.smithi008:power on output: Chassis Power Control: Up/On 2024-03-17T04:39:28.304 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T04:39:28.312 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2024-03-17T04:39:28.316 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-03-17T04:39:28.325 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-03-17T04:39:32.317 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T04:39:32.324 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T04:39:32.331 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T04:39:32.427 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-03-17T04:39:32.433 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-03-17T04:39:32.439 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-03-17T04:39:32.528 INFO:teuthology.orchestra.console.smithi032:Power on completed 2024-03-17T04:39:32.533 INFO:teuthology.orchestra.console.smithi191:Power on completed 2024-03-17T04:39:32.540 INFO:teuthology.orchestra.console.smithi008:Power on completed 2024-03-17T04:39:32.629 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2024-03-17T04:39:32.634 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2024-03-17T04:39:32.640 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2024-03-17T04:41:48.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:42:03.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:42:07.006 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-03-17T04:42:13.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:42:16.062 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-03-17T04:42:18.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:42:22.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:42:22.110 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-03-17T04:42:25.119 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-03-17T04:42:28.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:42:31.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:42:31.166 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-03-17T04:42:34.174 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-03-17T04:42:37.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:42:37.214 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-03-17T04:42:40.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:42:40.222 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-03-17T04:42:43.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:42:46.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:42:46.270 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-03-17T04:42:49.282 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-03-17T04:42:52.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:42:55.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:42:55.326 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-03-17T04:42:58.366 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-03-17T04:43:01.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:43:04.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:43:04.385 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-03-17T04:43:10.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:43:14.590 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-03-17T04:43:20.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:43:23.678 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-03-17T04:43:29.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:43:32.766 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-03-17T04:43:38.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:43:39.029 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-17T04:43:39.030 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-17T04:43:40.181 WARNING:teuthology.provision.fog.smithi032:timed out 2024-03-17T04:43:46.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:43:46.403 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-17T04:43:46.403 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-17T04:43:46.724 INFO:teuthology.provision.fog.smithi032:Node is ready 2024-03-17T04:43:46.724 DEBUG:teuthology.orchestra.run.smithi032:> hostname 2024-03-17T04:43:46.739 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com 2024-03-17T04:43:46.739 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts 2024-03-17T04:43:46.794 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032 2024-03-17T04:43:46.794 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2024-03-17T04:43:46.902 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts 2024-03-17T04:43:46.934 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts 2024-03-17T04:43:47.005 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname 2024-03-17T04:43:47.076 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2024-03-17T04:43:47.146 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-03-17T04:43:47.201 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream" 2024-03-17T04:43:47.201 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9" 2024-03-17T04:43:47.201 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos" 2024-03-17T04:43:47.201 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora" 2024-03-17T04:43:47.201 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9" 2024-03-17T04:43:47.201 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9" 2024-03-17T04:43:47.201 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-17T04:43:47.201 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2024-03-17T04:43:47.202 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon" 2024-03-17T04:43:47.202 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-17T04:43:47.202 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/" 2024-03-17T04:43:47.202 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T04:43:47.202 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-17T04:43:47.202 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T04:43:47.203 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2024-03-17T04:43:47.204 DEBUG:teuthology.parallel:result is None 2024-03-17T04:43:55.137 INFO:teuthology.provision.fog.smithi008:Node is ready 2024-03-17T04:43:55.137 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2024-03-17T04:43:55.157 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2024-03-17T04:43:55.157 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2024-03-17T04:43:55.214 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2024-03-17T04:43:55.215 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2024-03-17T04:43:55.341 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2024-03-17T04:43:55.375 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2024-03-17T04:43:55.449 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2024-03-17T04:43:55.521 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2024-03-17T04:43:55.592 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-03-17T04:43:55.648 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2024-03-17T04:43:55.648 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2024-03-17T04:43:55.648 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2024-03-17T04:43:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2024-03-17T04:43:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2024-03-17T04:43:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2024-03-17T04:43:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-17T04:43:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-03-17T04:43:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2024-03-17T04:43:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-17T04:43:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2024-03-17T04:43:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T04:43:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-17T04:43:55.649 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T04:43:55.649 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2024-03-17T04:43:55.650 DEBUG:teuthology.parallel:result is None 2024-03-17T04:44:10.406 WARNING:teuthology.provision.fog.smithi191:timed out 2024-03-17T04:44:16.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:44:16.731 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-17T04:44:16.732 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-17T04:44:17.056 INFO:teuthology.provision.fog.smithi191:Node is ready 2024-03-17T04:44:17.056 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2024-03-17T04:44:17.070 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2024-03-17T04:44:17.070 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2024-03-17T04:44:17.125 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2024-03-17T04:44:17.125 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-03-17T04:44:17.226 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2024-03-17T04:44:17.254 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2024-03-17T04:44:17.323 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2024-03-17T04:44:17.391 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-03-17T04:44:17.458 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-03-17T04:44:17.513 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-03-17T04:44:17.513 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-03-17T04:44:17.513 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-03-17T04:44:17.513 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-03-17T04:44:17.513 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-03-17T04:44:17.513 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-03-17T04:44:17.514 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-17T04:44:17.514 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-03-17T04:44:17.514 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-03-17T04:44:17.514 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-17T04:44:17.514 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-03-17T04:44:17.514 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T04:44:17.514 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-17T04:44:17.514 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T04:44:17.514 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2024-03-17T04:44:17.515 DEBUG:teuthology.parallel:result is None 2024-03-17T04:44:17.737 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2024-03-17T04:44:17.737 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-17T04:44:17.760 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2024-03-17T04:44:17.760 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-17T04:44:17.776 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2024-03-17T04:44:17.776 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-17T04:44:17.794 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2024-03-17T04:44:17.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-03-17T04:44:17.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:44:17.899 DEBUG:teuthology.orchestra.run.smithi008:> true 2024-03-17T04:44:18.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-03-17T04:44:18.081 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2024-03-17T04:44:18.136 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2024-03-17T04:44:18.137 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-03-17T04:44:18.192 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2024-03-17T04:44:18.192 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2024-03-17T04:44:18.192 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2024-03-17T04:44:18.192 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2024-03-17T04:44:18.192 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2024-03-17T04:44:18.192 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2024-03-17T04:44:18.192 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-17T04:44:18.192 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-03-17T04:44:18.192 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2024-03-17T04:44:18.193 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-17T04:44:18.193 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2024-03-17T04:44:18.193 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T04:44:18.193 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-17T04:44:18.193 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T04:44:18.193 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-03-17T04:44:18.218 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2024-03-17T04:44:18.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-03-17T04:44:18.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:44:18.321 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-03-17T04:44:18.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-03-17T04:44:18.501 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2024-03-17T04:44:18.556 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2024-03-17T04:44:18.557 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-03-17T04:44:18.611 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream" 2024-03-17T04:44:18.612 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9" 2024-03-17T04:44:18.612 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos" 2024-03-17T04:44:18.612 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora" 2024-03-17T04:44:18.612 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9" 2024-03-17T04:44:18.612 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9" 2024-03-17T04:44:18.612 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-17T04:44:18.612 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2024-03-17T04:44:18.612 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon" 2024-03-17T04:44:18.612 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-17T04:44:18.612 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/" 2024-03-17T04:44:18.612 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T04:44:18.612 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-17T04:44:18.613 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T04:44:18.613 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-03-17T04:44:18.634 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2024-03-17T04:44:18.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-03-17T04:44:18.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T04:44:18.720 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-03-17T04:44:18.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-03-17T04:44:18.794 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-03-17T04:44:18.850 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-03-17T04:44:18.850 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-03-17T04:44:18.906 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-03-17T04:44:18.907 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-03-17T04:44:18.907 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-03-17T04:44:18.907 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-03-17T04:44:18.907 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-03-17T04:44:18.907 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-03-17T04:44:18.907 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-17T04:44:18.907 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-03-17T04:44:18.908 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-03-17T04:44:18.908 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-17T04:44:18.908 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-03-17T04:44:18.908 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T04:44:18.908 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-17T04:44:18.908 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T04:44:18.909 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-03-17T04:44:18.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:44:19.022 INFO:teuthology.dispatcher.supervisor:Running job 7599134 2024-03-17T04:44:19.022 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi/7599134 --name teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/dbench}} -- /home/teuthworker/archive/teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi/7599134/orig.config.yaml 2024-03-17T04:44:19.025 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi/7599134 2024-03-17T04:44:19.026 INFO:teuthology.dispatcher.supervisor:Job PID: 1345204 2024-03-17T04:44:19.026 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-17T04:46:19.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:48:19.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:50:19.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:52:19.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:54:19.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:56:19.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:58:20.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:00:20.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:02:20.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:04:20.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:06:20.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:08:20.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:10:21.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:12:21.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:14:21.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:16:21.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:18:21.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:20:21.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:22:22.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:24:22.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:26:22.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:28:22.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:30:22.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:32:22.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:34:22.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:36:23.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:38:23.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:40:23.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:42:23.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:44:23.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:46:24.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:48:24.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:50:24.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:52:24.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:54:24.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:56:24.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T05:56:24.863 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-03-17T05:56:25.114 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi008 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi/7599173 2024-03-17T05:56:25.114 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi032 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi/7599172 2024-03-17T05:56:25.114 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi191 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi/7599173