2023-12-05T23:17:34.956 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-05T23:17:34.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T23:17:35.132 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7156cc4550>, signals=[15]) 2023-12-05T23:17:35.132 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2023-12-05T23:17:35.132 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2023-12-05T23:17:35.132 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-12-05T23:17:35.155 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2023-12-05T23:17:35.157 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2023-12-05T23:17:35.157 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-12-05T23:17:35.184 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging 2023-12-05T23:17:35.184 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server 2023-12-05T23:17:35.184 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-12-05T23:17:35.276 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_centos_9.stream (ID 10) 2023-12-05T23:17:35.307 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_centos_9.stream (ID 10) 2023-12-05T23:17:35.322 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of centos 9.stream 2023-12-05T23:17:35.326 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_centos_9.stream (ID 10) 2023-12-05T23:17:35.358 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 9.stream 2023-12-05T23:17:35.381 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 9.stream 2023-12-05T23:17:35.621 INFO:teuthology.orchestra.console.smithi032:Power off 2023-12-05T23:17:35.622 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T23:17:35.636 INFO:teuthology.orchestra.console.smithi153:Power off 2023-12-05T23:17:35.637 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T23:17:35.646 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-12-05T23:17:35.647 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T23:17:35.665 INFO:teuthology.orchestra.console.smithi173:Power off 2023-12-05T23:17:35.665 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T23:17:35.674 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-12-05T23:17:35.675 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-12-05T23:17:35.675 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T23:17:35.687 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2023-12-05T23:17:35.688 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T23:17:35.699 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-12-05T23:17:35.712 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-12-05T23:17:35.776 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-12-05T23:17:35.799 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-12-05T23:17:35.813 INFO:teuthology.orchestra.console.smithi173:Power off completed 2023-12-05T23:17:35.877 INFO:teuthology.orchestra.console.smithi032:Power on 2023-12-05T23:17:35.878 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-05T23:17:35.900 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On 2023-12-05T23:17:35.901 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T23:17:35.909 INFO:teuthology.orchestra.console.smithi153:Power on 2023-12-05T23:17:35.909 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-05T23:17:35.922 INFO:teuthology.orchestra.console.smithi173:Power on 2023-12-05T23:17:35.922 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-05T23:17:35.930 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-12-05T23:17:35.938 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On 2023-12-05T23:17:35.938 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T23:17:35.947 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On 2023-12-05T23:17:35.947 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T23:17:35.959 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-12-05T23:17:35.968 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-12-05T23:17:39.934 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T23:17:39.960 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T23:17:39.969 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T23:17:40.044 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-12-05T23:17:40.069 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-12-05T23:17:40.078 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-12-05T23:17:40.145 INFO:teuthology.orchestra.console.smithi032:Power on completed 2023-12-05T23:17:40.169 INFO:teuthology.orchestra.console.smithi153:Power on completed 2023-12-05T23:17:40.178 INFO:teuthology.orchestra.console.smithi173:Power on completed 2023-12-05T23:17:40.246 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2023-12-05T23:17:40.270 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2023-12-05T23:17:40.279 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2023-12-05T23:19:56.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:19:59.266 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-12-05T23:20:05.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:20:08.326 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-12-05T23:20:14.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:20:17.410 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-12-05T23:20:23.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:20:26.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:20:26.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:20:26.498 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-12-05T23:20:29.414 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-12-05T23:20:29.415 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-12-05T23:20:32.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:20:35.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:20:35.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:20:35.554 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-12-05T23:20:38.502 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-12-05T23:20:38.502 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-12-05T23:20:41.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:20:44.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:20:44.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:20:47.586 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-12-05T23:20:47.587 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-12-05T23:20:53.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:20:53.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:20:56.642 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-12-05T23:20:56.643 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-12-05T23:21:02.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:21:02.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:21:05.698 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-12-05T23:21:05.698 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-12-05T23:21:11.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:21:11.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:21:14.758 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-12-05T23:21:14.759 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-12-05T23:21:20.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:21:20.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:21:23.842 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-12-05T23:21:29.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:21:41.570 WARNING:teuthology.provision.fog.smithi032:timed out 2023-12-05T23:21:47.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:21:47.845 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-05T23:21:47.846 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-05T23:21:48.182 INFO:teuthology.provision.fog.smithi032:Node is ready 2023-12-05T23:21:48.183 DEBUG:teuthology.orchestra.run.smithi032:> hostname 2023-12-05T23:21:48.198 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com 2023-12-05T23:21:48.198 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts 2023-12-05T23:21:48.254 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032 2023-12-05T23:21:48.254 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-12-05T23:21:48.377 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts 2023-12-05T23:21:48.410 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts 2023-12-05T23:21:48.482 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname 2023-12-05T23:21:48.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-12-05T23:21:48.625 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-12-05T23:21:48.679 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream" 2023-12-05T23:21:48.680 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9" 2023-12-05T23:21:48.680 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos" 2023-12-05T23:21:48.680 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora" 2023-12-05T23:21:48.680 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9" 2023-12-05T23:21:48.680 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9" 2023-12-05T23:21:48.680 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-05T23:21:48.680 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-12-05T23:21:48.680 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon" 2023-12-05T23:21:48.680 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-05T23:21:48.680 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/" 2023-12-05T23:21:48.680 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T23:21:48.681 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-05T23:21:48.681 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T23:21:48.681 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2023-12-05T23:21:48.683 DEBUG:teuthology.parallel:result is None 2023-12-05T23:22:20.799 WARNING:teuthology.provision.fog.smithi173:timed out 2023-12-05T23:22:26.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:22:27.112 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-05T23:22:27.113 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-05T23:22:27.425 INFO:teuthology.provision.fog.smithi173:Node is ready 2023-12-05T23:22:27.425 DEBUG:teuthology.orchestra.run.smithi173:> hostname 2023-12-05T23:22:27.483 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2023-12-05T23:22:27.484 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts 2023-12-05T23:22:27.542 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2023-12-05T23:22:27.542 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2023-12-05T23:22:27.678 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts 2023-12-05T23:22:27.705 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts 2023-12-05T23:22:27.776 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname 2023-12-05T23:22:27.847 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2023-12-05T23:22:27.917 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-12-05T23:22:27.975 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2023-12-05T23:22:27.975 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2023-12-05T23:22:27.975 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2023-12-05T23:22:27.975 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2023-12-05T23:22:27.975 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2023-12-05T23:22:27.975 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2023-12-05T23:22:27.976 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-05T23:22:27.976 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-12-05T23:22:27.976 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2023-12-05T23:22:27.976 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-05T23:22:27.976 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2023-12-05T23:22:27.976 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T23:22:27.976 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-05T23:22:27.976 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T23:22:27.976 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2023-12-05T23:22:27.977 DEBUG:teuthology.parallel:result is None 2023-12-05T23:22:29.849 WARNING:teuthology.provision.fog.smithi153:timed out 2023-12-05T23:22:35.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:22:36.067 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-05T23:22:36.067 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-05T23:22:36.382 INFO:teuthology.provision.fog.smithi153:Node is ready 2023-12-05T23:22:36.382 DEBUG:teuthology.orchestra.run.smithi153:> hostname 2023-12-05T23:22:36.397 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2023-12-05T23:22:36.398 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts 2023-12-05T23:22:36.454 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2023-12-05T23:22:36.454 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-12-05T23:22:36.558 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts 2023-12-05T23:22:36.587 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts 2023-12-05T23:22:36.656 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname 2023-12-05T23:22:36.724 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-12-05T23:22:36.791 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-12-05T23:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2023-12-05T23:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2023-12-05T23:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2023-12-05T23:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2023-12-05T23:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2023-12-05T23:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2023-12-05T23:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-05T23:22:36.846 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-12-05T23:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2023-12-05T23:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-05T23:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2023-12-05T23:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T23:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-05T23:22:36.847 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T23:22:36.847 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2023-12-05T23:22:36.848 DEBUG:teuthology.parallel:result is None 2023-12-05T23:22:37.059 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2023-12-05T23:22:37.059 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-05T23:22:37.083 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2023-12-05T23:22:37.083 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-05T23:22:37.108 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2023-12-05T23:22:37.108 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-05T23:22:37.134 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2023-12-05T23:22:37.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-12-05T23:22:37.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:22:37.234 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-12-05T23:22:37.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-12-05T23:22:37.417 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2023-12-05T23:22:37.472 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2023-12-05T23:22:37.472 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-12-05T23:22:37.527 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream" 2023-12-05T23:22:37.527 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="9" 2023-12-05T23:22:37.527 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos" 2023-12-05T23:22:37.527 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora" 2023-12-05T23:22:37.527 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="9" 2023-12-05T23:22:37.528 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el9" 2023-12-05T23:22:37.528 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-05T23:22:37.528 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-12-05T23:22:37.528 INFO:teuthology.orchestra.run.smithi032.stdout:LOGO="fedora-logo-icon" 2023-12-05T23:22:37.528 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-05T23:22:37.528 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/" 2023-12-05T23:22:37.528 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T23:22:37.528 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-05T23:22:37.528 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T23:22:37.529 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-12-05T23:22:37.550 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2023-12-05T23:22:37.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-12-05T23:22:37.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:22:37.632 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-12-05T23:22:37.697 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-12-05T23:22:37.697 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-12-05T23:22:37.752 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-12-05T23:22:37.752 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-12-05T23:22:37.808 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2023-12-05T23:22:37.808 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2023-12-05T23:22:37.808 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2023-12-05T23:22:37.808 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2023-12-05T23:22:37.808 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2023-12-05T23:22:37.808 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2023-12-05T23:22:37.808 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-05T23:22:37.808 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-12-05T23:22:37.808 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2023-12-05T23:22:37.808 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-05T23:22:37.808 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2023-12-05T23:22:37.808 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T23:22:37.809 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-05T23:22:37.809 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T23:22:37.809 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-12-05T23:22:37.833 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2023-12-05T23:22:37.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-12-05T23:22:37.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-05T23:22:37.916 DEBUG:teuthology.orchestra.run.smithi173:> true 2023-12-05T23:22:37.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-12-05T23:22:37.987 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2023-12-05T23:22:38.043 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2023-12-05T23:22:38.043 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-12-05T23:22:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2023-12-05T23:22:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2023-12-05T23:22:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2023-12-05T23:22:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2023-12-05T23:22:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2023-12-05T23:22:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2023-12-05T23:22:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-05T23:22:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-12-05T23:22:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2023-12-05T23:22:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-05T23:22:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2023-12-05T23:22:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-05T23:22:38.101 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-05T23:22:38.101 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-05T23:22:38.101 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-12-05T23:22:38.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T23:22:38.210 INFO:teuthology.dispatcher.supervisor:Running job 7479095 2023-12-05T23:22:38.210 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2023-12-05_21:30:10-rbd-wip-dis-testing-distro-default-smithi/7479095 --name dis-2023-12-05_21:30:10-rbd-wip-dis-testing-distro-default-smithi --description rbd/qemu/{cache/none clusters/{fixed-3 openstack} conf/{disable-pool-app} data-pool/replicated features/defaults msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_latest} workloads/qemu_bonnie} -- /home/teuthworker/archive/dis-2023-12-05_21:30:10-rbd-wip-dis-testing-distro-default-smithi/7479095/orig.config.yaml 2023-12-05T23:22:38.213 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2023-12-05_21:30:10-rbd-wip-dis-testing-distro-default-smithi/7479095 2023-12-05T23:22:38.214 INFO:teuthology.dispatcher.supervisor:Job PID: 3094035 2023-12-05T23:22:38.214 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-05T23:24:38.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T23:26:38.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T23:28:38.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T23:30:38.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T23:32:38.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T23:34:39.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T23:36:39.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T23:38:39.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-05T23:38:39.552 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-05T23:38:39.688 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-05T23:38:39.688 INFO:teuthology.nuke:Checking targets against current locks 2023-12-05T23:38:39.739 DEBUG:teuthology.nuke:shortname: smithi032 2023-12-05T23:38:39.739 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T23:38:39.763 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-12-05_21:30:10-rbd-wip-dis-testing-distro-default-smithi/7479095', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 23:17:34.105340', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPL5NuOTeIZucdpNk3RsDmzYlbW3V0IhXbVg2a6EdHeMEYqz1Ik5xJqpODUfJNyr1y+8HIALk/jorsQGUQUBs98='} 2023-12-05T23:38:39.764 DEBUG:teuthology.nuke:shortname: smithi153 2023-12-05T23:38:39.764 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T23:38:39.787 DEBUG:teuthology.nuke:shortname: smithi173 2023-12-05T23:38:39.788 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-05T23:38:39.791 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-12-05_21:30:10-rbd-wip-dis-testing-distro-default-smithi/7479095', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 23:17:34.101824', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLnas5IHPjkldVHGdEZU9P91lEfVdi+F2SpedTnmkMxbfTE62fVT+sHF2MsVTK9Mlb0dCsu+qQLgwUhyWE6XOq8='} 2023-12-05T23:38:39.811 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-12-05_21:30:10-rbd-wip-dis-testing-distro-default-smithi/7479095', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-05 23:17:34.103789', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLoktiZfj78xBd517PUxRUUczz1Lu0V95X3/v5+MCVZjlEQbk5VpjpGmJ1WO7vmkD+L9rr9wqYtb3a4KIxEjoko='} 2023-12-05T23:38:39.819 INFO:teuthology.orchestra.console.smithi032:Power off 2023-12-05T23:38:39.820 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T23:38:39.844 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-12-05T23:38:39.844 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T23:38:39.858 INFO:teuthology.orchestra.console.smithi153:Power off 2023-12-05T23:38:39.858 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T23:38:39.870 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-12-05T23:38:39.879 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-12-05T23:38:39.879 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T23:38:39.896 INFO:teuthology.orchestra.console.smithi173:Power off 2023-12-05T23:38:39.896 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-05T23:38:39.904 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-12-05T23:38:39.917 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2023-12-05T23:38:39.918 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-05T23:38:39.938 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-12-05T23:38:39.971 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-12-05T23:38:40.006 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-12-05T23:38:40.039 INFO:teuthology.orchestra.console.smithi173:Power off completed 2023-12-05T23:38:40.117 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com 2023-12-05T23:38:40.151 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com 2023-12-05T23:38:40.183 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com