2023-12-13T01:53:33.991 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-13T01:53:33.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:53:34.176 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb06de82940>, signals=[15]) 2023-12-13T01:53:34.177 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2023-12-13T01:53:34.177 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T01:53:34.177 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-12-13T01:53:34.197 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2023-12-13T01:53:34.197 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T01:53:34.197 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-12-13T01:53:34.213 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-12-13T01:53:34.214 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T01:53:34.214 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-12-13T01:53:34.314 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T01:53:34.342 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T01:53:34.346 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T01:53:34.357 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of rhel 8.6 2023-12-13T01:53:34.387 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of rhel 8.6 2023-12-13T01:53:34.390 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of rhel 8.6 2023-12-13T01:53:34.590 INFO:teuthology.orchestra.console.smithi088:Power off 2023-12-13T01:53:34.590 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T01:53:34.605 INFO:teuthology.orchestra.console.smithi187:Power off 2023-12-13T01:53:34.605 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T01:53:34.615 INFO:teuthology.orchestra.console.smithi157:Power off 2023-12-13T01:53:34.615 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T01:53:34.624 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-12-13T01:53:34.624 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:34.632 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-12-13T01:53:34.632 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:34.640 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-12-13T01:53:34.640 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:34.648 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-12-13T01:53:34.657 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-12-13T01:53:34.660 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-13T01:53:38.650 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:38.658 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:38.664 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:38.758 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-12-13T01:53:38.766 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-12-13T01:53:38.772 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-13T01:53:42.763 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:42.770 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:42.776 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:42.872 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-12-13T01:53:42.878 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-12-13T01:53:42.885 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-13T01:53:42.973 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-12-13T01:53:42.979 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-12-13T01:53:43.074 INFO:teuthology.orchestra.console.smithi088:Power on 2023-12-13T01:53:43.075 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T01:53:43.082 INFO:teuthology.orchestra.console.smithi187:Power on 2023-12-13T01:53:43.082 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T01:53:43.096 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2023-12-13T01:53:43.096 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:43.104 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2023-12-13T01:53:43.104 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:43.116 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-12-13T01:53:43.124 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-12-13T01:53:46.888 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:46.997 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-13T01:53:47.098 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-12-13T01:53:47.117 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:47.124 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:47.198 INFO:teuthology.orchestra.console.smithi157:Power on 2023-12-13T01:53:47.199 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T01:53:47.220 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2023-12-13T01:53:47.220 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:47.228 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-12-13T01:53:47.232 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-12-13T01:53:47.241 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-13T01:53:51.233 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:51.241 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:51.247 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T01:53:51.343 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-12-13T01:53:51.348 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-12-13T01:53:51.355 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-12-13T01:53:51.444 INFO:teuthology.orchestra.console.smithi088:Power on completed 2023-12-13T01:53:51.449 INFO:teuthology.orchestra.console.smithi187:Power on completed 2023-12-13T01:53:51.456 INFO:teuthology.orchestra.console.smithi157:Power on completed 2023-12-13T01:53:51.546 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2023-12-13T01:53:51.549 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-12-13T01:53:51.557 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2023-12-13T01:56:37.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:56:37.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:56:40.582 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-13T01:56:40.582 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-13T01:56:46.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:56:46.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:56:49.666 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-13T01:56:49.667 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-13T01:56:55.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:56:55.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:56:58.722 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-13T01:56:58.723 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-13T01:57:04.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:04.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:07.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:07.810 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-13T01:57:07.810 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-13T01:57:10.722 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-13T01:57:13.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:13.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:16.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:16.866 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-13T01:57:16.866 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-13T01:57:19.778 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-13T01:57:22.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:22.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:25.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:25.922 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-13T01:57:25.922 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-13T01:57:28.834 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-13T01:57:31.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:31.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:34.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:35.010 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-13T01:57:37.894 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-13T01:57:41.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:43.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:44.066 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-13T01:57:46.985 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-13T01:57:50.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:50.306 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-13T01:57:52.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:56.066 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-13T01:57:56.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:57:59.362 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-13T01:58:02.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:58:05.126 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-13T01:58:05.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:58:08.011 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T01:58:08.011 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T01:58:08.350 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-12-13T01:58:08.350 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2023-12-13T01:58:08.366 INFO:teuthology.orchestra.run.smithi187.stdout:smithi022 2023-12-13T01:58:08.366 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi022 /etc/hosts 2023-12-13T01:58:08.423 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-12-13T01:58:08.423 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-12-13T01:58:08.544 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi022/smithi187/g' /etc/hosts 2023-12-13T01:58:08.571 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.22/172.21.15.187/g' /etc/hosts 2023-12-13T01:58:08.637 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi022/smithi187/g' /etc/hostname 2023-12-13T01:58:08.703 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-12-13T01:58:08.769 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-12-13T01:58:08.824 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T01:58:08.825 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T01:58:08.825 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel" 2023-12-13T01:58:08.825 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora" 2023-12-13T01:58:08.825 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.6" 2023-12-13T01:58:08.825 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-12-13T01:58:08.825 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T01:58:08.825 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-12-13T01:58:08.825 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T01:58:08.825 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T01:58:08.826 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T01:58:08.826 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T01:58:08.826 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-13T01:58:08.826 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T01:58:08.826 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T01:58:08.826 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T01:58:08.826 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T01:58:08.827 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-12-13T01:58:08.828 DEBUG:teuthology.parallel:result is None 2023-12-13T01:58:11.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:58:14.210 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-12-13T01:58:20.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:58:50.102 WARNING:teuthology.provision.fog.smithi088:timed out 2023-12-13T01:58:56.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:58:56.449 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T01:58:56.449 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T01:58:56.735 INFO:teuthology.provision.fog.smithi088:Node is ready 2023-12-13T01:58:56.736 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2023-12-13T01:58:56.754 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2023-12-13T01:58:56.755 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2023-12-13T01:58:56.813 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2023-12-13T01:58:56.813 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-12-13T01:58:56.947 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2023-12-13T01:58:56.976 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2023-12-13T01:58:57.044 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2023-12-13T01:58:57.112 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-12-13T01:58:57.178 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-12-13T01:58:57.235 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T01:58:57.235 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T01:58:57.235 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel" 2023-12-13T01:58:57.235 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora" 2023-12-13T01:58:57.236 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6" 2023-12-13T01:58:57.236 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-12-13T01:58:57.236 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T01:58:57.236 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-12-13T01:58:57.236 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T01:58:57.236 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T01:58:57.236 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T01:58:57.236 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T01:58:57.236 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-13T01:58:57.236 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T01:58:57.236 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T01:58:57.237 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T01:58:57.237 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T01:58:57.237 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2023-12-13T01:58:57.238 DEBUG:teuthology.parallel:result is None 2023-12-13T01:59:20.238 WARNING:teuthology.provision.fog.smithi157:timed out 2023-12-13T01:59:26.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:59:26.590 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T01:59:26.590 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T01:59:26.895 INFO:teuthology.provision.fog.smithi157:Node is ready 2023-12-13T01:59:26.896 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2023-12-13T01:59:26.913 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2023-12-13T01:59:26.913 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2023-12-13T01:59:26.970 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2023-12-13T01:59:26.971 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-12-13T01:59:27.125 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2023-12-13T01:59:27.174 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2023-12-13T01:59:27.214 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2023-12-13T01:59:27.282 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-12-13T01:59:27.347 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-12-13T01:59:27.404 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T01:59:27.405 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T01:59:27.405 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-12-13T01:59:27.405 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-12-13T01:59:27.405 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2023-12-13T01:59:27.405 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-12-13T01:59:27.405 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T01:59:27.405 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-12-13T01:59:27.405 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T01:59:27.406 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T01:59:27.406 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T01:59:27.406 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T01:59:27.406 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-13T01:59:27.406 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T01:59:27.406 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T01:59:27.406 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T01:59:27.406 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T01:59:27.407 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2023-12-13T01:59:27.407 DEBUG:teuthology.parallel:result is None 2023-12-13T01:59:27.600 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2023-12-13T01:59:27.600 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T01:59:27.640 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2023-12-13T01:59:27.640 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T01:59:27.664 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-12-13T01:59:27.664 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T01:59:27.683 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2023-12-13T01:59:27.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-13T01:59:27.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:59:27.750 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-12-13T01:59:27.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-13T01:59:27.884 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-12-13T01:59:27.941 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-12-13T01:59:27.942 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-12-13T01:59:27.999 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T01:59:27.999 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T01:59:27.999 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel" 2023-12-13T01:59:27.999 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora" 2023-12-13T01:59:27.999 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6" 2023-12-13T01:59:27.999 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-12-13T01:59:27.999 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T01:59:27.999 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-12-13T01:59:28.000 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T01:59:28.000 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T01:59:28.000 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T01:59:28.000 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T01:59:28.000 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-13T01:59:28.000 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T01:59:28.000 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T01:59:28.000 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T01:59:28.000 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T01:59:28.001 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-12-13T01:59:28.023 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2023-12-13T01:59:28.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-13T01:59:28.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:59:28.088 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-12-13T01:59:28.156 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-12-13T01:59:28.156 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-12-13T01:59:28.213 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-12-13T01:59:28.213 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-12-13T01:59:28.271 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T01:59:28.271 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T01:59:28.271 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-12-13T01:59:28.271 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-12-13T01:59:28.271 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6" 2023-12-13T01:59:28.271 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-12-13T01:59:28.272 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T01:59:28.272 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-12-13T01:59:28.272 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T01:59:28.272 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T01:59:28.272 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T01:59:28.272 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T01:59:28.272 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-12-13T01:59:28.272 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T01:59:28.272 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T01:59:28.272 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T01:59:28.273 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T01:59:28.273 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-12-13T01:59:28.298 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-12-13T01:59:28.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-13T01:59:28.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T01:59:28.365 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-12-13T01:59:28.500 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-13T01:59:28.500 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-12-13T01:59:28.557 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-12-13T01:59:28.557 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-12-13T01:59:28.614 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T01:59:28.614 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T01:59:28.614 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel" 2023-12-13T01:59:28.614 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora" 2023-12-13T01:59:28.614 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.6" 2023-12-13T01:59:28.614 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-12-13T01:59:28.615 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T01:59:28.615 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-12-13T01:59:28.615 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T01:59:28.615 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T01:59:28.615 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T01:59:28.615 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T01:59:28.615 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-13T01:59:28.615 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T01:59:28.615 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T01:59:28.615 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T01:59:28.615 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T01:59:28.616 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-12-13T01:59:28.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T01:59:28.731 INFO:teuthology.dispatcher.supervisor:Running job 7489354 2023-12-13T01:59:28.731 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489354 --name yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/iozone}} -- /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489354/orig.config.yaml 2023-12-13T01:59:28.734 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489354 2023-12-13T01:59:28.735 INFO:teuthology.dispatcher.supervisor:Job PID: 1009188 2023-12-13T01:59:28.735 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-13T02:01:28.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T02:03:29.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T02:05:29.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T02:07:29.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T02:07:29.413 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-13T02:07:29.577 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-13T02:07:29.578 INFO:teuthology.nuke:Checking targets against current locks 2023-12-13T02:07:29.622 DEBUG:teuthology.nuke:shortname: smithi088 2023-12-13T02:07:29.622 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T02:07:29.651 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489354', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 01:53:33.083102', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-13T02:07:29.655 DEBUG:teuthology.nuke:shortname: smithi157 2023-12-13T02:07:29.656 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T02:07:29.682 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489354', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 01:53:33.085676', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-13T02:07:29.683 DEBUG:teuthology.nuke:shortname: smithi187 2023-12-13T02:07:29.684 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T02:07:29.714 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_23:05:14-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7489354', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 01:53:33.084520', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-13T02:07:29.723 INFO:teuthology.orchestra.console.smithi088:Power off 2023-12-13T02:07:29.723 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T02:07:29.744 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-12-13T02:07:29.745 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T02:07:29.764 INFO:teuthology.orchestra.console.smithi157:Power off 2023-12-13T02:07:29.765 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T02:07:29.774 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-12-13T02:07:29.786 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-12-13T02:07:29.786 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T02:07:29.800 INFO:teuthology.orchestra.console.smithi187:Power off 2023-12-13T02:07:29.801 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T02:07:29.810 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-12-13T02:07:29.822 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-12-13T02:07:29.822 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T02:07:29.843 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-12-13T02:07:29.875 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-12-13T02:07:29.911 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-12-13T02:07:29.944 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-12-13T02:07:30.019 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com 2023-12-13T02:07:30.062 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com 2023-12-13T02:07:30.085 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com