2023-12-16T00:11:07.731 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-16T00:11:07.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:11:07.919 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3a44563940>, signals=[15]) 2023-12-16T00:11:07.919 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging 2023-12-16T00:11:07.919 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server 2023-12-16T00:11:07.919 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-12-16T00:11:07.943 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2023-12-16T00:11:07.943 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2023-12-16T00:11:07.943 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-12-16T00:11:07.967 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2023-12-16T00:11:07.967 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2023-12-16T00:11:07.967 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-12-16T00:11:08.072 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-16T00:11:08.087 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-16T00:11:08.090 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-16T00:11:08.114 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of rhel 8.6 2023-12-16T00:11:08.130 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of rhel 8.6 2023-12-16T00:11:08.133 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of rhel 8.6 2023-12-16T00:11:08.655 INFO:teuthology.orchestra.console.smithi181:Power off 2023-12-16T00:11:08.656 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:11:08.673 INFO:teuthology.orchestra.console.smithi099:Power off 2023-12-16T00:11:08.673 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:11:08.689 INFO:teuthology.orchestra.console.smithi046:Power off 2023-12-16T00:11:08.689 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:11:08.699 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-12-16T00:11:08.700 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:08.707 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-12-16T00:11:08.707 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:08.716 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2023-12-16T00:11:08.717 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:08.724 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-12-16T00:11:08.732 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-12-16T00:11:08.739 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-12-16T00:11:12.725 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:12.734 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:12.741 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:12.836 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-12-16T00:11:12.842 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-12-16T00:11:12.850 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-12-16T00:11:16.841 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:16.849 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:16.857 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:16.952 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-12-16T00:11:16.959 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-12-16T00:11:16.966 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-12-16T00:11:17.060 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-12-16T00:11:17.067 INFO:teuthology.orchestra.console.smithi046:Power off completed 2023-12-16T00:11:17.161 INFO:teuthology.orchestra.console.smithi181:Power on 2023-12-16T00:11:17.162 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-16T00:11:17.170 INFO:teuthology.orchestra.console.smithi046:Power on 2023-12-16T00:11:17.170 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-16T00:11:17.185 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On 2023-12-16T00:11:17.185 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:17.193 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On 2023-12-16T00:11:17.194 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:17.206 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-12-16T00:11:17.223 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-12-16T00:11:20.953 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:21.062 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-12-16T00:11:21.163 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-12-16T00:11:21.208 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:21.225 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:21.264 INFO:teuthology.orchestra.console.smithi099:Power on 2023-12-16T00:11:21.264 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-16T00:11:21.286 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2023-12-16T00:11:21.287 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:21.306 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-12-16T00:11:21.316 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-12-16T00:11:21.334 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-12-16T00:11:25.309 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:25.317 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:25.334 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:11:25.419 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-12-16T00:11:25.495 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-12-16T00:11:25.520 INFO:teuthology.orchestra.console.smithi099:Power on completed 2023-12-16T00:11:25.548 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-12-16T00:11:25.596 INFO:teuthology.orchestra.console.smithi181:Power on completed 2023-12-16T00:11:25.622 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2023-12-16T00:11:25.649 INFO:teuthology.orchestra.console.smithi046:Power on completed 2023-12-16T00:11:25.697 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2023-12-16T00:11:25.750 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2023-12-16T00:16:45.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:16:48.914 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-12-16T00:16:54.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:16:58.001 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-12-16T00:17:00.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:04.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:04.053 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-16T00:17:07.057 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-12-16T00:17:10.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:13.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:13.137 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-16T00:17:16.113 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-12-16T00:17:19.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:22.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:22.193 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-16T00:17:25.202 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-12-16T00:17:28.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:31.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:31.249 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-16T00:17:34.260 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-12-16T00:17:37.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:40.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:40.309 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-16T00:17:43.346 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-12-16T00:17:46.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:49.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:17:49.365 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-16T00:17:55.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:01.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:04.470 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-16T00:18:10.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:13.553 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-16T00:18:13.909 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-16T00:18:19.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:19.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:22.609 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-16T00:18:22.965 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-16T00:18:28.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:28.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:31.697 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-16T00:18:32.017 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-16T00:18:37.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:38.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:39.071 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-16T00:18:39.072 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-16T00:18:40.789 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-16T00:18:46.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:49.352 WARNING:teuthology.provision.fog.smithi181:timed out 2023-12-16T00:18:49.841 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-12-16T00:18:54.725 INFO:teuthology.provision.fog.smithi099:Node is ready 2023-12-16T00:18:54.725 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2023-12-16T00:18:54.786 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2023-12-16T00:18:54.787 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2023-12-16T00:18:54.846 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2023-12-16T00:18:54.846 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-12-16T00:18:54.979 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2023-12-16T00:18:55.010 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2023-12-16T00:18:55.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2023-12-16T00:18:55.149 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-12-16T00:18:55.217 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-12-16T00:18:55.274 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:18:55.274 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:18:55.275 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel" 2023-12-16T00:18:55.275 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora" 2023-12-16T00:18:55.275 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6" 2023-12-16T00:18:55.275 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:18:55.275 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:18:55.275 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-12-16T00:18:55.275 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:18:55.275 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:18:55.275 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:18:55.275 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:18:55.275 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-16T00:18:55.275 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:18:55.275 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:18:55.275 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:18:55.276 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:18:55.276 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2023-12-16T00:18:55.281 DEBUG:teuthology.parallel:result is None 2023-12-16T00:18:55.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:55.578 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-16T00:18:55.578 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-16T00:18:55.839 INFO:teuthology.provision.fog.smithi181:Node is ready 2023-12-16T00:18:55.839 DEBUG:teuthology.orchestra.run.smithi181:> hostname 2023-12-16T00:18:55.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:18:55.857 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181 2023-12-16T00:18:55.857 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181 /etc/hosts 2023-12-16T00:18:55.915 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2023-12-16T00:18:55.916 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-12-16T00:18:56.044 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181/smithi181/g' /etc/hosts 2023-12-16T00:18:56.073 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts 2023-12-16T00:18:56.141 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181/smithi181/g' /etc/hostname 2023-12-16T00:18:56.210 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-12-16T00:18:56.276 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-12-16T00:18:56.334 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:18:56.334 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:18:56.334 INFO:teuthology.orchestra.run.smithi181.stdout:ID="rhel" 2023-12-16T00:18:56.334 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="fedora" 2023-12-16T00:18:56.334 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8.6" 2023-12-16T00:18:56.334 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:18:56.334 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:18:56.334 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-12-16T00:18:56.334 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:18:56.334 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:18:56.334 INFO:teuthology.orchestra.run.smithi181.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:18:56.334 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:18:56.334 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-12-16T00:18:56.335 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:18:56.335 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:18:56.335 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:18:56.335 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:18:56.335 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2023-12-16T00:18:56.335 DEBUG:teuthology.parallel:result is None 2023-12-16T00:19:55.902 WARNING:teuthology.provision.fog.smithi046:timed out 2023-12-16T00:20:01.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:20:02.229 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-16T00:20:02.229 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-16T00:20:02.528 INFO:teuthology.provision.fog.smithi046:Node is ready 2023-12-16T00:20:02.529 DEBUG:teuthology.orchestra.run.smithi046:> hostname 2023-12-16T00:20:02.550 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2023-12-16T00:20:02.550 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts 2023-12-16T00:20:02.611 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-12-16T00:20:02.611 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-12-16T00:20:02.732 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts 2023-12-16T00:20:02.765 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts 2023-12-16T00:20:02.841 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname 2023-12-16T00:20:02.915 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-12-16T00:20:02.989 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-12-16T00:20:03.050 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:20:03.050 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:20:03.050 INFO:teuthology.orchestra.run.smithi046.stdout:ID="rhel" 2023-12-16T00:20:03.050 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="fedora" 2023-12-16T00:20:03.050 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8.6" 2023-12-16T00:20:03.050 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:20:03.050 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:20:03.050 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-12-16T00:20:03.050 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:20:03.050 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:20:03.051 INFO:teuthology.orchestra.run.smithi046.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:20:03.051 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:20:03.051 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-12-16T00:20:03.051 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:20:03.051 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:20:03.051 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:20:03.051 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:20:03.051 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2023-12-16T00:20:03.052 DEBUG:teuthology.parallel:result is None 2023-12-16T00:20:03.274 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2023-12-16T00:20:03.274 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-16T00:20:03.298 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2023-12-16T00:20:03.298 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-16T00:20:03.323 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2023-12-16T00:20:03.323 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-16T00:20:03.340 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2023-12-16T00:20:03.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-12-16T00:20:03.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:20:03.408 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-12-16T00:20:03.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-12-16T00:20:03.487 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2023-12-16T00:20:03.548 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2023-12-16T00:20:03.549 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-12-16T00:20:03.610 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:20:03.610 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:20:03.610 INFO:teuthology.orchestra.run.smithi046.stdout:ID="rhel" 2023-12-16T00:20:03.610 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="fedora" 2023-12-16T00:20:03.610 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8.6" 2023-12-16T00:20:03.610 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:20:03.610 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:20:03.610 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-12-16T00:20:03.610 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:20:03.610 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:20:03.610 INFO:teuthology.orchestra.run.smithi046.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:20:03.610 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:20:03.610 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-12-16T00:20:03.611 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:20:03.611 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:20:03.611 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:20:03.611 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:20:03.611 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-12-16T00:20:03.631 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2023-12-16T00:20:03.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-16T00:20:03.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:20:03.698 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-12-16T00:20:03.839 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-16T00:20:03.839 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-12-16T00:20:03.896 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-12-16T00:20:03.896 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-12-16T00:20:03.953 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:20:03.953 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:20:03.953 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel" 2023-12-16T00:20:03.953 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora" 2023-12-16T00:20:03.954 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6" 2023-12-16T00:20:03.954 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:20:03.954 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:20:03.954 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-12-16T00:20:03.954 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:20:03.954 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:20:03.954 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:20:03.954 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:20:03.954 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-16T00:20:03.954 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:20:03.954 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:20:03.954 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:20:03.954 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:20:03.955 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-12-16T00:20:03.981 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2023-12-16T00:20:03.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-12-16T00:20:03.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-16T00:20:04.050 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-12-16T00:20:04.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-12-16T00:20:04.191 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2023-12-16T00:20:04.249 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2023-12-16T00:20:04.250 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-12-16T00:20:04.307 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Red Hat Enterprise Linux" 2023-12-16T00:20:04.307 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8.6 (Ootpa)" 2023-12-16T00:20:04.307 INFO:teuthology.orchestra.run.smithi181.stdout:ID="rhel" 2023-12-16T00:20:04.307 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="fedora" 2023-12-16T00:20:04.307 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8.6" 2023-12-16T00:20:04.307 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2023-12-16T00:20:04.307 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-16T00:20:04.307 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-12-16T00:20:04.307 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-16T00:20:04.307 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.redhat.com/" 2023-12-16T00:20:04.307 INFO:teuthology.orchestra.run.smithi181.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-16T00:20:04.307 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-16T00:20:04.308 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-12-16T00:20:04.308 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-16T00:20:04.308 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-16T00:20:04.308 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-16T00:20:04.308 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-16T00:20:04.308 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-12-16T00:20:04.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:20:04.425 INFO:teuthology.dispatcher.supervisor:Running job 7493384 2023-12-16T00:20:04.425 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493384 --name yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsync-tester}} -- /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493384/orig.config.yaml 2023-12-16T00:20:04.428 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493384 2023-12-16T00:20:04.428 INFO:teuthology.dispatcher.supervisor:Job PID: 2046466 2023-12-16T00:20:04.429 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-16T00:22:04.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:24:04.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:26:04.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:28:05.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:30:05.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:32:05.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:34:05.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:36:05.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-16T00:36:05.887 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-16T00:36:06.029 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-16T00:36:06.029 INFO:teuthology.nuke:Checking targets against current locks 2023-12-16T00:36:06.082 DEBUG:teuthology.nuke:shortname: smithi046 2023-12-16T00:36:06.083 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T00:36:06.102 DEBUG:teuthology.nuke:shortname: smithi099 2023-12-16T00:36:06.102 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T00:36:06.108 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493384', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 00:11:06.804587', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJzL/ATGNkprLmx0SIJEa3SpmSB0PoHOCh5zG/uSDYwPZ1G2lsGlk1g8FYacHXwztUfTQAd9fDAO2/5b7gELVRI='} 2023-12-16T00:36:06.123 DEBUG:teuthology.nuke:shortname: smithi181 2023-12-16T00:36:06.123 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-16T00:36:06.127 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493384', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 00:11:06.808318', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMqqwH/yfbx8Qh/4+PTm6So4g14g6jCNbxTRnvcRLBF3urFSmNefiUXOJ/4yhy1E8QFpJcAvFCYef+rp6F1oaY8='} 2023-12-16T00:36:06.143 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_00:09:48-fs-main-distro-default-smithi/7493384', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-16 00:11:06.806560', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBdc5iLaiTlvW7QbnVVJUxie9zFygxppjmnJT+FM+zpBDEnoRvrlAitjymzsrhzxqcJ6UVrsRgZ32oWyXThwaIU='} 2023-12-16T00:36:06.151 INFO:teuthology.orchestra.console.smithi046:Power off 2023-12-16T00:36:06.151 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:36:06.175 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2023-12-16T00:36:06.175 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:36:06.192 INFO:teuthology.orchestra.console.smithi099:Power off 2023-12-16T00:36:06.192 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:36:06.205 INFO:teuthology.orchestra.console.smithi181:Power off 2023-12-16T00:36:06.205 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-16T00:36:06.211 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-12-16T00:36:06.212 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-12-16T00:36:06.212 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:36:06.225 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-12-16T00:36:06.225 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-16T00:36:06.233 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-12-16T00:36:06.247 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-12-16T00:36:06.312 INFO:teuthology.orchestra.console.smithi046:Power off completed 2023-12-16T00:36:06.334 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-12-16T00:36:06.348 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-12-16T00:36:06.460 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com 2023-12-16T00:36:06.476 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com 2023-12-16T00:36:06.495 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com