2023-10-10T09:20:05.665 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-10T09:20:05.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:20:05.796 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fac0cb31670>, signals=[15]) 2023-10-10T09:20:05.797 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2023-10-10T09:20:05.797 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T09:20:05.798 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-10-10T09:20:05.813 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-10-10T09:20:05.814 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T09:20:05.814 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-10-10T09:20:05.815 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /host {"name": "smithi157"} 2023-10-10T09:20:05.838 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"} 2023-10-10T09:20:05.892 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-10T09:20:05.915 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-10T09:20:05.933 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-10T09:20:05.934 DEBUG:teuthology.provision.fog.smithi157:FOG request: PUT /host/262 {"imageID": 7} 2023-10-10T09:20:05.962 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-10T09:20:05.962 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 7} 2023-10-10T09:20:05.981 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of rhel 8.4 2023-10-10T09:20:05.981 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T09:20:06.017 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of rhel 8.4 2023-10-10T09:20:06.017 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-10T09:20:06.045 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T09:20:06.076 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T09:20:06.083 DEBUG:teuthology.provision.fog.smithi157:FOG request: POST /host/262/task {"taskTypeID": 1} 2023-10-10T09:20:06.121 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1} 2023-10-10T09:20:06.136 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T09:20:06.187 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-10T09:20:06.237 INFO:teuthology.orchestra.console.smithi157:Power off 2023-10-10T09:20:06.238 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T09:20:06.261 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-10-10T09:20:06.262 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:20:06.283 INFO:teuthology.orchestra.console.smithi195:Power off 2023-10-10T09:20:06.284 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T09:20:06.293 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-10T09:20:06.307 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-10-10T09:20:06.307 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:20:06.333 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-10-10T09:20:10.298 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:20:10.335 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:20:10.407 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-10T09:20:10.445 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-10-10T09:20:14.410 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:20:14.446 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:20:14.519 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-10-10T09:20:14.555 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-10-10T09:20:14.620 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-10-10T09:20:14.656 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-10-10T09:20:14.721 INFO:teuthology.orchestra.console.smithi157:Power on 2023-10-10T09:20:14.722 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T09:20:14.742 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On 2023-10-10T09:20:14.743 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:20:14.758 INFO:teuthology.orchestra.console.smithi195:Power on 2023-10-10T09:20:14.759 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T09:20:14.767 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-10-10T09:20:14.779 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2023-10-10T09:20:14.779 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:20:14.800 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-10-10T09:20:18.772 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:20:18.801 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:20:18.882 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-10-10T09:20:18.911 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-10-10T09:20:22.886 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:20:22.913 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:20:23.023 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-10-10T09:20:23.042 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2023-10-10T09:20:23.124 INFO:teuthology.orchestra.console.smithi195:Power on completed 2023-10-10T09:20:23.143 INFO:teuthology.orchestra.console.smithi157:Power on completed 2023-10-10T09:20:23.226 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-10-10T09:20:23.227 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-10T09:20:23.244 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2023-10-10T09:20:23.244 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T09:20:38.326 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-10T09:20:38.328 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T09:20:53.414 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-10T09:20:53.416 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T09:21:08.518 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T09:21:08.520 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-10T09:21:23.610 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-10T09:21:23.612 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T09:21:38.706 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T09:21:38.708 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-10T09:21:53.790 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-10T09:21:53.791 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T09:22:08.882 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-10T09:22:08.884 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T09:22:23.966 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T09:22:23.968 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-10T09:22:39.058 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T09:22:39.059 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-10T09:22:54.132 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T09:22:54.134 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-10T09:23:09.218 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-10T09:23:09.220 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T09:23:24.306 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-10-10T09:23:24.308 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-10T09:23:24.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:23:24.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:23:42.842 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-10-10T09:23:42.843 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-10T09:23:48.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:23:48.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:23:51.930 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-10-10T09:23:51.931 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-10T09:23:57.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:23:57.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:24:01.018 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-10-10T09:24:01.050 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-10T09:24:07.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:24:07.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:24:10.111 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-10-10T09:24:10.138 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-10T09:24:16.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:24:16.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:24:19.230 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-10T09:24:25.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:24:28.314 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-10T09:24:34.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:24:37.434 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-10-10T09:24:43.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:25:16.174 WARNING:teuthology.provision.fog.smithi195:timed out 2023-10-10T09:25:22.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:25:22.559 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T09:25:22.560 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T09:25:22.857 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-10-10T09:25:22.858 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-10-10T09:25:22.874 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2023-10-10T09:25:22.874 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2023-10-10T09:25:22.931 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2023-10-10T09:25:22.932 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-10-10T09:25:23.048 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2023-10-10T09:25:23.076 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2023-10-10T09:25:23.142 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2023-10-10T09:25:23.208 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-10-10T09:25:23.272 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-10-10T09:25:23.326 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T09:25:23.326 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T09:25:23.326 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-10-10T09:25:23.327 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-10-10T09:25:23.327 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.4" 2023-10-10T09:25:23.327 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-10-10T09:25:23.327 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T09:25:23.327 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-10-10T09:25:23.328 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T09:25:23.328 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T09:25:23.328 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T09:25:23.328 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T09:25:23.329 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-10T09:25:23.329 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T09:25:23.329 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T09:25:23.329 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T09:25:23.329 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T09:25:23.330 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-10-10T09:25:23.332 DEBUG:teuthology.parallel:result is None 2023-10-10T09:25:43.482 WARNING:teuthology.provision.fog.smithi157:timed out 2023-10-10T09:25:49.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:25:49.836 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T09:25:49.837 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T09:25:50.147 INFO:teuthology.provision.fog.smithi157:Node is ready 2023-10-10T09:25:50.148 DEBUG:teuthology.orchestra.run.smithi157:> hostname 2023-10-10T09:25:50.161 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2023-10-10T09:25:50.161 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts 2023-10-10T09:25:50.215 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2023-10-10T09:25:50.216 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-10-10T09:25:50.334 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts 2023-10-10T09:25:50.359 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts 2023-10-10T09:25:50.422 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname 2023-10-10T09:25:50.486 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157 2023-10-10T09:25:50.549 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-10-10T09:25:50.603 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T09:25:50.604 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T09:25:50.604 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-10-10T09:25:50.604 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-10-10T09:25:50.605 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.4" 2023-10-10T09:25:50.605 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-10-10T09:25:50.605 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T09:25:50.605 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-10-10T09:25:50.606 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T09:25:50.606 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T09:25:50.606 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T09:25:50.606 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T09:25:50.606 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-10T09:25:50.607 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T09:25:50.607 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T09:25:50.607 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T09:25:50.607 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T09:25:50.608 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2023-10-10T09:25:50.608 DEBUG:teuthology.parallel:result is None 2023-10-10T09:25:50.864 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2023-10-10T09:25:50.865 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-10T09:25:50.907 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-10-10T09:25:50.907 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-10T09:25:50.942 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2023-10-10T09:25:50.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-10T09:25:50.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:25:51.035 DEBUG:teuthology.orchestra.run.smithi157:> true 2023-10-10T09:25:51.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2023-10-10T09:25:51.100 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2023-10-10T09:25:51.151 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2023-10-10T09:25:51.152 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2023-10-10T09:25:51.205 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T09:25:51.206 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T09:25:51.206 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel" 2023-10-10T09:25:51.206 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora" 2023-10-10T09:25:51.206 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.4" 2023-10-10T09:25:51.207 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2023-10-10T09:25:51.207 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T09:25:51.207 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2023-10-10T09:25:51.207 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T09:25:51.207 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T09:25:51.208 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T09:25:51.208 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T09:25:51.208 INFO:teuthology.orchestra.run.smithi157.stdout: 2023-10-10T09:25:51.208 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T09:25:51.209 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T09:25:51.209 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T09:25:51.209 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T09:25:51.210 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-10-10T09:25:51.240 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-10-10T09:25:51.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-10-10T09:25:51.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:25:51.315 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-10-10T09:25:51.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-10-10T09:25:51.433 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-10-10T09:25:51.488 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-10-10T09:25:51.488 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-10-10T09:25:51.543 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T09:25:51.543 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T09:25:51.543 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-10-10T09:25:51.543 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-10-10T09:25:51.544 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.4" 2023-10-10T09:25:51.544 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-10-10T09:25:51.544 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T09:25:51.544 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-10-10T09:25:51.545 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T09:25:51.545 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T09:25:51.545 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T09:25:51.545 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T09:25:51.545 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-10-10T09:25:51.546 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T09:25:51.546 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T09:25:51.546 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T09:25:51.546 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T09:25:51.547 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-10-10T09:25:51.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:25:51.671 INFO:teuthology.dispatcher.supervisor:Running job 7419449 2023-10-10T09:25:51.672 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419449 --name yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration} -- /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419449/orig.config.yaml 2023-10-10T09:25:51.675 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419449 2023-10-10T09:25:51.676 INFO:teuthology.dispatcher.supervisor:Job PID: 360979 2023-10-10T09:25:51.676 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-10T09:27:51.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:29:51.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:31:52.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:33:52.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:35:52.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:37:52.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:39:52.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:41:52.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:43:53.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:45:53.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:47:53.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:49:53.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:49:53.670 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-10T09:49:53.847 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-10T09:49:53.848 INFO:teuthology.nuke:Checking targets against current locks 2023-10-10T09:49:53.902 DEBUG:teuthology.nuke:shortname: smithi157 2023-10-10T09:49:53.902 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T09:49:53.922 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419449', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 09:20:04.824021', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPzTUzhWEJXhq+M6sO4N25fxMtCQfnNw8V1DUSlJuSx2q97dOQNxVjQ5zp9fxgvUZPGgk/B11Q6V4Gn7JcejvTY='} 2023-10-10T09:49:53.928 DEBUG:teuthology.nuke:shortname: smithi195 2023-10-10T09:49:53.929 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T09:49:53.953 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419449', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 09:20:04.825466', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDI+rK/cMej1JyKSikZmiKEITuIi2Cu1ehQrU7D06KP9L6dZwEcqoG5Gn0rP7xOEwGVwGp2Tu35PWqcU7HeTBTg='} 2023-10-10T09:49:53.968 INFO:teuthology.orchestra.console.smithi157:Power off 2023-10-10T09:49:53.969 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T09:49:53.991 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2023-10-10T09:49:53.992 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:49:54.007 INFO:teuthology.orchestra.console.smithi195:Power off 2023-10-10T09:49:54.008 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T09:49:54.017 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2023-10-10T09:49:54.029 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-10-10T09:49:54.029 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:49:54.052 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-10-10T09:49:54.118 INFO:teuthology.orchestra.console.smithi157:Power off completed 2023-10-10T09:49:54.153 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-10-10T09:49:54.287 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com 2023-10-10T09:49:54.310 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com