2023-10-12T11:40:17.808 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-12T11:40:17.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T11:40:17.975 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0e2d88c670>, signals=[15]) 2023-10-12T11:40:17.977 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2023-10-12T11:40:17.977 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2023-10-12T11:40:17.977 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-10-12T11:40:18.002 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging 2023-10-12T11:40:18.002 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server 2023-10-12T11:40:18.003 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-10-12T11:40:18.004 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /host {"name": "smithi072"} 2023-10-12T11:40:18.027 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /host {"name": "smithi097"} 2023-10-12T11:40:18.079 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-12T11:40:18.104 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-12T11:40:18.122 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-12T11:40:18.122 DEBUG:teuthology.provision.fog.smithi072:FOG request: PUT /host/177 {"imageID": 7} 2023-10-12T11:40:18.146 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-12T11:40:18.147 DEBUG:teuthology.provision.fog.smithi097:FOG request: PUT /host/202 {"imageID": 7} 2023-10-12T11:40:18.174 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of rhel 8.4 2023-10-12T11:40:18.174 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:40:18.200 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of rhel 8.4 2023-10-12T11:40:18.200 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-12T11:40:18.228 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /tasktype {"name": "deploy"} 2023-10-12T11:40:18.245 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /tasktype {"name": "deploy"} 2023-10-12T11:40:18.265 DEBUG:teuthology.provision.fog.smithi072:FOG request: POST /host/177/task {"taskTypeID": 1} 2023-10-12T11:40:18.285 DEBUG:teuthology.provision.fog.smithi097:FOG request: POST /host/202/task {"taskTypeID": 1} 2023-10-12T11:40:18.626 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:40:18.640 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-12T11:40:18.729 INFO:teuthology.orchestra.console.smithi072:Power off 2023-10-12T11:40:18.730 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T11:40:18.743 INFO:teuthology.orchestra.console.smithi097:Power off 2023-10-12T11:40:18.744 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T11:40:18.756 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-10-12T11:40:18.756 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T11:40:18.767 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-10-12T11:40:18.767 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T11:40:18.779 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-12T11:40:18.791 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-10-12T11:40:22.782 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T11:40:22.792 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T11:40:22.893 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-12T11:40:22.901 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-10-12T11:40:26.898 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T11:40:26.905 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T11:40:27.008 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-12T11:40:27.016 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-10-12T11:40:27.117 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-10-12T11:40:27.218 INFO:teuthology.orchestra.console.smithi097:Power on 2023-10-12T11:40:27.218 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-12T11:40:27.240 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On 2023-10-12T11:40:27.241 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T11:40:27.261 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-10-12T11:40:31.010 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T11:40:31.120 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-12T11:40:31.221 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-10-12T11:40:31.262 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T11:40:31.321 INFO:teuthology.orchestra.console.smithi072:Power on 2023-10-12T11:40:31.322 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-12T11:40:31.346 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On 2023-10-12T11:40:31.347 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T11:40:31.367 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-12T11:40:31.372 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-10-12T11:40:35.370 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T11:40:35.378 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T11:40:35.480 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-12T11:40:35.534 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2023-10-12T11:40:35.635 INFO:teuthology.orchestra.console.smithi097:Power on completed 2023-10-12T11:40:35.735 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2023-10-12T11:40:35.736 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-12T11:40:39.485 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T11:40:39.594 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-12T11:40:39.695 INFO:teuthology.orchestra.console.smithi072:Power on completed 2023-10-12T11:40:39.796 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2023-10-12T11:40:39.796 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:40:50.802 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-12T11:40:54.858 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:41:05.886 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-12T11:41:09.918 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:41:20.966 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-12T11:41:24.986 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:41:36.038 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-12T11:41:40.058 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:41:51.110 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-12T11:41:55.134 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:42:06.198 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-12T11:42:10.198 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:42:21.288 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-12T11:42:25.262 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:42:36.375 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-12T11:42:40.326 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:42:51.452 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-12T11:42:55.402 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:43:06.534 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-12T11:43:10.470 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:43:21.609 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-10-12T11:43:21.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T11:43:25.550 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:43:40.155 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-10-12T11:43:40.633 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:43:46.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T11:43:49.242 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-10-12T11:43:55.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T11:43:55.704 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-12T11:43:55.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T11:43:58.334 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-10-12T11:44:04.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T11:44:07.422 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-10-12T11:44:13.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T11:44:14.202 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-12T11:44:20.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T11:44:23.258 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-12T11:44:29.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T11:44:32.314 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-12T11:44:38.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T11:44:41.370 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-12T11:44:47.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T11:45:13.454 WARNING:teuthology.provision.fog.smithi097:timed out 2023-10-12T11:45:19.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T11:45:19.861 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-12T11:45:19.862 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-12T11:45:20.116 INFO:teuthology.provision.fog.smithi097:Node is ready 2023-10-12T11:45:20.117 DEBUG:teuthology.orchestra.run.smithi097:> hostname 2023-10-12T11:45:20.130 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com 2023-10-12T11:45:20.130 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts 2023-10-12T11:45:20.185 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097 2023-10-12T11:45:20.186 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-10-12T11:45:20.291 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts 2023-10-12T11:45:20.316 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts 2023-10-12T11:45:20.379 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname 2023-10-12T11:45:20.442 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-10-12T11:45:20.505 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-10-12T11:45:20.559 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Red Hat Enterprise Linux" 2023-10-12T11:45:20.559 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8.4 (Ootpa)" 2023-10-12T11:45:20.559 INFO:teuthology.orchestra.run.smithi097.stdout:ID="rhel" 2023-10-12T11:45:20.560 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="fedora" 2023-10-12T11:45:20.560 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8.4" 2023-10-12T11:45:20.560 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8" 2023-10-12T11:45:20.560 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-12T11:45:20.560 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-10-12T11:45:20.561 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-12T11:45:20.561 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.redhat.com/" 2023-10-12T11:45:20.561 INFO:teuthology.orchestra.run.smithi097.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-12T11:45:20.561 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-12T11:45:20.562 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-10-12T11:45:20.562 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-12T11:45:20.562 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-12T11:45:20.562 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-12T11:45:20.562 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-12T11:45:20.563 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2023-10-12T11:45:20.564 DEBUG:teuthology.parallel:result is None 2023-10-12T11:45:47.402 WARNING:teuthology.provision.fog.smithi072:timed out 2023-10-12T11:45:53.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T11:45:53.842 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-12T11:45:53.843 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-12T11:45:59.135 INFO:teuthology.provision.fog.smithi072:Node is ready 2023-10-12T11:45:59.136 DEBUG:teuthology.orchestra.run.smithi072:> hostname 2023-10-12T11:45:59.151 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072 2023-10-12T11:45:59.152 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072 /etc/hosts 2023-10-12T11:45:59.205 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2023-10-12T11:45:59.205 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-10-12T11:45:59.450 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072/smithi072/g' /etc/hosts 2023-10-12T11:45:59.474 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts 2023-10-12T11:45:59.539 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072/smithi072/g' /etc/hostname 2023-10-12T11:45:59.604 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-10-12T11:45:59.668 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-10-12T11:45:59.721 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux" 2023-10-12T11:45:59.722 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.4 (Ootpa)" 2023-10-12T11:45:59.722 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel" 2023-10-12T11:45:59.722 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora" 2023-10-12T11:45:59.722 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.4" 2023-10-12T11:45:59.723 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-10-12T11:45:59.723 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-12T11:45:59.723 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-10-12T11:45:59.723 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-12T11:45:59.725 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/" 2023-10-12T11:45:59.725 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-12T11:45:59.725 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-12T11:45:59.726 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-12T11:45:59.726 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-12T11:45:59.726 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-12T11:45:59.726 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-12T11:45:59.726 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-12T11:45:59.727 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2023-10-12T11:45:59.728 DEBUG:teuthology.parallel:result is None 2023-10-12T11:45:59.875 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2023-10-12T11:45:59.876 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-12T11:45:59.901 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com 2023-10-12T11:45:59.902 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-12T11:45:59.929 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2023-10-12T11:45:59.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-12T11:45:59.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T11:45:59.999 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-10-12T11:46:00.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-12T11:46:00.064 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-10-12T11:46:00.118 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-10-12T11:46:00.119 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-10-12T11:46:00.173 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux" 2023-10-12T11:46:00.173 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.4 (Ootpa)" 2023-10-12T11:46:00.173 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel" 2023-10-12T11:46:00.174 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora" 2023-10-12T11:46:00.174 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.4" 2023-10-12T11:46:00.174 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-10-12T11:46:00.175 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-12T11:46:00.175 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-10-12T11:46:00.175 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-12T11:46:00.176 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/" 2023-10-12T11:46:00.176 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-12T11:46:00.176 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-12T11:46:00.177 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-12T11:46:00.177 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-12T11:46:00.177 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-12T11:46:00.178 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-12T11:46:00.178 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-12T11:46:00.179 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-10-12T11:46:00.202 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server 2023-10-12T11:46:00.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-10-12T11:46:00.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T11:46:00.269 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-10-12T11:46:00.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-10-12T11:46:00.393 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2023-10-12T11:46:00.447 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2023-10-12T11:46:00.447 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-10-12T11:46:00.501 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Red Hat Enterprise Linux" 2023-10-12T11:46:00.502 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8.4 (Ootpa)" 2023-10-12T11:46:00.502 INFO:teuthology.orchestra.run.smithi097.stdout:ID="rhel" 2023-10-12T11:46:00.502 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="fedora" 2023-10-12T11:46:00.502 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8.4" 2023-10-12T11:46:00.502 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8" 2023-10-12T11:46:00.503 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-12T11:46:00.503 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-10-12T11:46:00.503 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-12T11:46:00.503 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.redhat.com/" 2023-10-12T11:46:00.503 INFO:teuthology.orchestra.run.smithi097.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-12T11:46:00.504 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-12T11:46:00.504 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-10-12T11:46:00.504 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-12T11:46:00.504 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-12T11:46:00.504 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-12T11:46:00.505 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-12T11:46:00.505 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-10-12T11:46:00.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T11:46:00.644 INFO:teuthology.dispatcher.supervisor:Running job 7422924 2023-10-12T11:46:00.644 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-12_03:42:08-rados-wip-yuri5-testing-2023-10-11-1125-quincy-distro-default-smithi/7422924 --name yuriw-2023-10-12_03:42:08-rados-wip-yuri5-testing-2023-10-11-1125-quincy-distro-default-smithi --description rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} -- /home/teuthworker/archive/yuriw-2023-10-12_03:42:08-rados-wip-yuri5-testing-2023-10-11-1125-quincy-distro-default-smithi/7422924/orig.config.yaml 2023-10-12T11:46:00.647 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-12_03:42:08-rados-wip-yuri5-testing-2023-10-11-1125-quincy-distro-default-smithi/7422924 2023-10-12T11:46:00.648 INFO:teuthology.dispatcher.supervisor:Job PID: 830080 2023-10-12T11:46:00.648 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-12T11:48:00.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T11:50:00.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T11:52:01.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T11:54:01.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T11:56:01.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T11:58:01.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T12:00:01.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T12:02:01.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T12:02:01.978 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-12T12:02:02.073 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-12T12:02:02.074 INFO:teuthology.nuke:Checking targets against current locks 2023-10-12T12:02:02.129 DEBUG:teuthology.nuke:shortname: smithi072 2023-10-12T12:02:02.129 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-12T12:02:02.152 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-12_03:42:08-rados-wip-yuri5-testing-2023-10-11-1125-quincy-distro-default-smithi/7422924', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-12 11:40:17.011759', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAOCFOPlKCG5LsJjMwQ67zbVEdg/xY9HetJDJA1qHiOG6Fv+C3ClrJZHr1Iu6utEoV6HP3WjFJ3URlt5Njnc1Po='} 2023-10-12T12:02:02.157 DEBUG:teuthology.nuke:shortname: smithi097 2023-10-12T12:02:02.158 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-12T12:02:02.178 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-12_03:42:08-rados-wip-yuri5-testing-2023-10-11-1125-quincy-distro-default-smithi/7422924', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-12 11:40:17.013214', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH58/wB3G3ZPrWEhrArWiuVRiS6qmfKQPaWBD5xgV60ieC248qAGxjyMFZhl1u85gndQVqxyKodkMXMs6cevme8='} 2023-10-12T12:02:02.202 INFO:teuthology.orchestra.console.smithi072:Power off 2023-10-12T12:02:02.202 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T12:02:02.227 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-10-12T12:02:02.230 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T12:02:02.246 INFO:teuthology.orchestra.console.smithi097:Power off 2023-10-12T12:02:02.246 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T12:02:02.256 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-12T12:02:02.268 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2023-10-12T12:02:02.268 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T12:02:02.290 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2023-10-12T12:02:02.357 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-10-12T12:02:02.392 INFO:teuthology.orchestra.console.smithi097:Power off completed 2023-10-12T12:02:02.510 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com 2023-10-12T12:02:02.535 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com