2023-09-16T16:18:34.669 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-16T16:18:34.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:18:34.824 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f68c058bf70>, signals=[15]) 2023-09-16T16:18:34.825 INFO:teuthology.lock.ops:Start node 'smithi061.front.sepia.ceph.com' reimaging 2023-09-16T16:18:34.825 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: reset os type and version on server 2023-09-16T16:18:34.826 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-09-16T16:18:34.846 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2023-09-16T16:18:34.847 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2023-09-16T16:18:34.847 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-09-16T16:18:34.849 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /host {"name": "smithi061"} 2023-09-16T16:18:34.871 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /host {"name": "smithi191"} 2023-09-16T16:18:34.926 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-16T16:18:34.938 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-16T16:18:34.968 DEBUG:teuthology.provision.fog.smithi061:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-16T16:18:34.969 DEBUG:teuthology.provision.fog.smithi061:FOG request: PUT /host/166 {"imageID": 5} 2023-09-16T16:18:34.983 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-16T16:18:34.983 DEBUG:teuthology.provision.fog.smithi191:FOG request: PUT /host/296 {"imageID": 5} 2023-09-16T16:18:35.015 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of rhel 8.6 2023-09-16T16:18:35.015 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-16T16:18:35.030 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of rhel 8.6 2023-09-16T16:18:35.031 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-16T16:18:35.080 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /tasktype {"name": "deploy"} 2023-09-16T16:18:35.096 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /tasktype {"name": "deploy"} 2023-09-16T16:18:35.131 DEBUG:teuthology.provision.fog.smithi061:FOG request: POST /host/166/task {"taskTypeID": 1} 2023-09-16T16:18:35.137 DEBUG:teuthology.provision.fog.smithi191:FOG request: POST /host/296/task {"taskTypeID": 1} 2023-09-16T16:18:35.191 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-16T16:18:35.194 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-16T16:18:35.300 INFO:teuthology.orchestra.console.smithi061:Power off 2023-09-16T16:18:35.301 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T16:18:35.314 INFO:teuthology.orchestra.console.smithi191:Power off 2023-09-16T16:18:35.315 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T16:18:35.323 DEBUG:teuthology.orchestra.console.smithi061:power off output: Chassis Power Control: Down/Off 2023-09-16T16:18:35.324 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:18:35.338 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-09-16T16:18:35.338 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:18:35.354 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-09-16T16:18:35.361 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-09-16T16:18:35.456 INFO:teuthology.orchestra.console.smithi061:Power off completed 2023-09-16T16:18:35.462 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-09-16T16:18:35.558 INFO:teuthology.orchestra.console.smithi061:Power on 2023-09-16T16:18:35.558 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-16T16:18:35.567 INFO:teuthology.orchestra.console.smithi191:Power on 2023-09-16T16:18:35.567 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-16T16:18:35.580 DEBUG:teuthology.orchestra.console.smithi061:power on output: Chassis Power Control: Up/On 2023-09-16T16:18:35.581 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:18:35.590 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2023-09-16T16:18:35.591 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:18:35.603 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-09-16T16:18:35.614 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-09-16T16:18:39.606 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:18:39.614 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:18:39.715 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-09-16T16:18:39.724 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-09-16T16:18:39.825 INFO:teuthology.orchestra.console.smithi191:Power on completed 2023-09-16T16:18:39.926 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2023-09-16T16:18:39.927 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-16T16:18:43.718 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:18:43.826 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-09-16T16:18:43.928 INFO:teuthology.orchestra.console.smithi061:Power on completed 2023-09-16T16:18:44.028 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish 2023-09-16T16:18:44.029 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-16T16:18:54.998 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-16T16:18:59.094 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-16T16:19:10.066 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-16T16:19:14.158 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-16T16:19:25.140 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-16T16:19:29.226 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-16T16:19:40.214 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-16T16:19:44.290 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-16T16:19:55.295 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-16T16:19:59.354 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-16T16:20:10.374 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-16T16:20:14.426 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-16T16:20:25.442 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-16T16:20:29.494 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-16T16:20:40.518 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-16T16:20:44.567 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-16T16:20:55.594 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-16T16:20:59.654 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-16T16:21:10.684 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-16T16:21:14.738 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-16T16:21:25.755 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-09-16T16:21:25.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:21:28.890 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-09-16T16:21:29.813 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-16T16:21:29.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:21:32.958 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-16T16:21:34.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:21:37.949 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-09-16T16:21:38.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:21:42.046 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-16T16:21:43.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:21:47.006 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-09-16T16:21:48.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:21:51.130 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-16T16:21:53.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:21:56.090 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-09-16T16:21:57.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:22:00.186 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-16T16:22:02.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:22:05.150 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-09-16T16:22:06.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:22:09.242 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-16T16:22:11.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:22:14.238 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-09-16T16:22:15.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:22:18.298 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-16T16:22:20.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:22:23.326 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-09-16T16:22:24.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:22:27.356 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-16T16:22:29.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:22:33.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:22:36.446 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-16T16:22:42.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:23:29.378 WARNING:teuthology.provision.fog.smithi191:timed out 2023-09-16T16:23:35.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:23:35.716 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-16T16:23:35.717 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-16T16:23:36.039 INFO:teuthology.provision.fog.smithi191:Node is ready 2023-09-16T16:23:36.039 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2023-09-16T16:23:36.057 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191 2023-09-16T16:23:36.058 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191 /etc/hosts 2023-09-16T16:23:36.120 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2023-09-16T16:23:36.120 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-09-16T16:23:36.252 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191/smithi191/g' /etc/hosts 2023-09-16T16:23:36.282 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2023-09-16T16:23:36.355 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191/smithi191/g' /etc/hostname 2023-09-16T16:23:36.427 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-09-16T16:23:36.503 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-09-16T16:23:36.571 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2023-09-16T16:23:36.571 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.6 (Ootpa)" 2023-09-16T16:23:36.571 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2023-09-16T16:23:36.571 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2023-09-16T16:23:36.572 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.6" 2023-09-16T16:23:36.572 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-09-16T16:23:36.572 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-16T16:23:36.572 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-09-16T16:23:36.572 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-16T16:23:36.573 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2023-09-16T16:23:36.573 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-16T16:23:36.573 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T16:23:36.573 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-16T16:23:36.573 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T16:23:36.574 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-16T16:23:36.574 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-16T16:23:36.574 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-16T16:23:36.575 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2023-09-16T16:23:36.576 DEBUG:teuthology.parallel:result is None 2023-09-16T16:23:42.458 WARNING:teuthology.provision.fog.smithi061:timed out 2023-09-16T16:23:48.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:23:48.818 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-16T16:23:48.818 DEBUG:teuthology.orchestra.run.smithi061:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-16T16:23:49.135 INFO:teuthology.provision.fog.smithi061:Node is ready 2023-09-16T16:23:49.135 DEBUG:teuthology.orchestra.run.smithi061:> hostname 2023-09-16T16:23:49.154 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com 2023-09-16T16:23:49.154 DEBUG:teuthology.orchestra.run.smithi061:> grep smithi061.front.sepia.ceph.com /etc/hosts 2023-09-16T16:23:49.216 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061 2023-09-16T16:23:49.216 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-09-16T16:23:49.335 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hosts 2023-09-16T16:23:49.365 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/172.21.15.61/172.21.15.61/g' /etc/hosts 2023-09-16T16:23:49.438 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hostname 2023-09-16T16:23:49.511 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-09-16T16:23:49.582 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-09-16T16:23:49.643 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux" 2023-09-16T16:23:49.644 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.6 (Ootpa)" 2023-09-16T16:23:49.644 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel" 2023-09-16T16:23:49.644 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora" 2023-09-16T16:23:49.645 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.6" 2023-09-16T16:23:49.645 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2023-09-16T16:23:49.645 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-16T16:23:49.646 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2023-09-16T16:23:49.646 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-16T16:23:49.646 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/" 2023-09-16T16:23:49.647 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-16T16:23:49.647 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T16:23:49.647 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-09-16T16:23:49.647 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T16:23:49.648 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-16T16:23:49.648 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-16T16:23:49.648 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-16T16:23:49.649 INFO:teuthology.provision.fog.smithi061:Deploy complete! 2023-09-16T16:23:49.650 DEBUG:teuthology.parallel:result is None 2023-09-16T16:23:49.803 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com 2023-09-16T16:23:49.803 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-16T16:23:49.837 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2023-09-16T16:23:49.839 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server 2023-09-16T16:23:49.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-09-16T16:23:49.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:23:49.911 DEBUG:teuthology.orchestra.run.smithi061:> true 2023-09-16T16:23:49.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-09-16T16:23:49.979 DEBUG:teuthology.orchestra.run.smithi061:> uname -m 2023-09-16T16:23:50.036 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2023-09-16T16:23:50.037 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-09-16T16:23:50.093 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux" 2023-09-16T16:23:50.093 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.6 (Ootpa)" 2023-09-16T16:23:50.093 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel" 2023-09-16T16:23:50.094 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora" 2023-09-16T16:23:50.094 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.6" 2023-09-16T16:23:50.094 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2023-09-16T16:23:50.094 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-16T16:23:50.094 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2023-09-16T16:23:50.095 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-16T16:23:50.095 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/" 2023-09-16T16:23:50.095 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-16T16:23:50.095 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T16:23:50.095 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-09-16T16:23:50.096 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T16:23:50.096 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-16T16:23:50.096 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-16T16:23:50.096 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-16T16:23:50.097 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-09-16T16:23:50.112 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2023-09-16T16:23:50.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-09-16T16:23:50.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:23:50.180 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-09-16T16:23:50.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-09-16T16:23:50.307 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-09-16T16:23:50.364 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-09-16T16:23:50.365 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-09-16T16:23:50.421 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux" 2023-09-16T16:23:50.421 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.6 (Ootpa)" 2023-09-16T16:23:50.422 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel" 2023-09-16T16:23:50.422 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora" 2023-09-16T16:23:50.422 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.6" 2023-09-16T16:23:50.422 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-09-16T16:23:50.423 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-16T16:23:50.423 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-09-16T16:23:50.423 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-16T16:23:50.423 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/" 2023-09-16T16:23:50.423 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-16T16:23:50.424 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T16:23:50.424 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-09-16T16:23:50.424 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T16:23:50.424 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-16T16:23:50.424 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-16T16:23:50.425 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-16T16:23:50.425 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-09-16T16:23:50.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:23:50.553 INFO:teuthology.dispatcher.supervisor:Running job 7397303 2023-09-16T16:23:50.553 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi/7397303 --name teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi/7397303/orig.config.yaml 2023-09-16T16:23:50.556 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi/7397303 2023-09-16T16:23:50.557 INFO:teuthology.dispatcher.supervisor:Job PID: 156745 2023-09-16T16:23:50.557 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-16T16:25:50.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:27:50.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:29:50.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:31:51.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:33:51.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:35:51.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:37:51.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:39:51.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:41:52.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:43:52.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:45:52.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:47:52.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:49:52.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:51:52.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:53:52.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:55:53.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:57:53.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:59:53.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:01:53.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:03:53.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:05:53.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:07:54.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:09:54.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:11:54.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:13:54.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:15:54.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:17:54.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:19:54.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:21:55.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:23:55.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:25:55.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:27:56.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:29:56.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:31:56.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:33:56.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:35:56.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:37:56.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:39:57.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:41:57.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:43:57.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:45:57.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:47:57.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:49:57.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:51:58.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:53:58.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:55:58.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:57:58.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:59:58.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:01:58.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:03:59.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:03:59.153 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-16T18:03:59.339 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-16T18:03:59.339 INFO:teuthology.nuke:Checking targets against current locks 2023-09-16T18:03:59.389 DEBUG:teuthology.nuke:shortname: smithi061 2023-09-16T18:03:59.390 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-16T18:03:59.415 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi/7397303', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-16 16:18:33.746259', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-16T18:03:59.420 DEBUG:teuthology.nuke:shortname: smithi191 2023-09-16T18:03:59.420 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-16T18:03:59.442 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi/7397303', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-16 16:18:33.744903', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-16T18:03:59.474 INFO:teuthology.orchestra.console.smithi061:Power off 2023-09-16T18:03:59.475 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T18:03:59.498 DEBUG:teuthology.orchestra.console.smithi061:power off output: Chassis Power Control: Down/Off 2023-09-16T18:03:59.499 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T18:03:59.514 INFO:teuthology.orchestra.console.smithi191:Power off 2023-09-16T18:03:59.515 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T18:03:59.524 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-09-16T18:03:59.536 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-09-16T18:03:59.536 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T18:03:59.559 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-09-16T18:03:59.626 INFO:teuthology.orchestra.console.smithi061:Power off completed 2023-09-16T18:03:59.660 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-09-16T18:03:59.777 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com 2023-09-16T18:03:59.810 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com