2023-10-12T03:24:36.163 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-12T03:24:36.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:24:36.348 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc35074ae50>, signals=[15]) 2023-10-12T03:24:36.350 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2023-10-12T03:24:36.351 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2023-10-12T03:24:36.352 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-10-12T03:24:36.371 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2023-10-12T03:24:36.372 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2023-10-12T03:24:36.372 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-10-12T03:24:36.373 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /host {"name": "smithi129"} 2023-10-12T03:24:36.396 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /host {"name": "smithi156"} 2023-10-12T03:24:36.439 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-12T03:24:36.456 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-12T03:24:36.492 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-12T03:24:36.493 DEBUG:teuthology.provision.fog.smithi129:FOG request: PUT /host/234 {"imageID": 5} 2023-10-12T03:24:36.499 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-12T03:24:36.499 DEBUG:teuthology.provision.fog.smithi156:FOG request: PUT /host/261 {"imageID": 5} 2023-10-12T03:24:36.535 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of rhel 8.6 2023-10-12T03:24:36.536 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-12T03:24:36.542 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of rhel 8.6 2023-10-12T03:24:36.543 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-12T03:24:36.609 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /tasktype {"name": "deploy"} 2023-10-12T03:24:36.613 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /tasktype {"name": "deploy"} 2023-10-12T03:24:36.660 DEBUG:teuthology.provision.fog.smithi129:FOG request: POST /host/234/task {"taskTypeID": 1} 2023-10-12T03:24:36.664 DEBUG:teuthology.provision.fog.smithi156:FOG request: POST /host/261/task {"taskTypeID": 1} 2023-10-12T03:24:36.720 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-12T03:24:36.734 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-12T03:24:36.826 INFO:teuthology.orchestra.console.smithi129:Power off 2023-10-12T03:24:36.827 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T03:24:36.840 INFO:teuthology.orchestra.console.smithi156:Power off 2023-10-12T03:24:36.841 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T03:24:36.849 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-10-12T03:24:36.850 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:24:36.861 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-10-12T03:24:36.862 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:24:36.871 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-10-12T03:24:36.883 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-10-12T03:24:36.972 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-10-12T03:24:36.984 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-10-12T03:24:37.074 INFO:teuthology.orchestra.console.smithi129:Power on 2023-10-12T03:24:37.074 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-12T03:24:37.085 INFO:teuthology.orchestra.console.smithi156:Power on 2023-10-12T03:24:37.086 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-12T03:24:37.097 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2023-10-12T03:24:37.098 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:24:37.107 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2023-10-12T03:24:37.108 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:24:37.120 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-10-12T03:24:37.130 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-10-12T03:24:41.122 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:24:41.131 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:24:41.232 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-10-12T03:24:41.240 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-10-12T03:24:45.234 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:24:45.243 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:24:45.345 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-10-12T03:24:45.352 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-10-12T03:24:45.447 INFO:teuthology.orchestra.console.smithi129:Power on completed 2023-10-12T03:24:45.454 INFO:teuthology.orchestra.console.smithi156:Power on completed 2023-10-12T03:24:45.548 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2023-10-12T03:24:45.549 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-12T03:24:45.555 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2023-10-12T03:24:45.555 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-12T03:25:00.628 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-12T03:25:00.630 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-12T03:25:15.706 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-12T03:25:15.708 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-12T03:25:30.778 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-12T03:25:30.780 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-12T03:25:45.858 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-12T03:25:45.860 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-12T03:26:00.934 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-12T03:26:00.936 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-12T03:26:16.014 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-12T03:26:16.016 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-12T03:26:31.094 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-12T03:26:31.096 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-12T03:26:46.170 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-12T03:26:46.172 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-12T03:27:01.254 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-12T03:27:01.257 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-12T03:27:16.330 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-12T03:27:16.332 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-12T03:27:31.410 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-10-12T03:27:31.412 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-10-12T03:27:31.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:27:31.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:27:49.886 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-12T03:27:49.887 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-10-12T03:27:55.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:27:55.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:27:58.974 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-12T03:27:58.975 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-10-12T03:28:04.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:28:04.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:28:08.058 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-12T03:28:08.059 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-10-12T03:28:14.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:28:14.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:28:17.146 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-12T03:28:17.147 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-10-12T03:28:23.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:28:23.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:28:26.202 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-10-12T03:28:26.234 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-10-12T03:28:32.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:28:32.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:28:50.558 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-10-12T03:28:56.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:28:59.643 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-10-12T03:29:05.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:29:06.353 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-12T03:29:06.354 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-12T03:29:06.655 INFO:teuthology.provision.fog.smithi156:Node is ready 2023-10-12T03:29:06.656 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2023-10-12T03:29:06.671 INFO:teuthology.orchestra.run.smithi156.stdout:smithi022 2023-10-12T03:29:06.672 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi022 /etc/hosts 2023-10-12T03:29:06.728 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-10-12T03:29:06.728 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-10-12T03:29:06.831 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi022/smithi156/g' /etc/hosts 2023-10-12T03:29:06.857 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.22/172.21.15.156/g' /etc/hosts 2023-10-12T03:29:06.925 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi022/smithi156/g' /etc/hostname 2023-10-12T03:29:06.993 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-10-12T03:29:07.061 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-10-12T03:29:07.124 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-10-12T03:29:07.124 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-10-12T03:29:07.124 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-10-12T03:29:07.125 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-10-12T03:29:07.125 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-10-12T03:29:07.125 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-10-12T03:29:07.125 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-12T03:29:07.125 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-10-12T03:29:07.126 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-12T03:29:07.126 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-10-12T03:29:07.126 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-12T03:29:07.126 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-12T03:29:07.126 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-12T03:29:07.127 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-12T03:29:07.127 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-12T03:29:07.127 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-12T03:29:07.127 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-12T03:29:07.128 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2023-10-12T03:29:07.129 DEBUG:teuthology.parallel:result is None 2023-10-12T03:29:32.234 WARNING:teuthology.provision.fog.smithi129:timed out 2023-10-12T03:29:38.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:29:38.569 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-12T03:29:38.569 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-12T03:29:38.862 INFO:teuthology.provision.fog.smithi129:Node is ready 2023-10-12T03:29:38.863 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2023-10-12T03:29:38.882 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2023-10-12T03:29:38.883 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2023-10-12T03:29:38.940 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2023-10-12T03:29:38.940 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-10-12T03:29:39.066 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2023-10-12T03:29:39.096 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2023-10-12T03:29:39.164 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2023-10-12T03:29:39.233 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-10-12T03:29:39.299 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-10-12T03:29:39.355 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="Red Hat Enterprise Linux" 2023-10-12T03:29:39.356 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8.6 (Ootpa)" 2023-10-12T03:29:39.356 INFO:teuthology.orchestra.run.smithi129.stdout:ID="rhel" 2023-10-12T03:29:39.356 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="fedora" 2023-10-12T03:29:39.356 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8.6" 2023-10-12T03:29:39.357 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2023-10-12T03:29:39.357 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-12T03:29:39.357 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-10-12T03:29:39.357 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-12T03:29:39.357 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://www.redhat.com/" 2023-10-12T03:29:39.358 INFO:teuthology.orchestra.run.smithi129.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-12T03:29:39.358 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-12T03:29:39.358 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-12T03:29:39.358 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-12T03:29:39.358 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-12T03:29:39.359 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-12T03:29:39.359 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-12T03:29:39.359 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2023-10-12T03:29:39.360 DEBUG:teuthology.parallel:result is None 2023-10-12T03:29:39.511 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2023-10-12T03:29:39.512 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2023-10-12T03:29:39.513 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2023-10-12T03:29:39.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-10-12T03:29:39.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:29:39.578 DEBUG:teuthology.orchestra.run.smithi129:> true 2023-10-12T03:29:39.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-10-12T03:29:39.644 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2023-10-12T03:29:39.700 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2023-10-12T03:29:39.700 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-10-12T03:29:39.757 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="Red Hat Enterprise Linux" 2023-10-12T03:29:39.757 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8.6 (Ootpa)" 2023-10-12T03:29:39.757 INFO:teuthology.orchestra.run.smithi129.stdout:ID="rhel" 2023-10-12T03:29:39.757 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="fedora" 2023-10-12T03:29:39.758 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8.6" 2023-10-12T03:29:39.758 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2023-10-12T03:29:39.758 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-12T03:29:39.758 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-10-12T03:29:39.759 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-12T03:29:39.759 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://www.redhat.com/" 2023-10-12T03:29:39.759 INFO:teuthology.orchestra.run.smithi129.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-12T03:29:39.759 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-12T03:29:39.759 INFO:teuthology.orchestra.run.smithi129.stdout: 2023-10-12T03:29:39.760 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-12T03:29:39.760 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-12T03:29:39.760 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-12T03:29:39.760 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-12T03:29:39.761 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-10-12T03:29:39.790 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2023-10-12T03:29:39.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-12T03:29:39.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:29:39.858 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-10-12T03:29:39.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-10-12T03:29:39.992 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-10-12T03:29:40.050 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-10-12T03:29:40.050 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-10-12T03:29:40.107 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-10-12T03:29:40.107 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-10-12T03:29:40.107 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-10-12T03:29:40.107 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-10-12T03:29:40.108 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-10-12T03:29:40.108 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-10-12T03:29:40.108 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-12T03:29:40.108 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-10-12T03:29:40.108 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-12T03:29:40.109 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-10-12T03:29:40.109 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-12T03:29:40.109 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-12T03:29:40.109 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-10-12T03:29:40.109 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-12T03:29:40.110 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-12T03:29:40.110 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-12T03:29:40.110 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-12T03:29:40.111 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-10-12T03:29:40.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:29:40.236 INFO:teuthology.dispatcher.supervisor:Running job 7422467 2023-10-12T03:29:40.237 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi/7422467 --name teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi/7422467/orig.config.yaml 2023-10-12T03:29:40.240 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi/7422467 2023-10-12T03:29:40.240 INFO:teuthology.dispatcher.supervisor:Job PID: 483483 2023-10-12T03:29:40.241 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-12T03:31:40.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:33:40.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:35:40.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:37:40.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:39:41.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:41:41.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:43:41.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:45:41.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:47:41.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:49:41.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:49:41.934 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-12T03:49:42.069 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-12T03:49:42.070 INFO:teuthology.nuke:Checking targets against current locks 2023-10-12T03:49:42.123 DEBUG:teuthology.nuke:shortname: smithi129 2023-10-12T03:49:42.123 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-12T03:49:42.152 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi/7422467', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-12 03:24:35.331886', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-12T03:49:42.156 DEBUG:teuthology.nuke:shortname: smithi156 2023-10-12T03:49:42.156 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-12T03:49:42.182 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi/7422467', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-12 03:24:35.330126', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-12T03:49:42.212 INFO:teuthology.orchestra.console.smithi129:Power off 2023-10-12T03:49:42.213 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T03:49:42.241 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-10-12T03:49:42.241 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:49:42.256 INFO:teuthology.orchestra.console.smithi156:Power off 2023-10-12T03:49:42.257 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T03:49:42.267 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-10-12T03:49:42.280 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-10-12T03:49:42.280 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:49:42.306 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-10-12T03:49:42.368 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-10-12T03:49:42.407 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-10-12T03:49:42.518 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com 2023-10-12T03:49:42.559 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com