2023-09-28T13:22:21.979 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-28T13:22:21.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T13:22:22.123 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5ae4834670>, signals=[15]) 2023-09-28T13:22:22.123 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2023-09-28T13:22:22.124 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2023-09-28T13:22:22.124 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-09-28T13:22:22.148 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-09-28T13:22:22.148 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-09-28T13:22:22.148 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-09-28T13:22:22.149 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /host {"name": "smithi008"} 2023-09-28T13:22:22.173 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"} 2023-09-28T13:22:22.238 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-09-28T13:22:22.247 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-09-28T13:22:22.287 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_rhel_8.4 (ID 7) 2023-09-28T13:22:22.287 DEBUG:teuthology.provision.fog.smithi008:FOG request: PUT /host/114 {"imageID": 7} 2023-09-28T13:22:22.290 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_rhel_8.4 (ID 7) 2023-09-28T13:22:22.291 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 7} 2023-09-28T13:22:22.337 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of rhel 8.4 2023-09-28T13:22:22.337 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-09-28T13:22:22.338 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of rhel 8.4 2023-09-28T13:22:22.338 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-09-28T13:22:22.379 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"} 2023-09-28T13:22:22.382 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /tasktype {"name": "deploy"} 2023-09-28T13:22:22.414 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1} 2023-09-28T13:22:22.417 DEBUG:teuthology.provision.fog.smithi008:FOG request: POST /host/114/task {"taskTypeID": 1} 2023-09-28T13:22:22.473 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-09-28T13:22:22.479 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-09-28T13:22:22.552 INFO:teuthology.orchestra.console.smithi102:Power off 2023-09-28T13:22:22.552 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T13:22:22.566 INFO:teuthology.orchestra.console.smithi008:Power off 2023-09-28T13:22:22.566 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T13:22:22.579 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-09-28T13:22:22.579 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T13:22:22.588 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-09-28T13:22:22.588 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T13:22:22.599 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-09-28T13:22:22.608 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-09-28T13:22:26.604 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T13:22:26.610 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T13:22:26.712 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-09-28T13:22:26.718 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-09-28T13:22:30.714 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T13:22:30.723 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T13:22:30.826 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-09-28T13:22:30.832 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-09-28T13:22:30.928 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-09-28T13:22:30.933 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-09-28T13:22:31.029 INFO:teuthology.orchestra.console.smithi102:Power on 2023-09-28T13:22:31.029 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-28T13:22:31.036 INFO:teuthology.orchestra.console.smithi008:Power on 2023-09-28T13:22:31.036 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-28T13:22:31.050 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On 2023-09-28T13:22:31.050 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T13:22:31.056 DEBUG:teuthology.orchestra.console.smithi008:power on output: Chassis Power Control: Up/On 2023-09-28T13:22:31.057 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T13:22:31.069 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-09-28T13:22:31.077 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-09-28T13:22:35.072 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T13:22:35.079 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T13:22:35.181 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-09-28T13:22:35.187 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-09-28T13:22:39.186 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T13:22:39.195 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T13:22:39.297 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-09-28T13:22:39.302 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-09-28T13:22:39.399 INFO:teuthology.orchestra.console.smithi102:Power on completed 2023-09-28T13:22:39.403 INFO:teuthology.orchestra.console.smithi008:Power on completed 2023-09-28T13:22:39.500 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-09-28T13:22:39.500 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-09-28T13:22:39.504 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2023-09-28T13:22:39.504 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-09-28T13:22:54.566 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-09-28T13:22:54.568 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-09-28T13:23:09.630 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-09-28T13:23:09.830 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-09-28T13:23:24.906 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-09-28T13:23:24.907 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-09-28T13:23:39.974 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-09-28T13:23:39.977 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-09-28T13:23:55.046 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-09-28T13:23:55.047 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-09-28T13:24:10.122 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-09-28T13:24:10.124 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-09-28T13:24:25.190 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-09-28T13:24:25.192 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-09-28T13:24:40.266 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-09-28T13:24:40.268 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-09-28T13:24:55.338 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-09-28T13:24:55.340 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-09-28T13:25:10.418 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-09-28T13:25:10.420 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-09-28T13:25:25.482 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-09-28T13:25:25.483 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-09-28T13:25:25.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:25:25.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:25:43.935 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-09-28T13:25:43.935 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-09-28T13:25:49.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:25:49.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:25:53.022 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-09-28T13:25:53.023 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-09-28T13:25:59.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:25:59.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:26:02.110 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-09-28T13:26:02.111 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-09-28T13:26:08.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:26:08.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:26:11.194 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-09-28T13:26:11.195 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-09-28T13:26:17.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:26:17.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:27:17.261 WARNING:teuthology.provision.fog.smithi102:timed out 2023-09-28T13:27:17.261 WARNING:teuthology.provision.fog.smithi008:timed out 2023-09-28T13:27:23.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:27:23.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:27:23.506 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-28T13:27:23.506 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-28T13:27:23.638 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-28T13:27:23.639 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-28T13:27:23.756 INFO:teuthology.provision.fog.smithi008:Node is ready 2023-09-28T13:27:23.757 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2023-09-28T13:27:23.772 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2023-09-28T13:27:23.772 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2023-09-28T13:27:23.828 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2023-09-28T13:27:23.828 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-09-28T13:27:23.890 INFO:teuthology.provision.fog.smithi102:Node is ready 2023-09-28T13:27:23.890 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2023-09-28T13:27:23.906 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2023-09-28T13:27:23.906 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2023-09-28T13:27:23.943 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2023-09-28T13:27:23.962 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2023-09-28T13:27:23.963 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-09-28T13:27:23.969 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2023-09-28T13:27:24.034 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2023-09-28T13:27:24.076 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2023-09-28T13:27:24.099 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-09-28T13:27:24.102 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2023-09-28T13:27:24.163 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-09-28T13:27:24.166 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2023-09-28T13:27:24.218 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T13:27:24.218 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T13:27:24.218 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2023-09-28T13:27:24.218 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2023-09-28T13:27:24.218 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.4" 2023-09-28T13:27:24.218 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-09-28T13:27:24.218 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T13:27:24.218 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-09-28T13:27:24.218 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T13:27:24.219 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T13:27:24.219 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T13:27:24.219 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T13:27:24.219 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-09-28T13:27:24.219 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T13:27:24.219 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T13:27:24.219 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T13:27:24.219 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T13:27:24.220 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2023-09-28T13:27:24.221 DEBUG:teuthology.parallel:result is None 2023-09-28T13:27:24.230 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-09-28T13:27:24.294 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-09-28T13:27:24.348 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T13:27:24.348 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T13:27:24.348 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2023-09-28T13:27:24.348 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2023-09-28T13:27:24.349 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.4" 2023-09-28T13:27:24.349 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-09-28T13:27:24.349 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T13:27:24.349 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-09-28T13:27:24.349 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T13:27:24.349 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T13:27:24.349 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T13:27:24.349 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T13:27:24.349 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-09-28T13:27:24.349 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T13:27:24.349 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T13:27:24.349 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T13:27:24.349 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T13:27:24.350 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2023-09-28T13:27:24.350 DEBUG:teuthology.parallel:result is None 2023-09-28T13:27:24.495 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2023-09-28T13:27:24.496 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-28T13:27:24.518 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2023-09-28T13:27:24.518 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-28T13:27:24.536 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2023-09-28T13:27:24.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-09-28T13:27:24.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:27:24.601 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-09-28T13:27:24.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-09-28T13:27:24.668 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-09-28T13:27:24.722 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-09-28T13:27:24.723 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-09-28T13:27:24.776 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T13:27:24.776 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T13:27:24.777 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2023-09-28T13:27:24.777 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2023-09-28T13:27:24.777 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.4" 2023-09-28T13:27:24.777 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-09-28T13:27:24.777 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T13:27:24.777 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-09-28T13:27:24.777 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T13:27:24.777 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T13:27:24.777 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T13:27:24.777 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T13:27:24.777 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-09-28T13:27:24.777 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T13:27:24.778 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T13:27:24.778 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T13:27:24.778 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T13:27:24.778 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-09-28T13:27:24.794 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2023-09-28T13:27:24.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-09-28T13:27:24.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T13:27:24.860 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-09-28T13:27:24.928 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-09-28T13:27:24.929 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-09-28T13:27:24.982 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-09-28T13:27:24.983 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-09-28T13:27:25.036 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T13:27:25.036 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T13:27:25.036 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2023-09-28T13:27:25.036 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2023-09-28T13:27:25.036 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.4" 2023-09-28T13:27:25.036 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-09-28T13:27:25.036 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T13:27:25.036 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-09-28T13:27:25.036 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T13:27:25.037 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T13:27:25.037 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T13:27:25.037 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T13:27:25.037 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-09-28T13:27:25.037 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T13:27:25.037 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T13:27:25.037 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T13:27:25.037 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T13:27:25.038 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-09-28T13:27:25.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T13:27:25.153 INFO:teuthology.dispatcher.supervisor:Running job 7403819 2023-09-28T13:27:25.153 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-27_19:25:46-fs-wip-yuri2-testing-2023-09-27-0908-quincy-distro-default-smithi/7403819 --name yuriw-2023-09-27_19:25:46-fs-wip-yuri2-testing-2023-09-27-0908-quincy-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} -- /home/teuthworker/archive/yuriw-2023-09-27_19:25:46-fs-wip-yuri2-testing-2023-09-27-0908-quincy-distro-default-smithi/7403819/orig.config.yaml 2023-09-28T13:27:25.155 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-27_19:25:46-fs-wip-yuri2-testing-2023-09-27-0908-quincy-distro-default-smithi/7403819 2023-09-28T13:27:25.156 INFO:teuthology.dispatcher.supervisor:Job PID: 4069882 2023-09-28T13:27:25.156 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-28T13:29:25.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T13:31:25.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T13:33:25.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T13:35:25.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T13:37:25.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T13:39:25.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T13:41:26.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T13:43:26.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T13:45:26.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T13:45:26.539 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-28T13:45:26.647 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-28T13:45:26.647 INFO:teuthology.nuke:Checking targets against current locks 2023-09-28T13:45:26.696 DEBUG:teuthology.nuke:shortname: smithi008 2023-09-28T13:45:26.696 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T13:45:26.720 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:25:46-fs-wip-yuri2-testing-2023-09-27-0908-quincy-distro-default-smithi/7403819', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 13:22:21.137680', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFpfmzTQJ2x23XKdjxBWROsq5drTz3M5Mpeu9BJlTYgSoWv0uL+oo7bVweGjusRY12ZYKfbCuv/QxpSjF4mnvpk='} 2023-09-28T13:45:26.723 DEBUG:teuthology.nuke:shortname: smithi102 2023-09-28T13:45:26.724 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T13:45:26.747 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:25:46-fs-wip-yuri2-testing-2023-09-27-0908-quincy-distro-default-smithi/7403819', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 13:22:21.139373', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGCMNPmuMFXY90/Ir0ZxXuikr0YvrU/4VLA//goC4joIcsUWzwQuFJ035QqCQplPomb1uRRfdyj7hqpQ9Nm5gKY='} 2023-09-28T13:45:26.776 INFO:teuthology.orchestra.console.smithi008:Power off 2023-09-28T13:45:26.777 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T13:45:26.797 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-09-28T13:45:26.797 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T13:45:26.811 INFO:teuthology.orchestra.console.smithi102:Power off 2023-09-28T13:45:26.812 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T13:45:26.824 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-09-28T13:45:26.833 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-09-28T13:45:26.834 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T13:45:26.853 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-09-28T13:45:26.925 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-09-28T13:45:26.955 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-09-28T13:45:27.090 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com 2023-09-28T13:45:27.097 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com