2023-10-05T04:12:51.231 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-05T04:12:51.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T04:12:51.401 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9c1f957670>, signals=[15]) 2023-10-05T04:12:51.401 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2023-10-05T04:12:51.401 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2023-10-05T04:12:51.402 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-10-05T04:12:51.425 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-10-05T04:12:51.425 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-10-05T04:12:51.425 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-10-05T04:12:51.427 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"} 2023-10-05T04:12:51.467 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-10-05T04:12:51.542 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-05T04:12:51.558 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-05T04:12:51.597 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-05T04:12:51.597 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 7} 2023-10-05T04:12:51.616 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-05T04:12:51.616 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 7} 2023-10-05T04:12:51.651 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of rhel 8.4 2023-10-05T04:12:51.651 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-05T04:12:51.673 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of rhel 8.4 2023-10-05T04:12:51.673 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-05T04:12:51.711 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"} 2023-10-05T04:12:51.735 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-10-05T04:12:51.755 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1} 2023-10-05T04:12:51.790 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-10-05T04:12:51.820 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-05T04:12:51.862 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-05T04:12:51.927 INFO:teuthology.orchestra.console.smithi031:Power off 2023-10-05T04:12:51.927 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T04:12:51.961 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-10-05T04:12:51.961 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T04:12:51.981 INFO:teuthology.orchestra.console.smithi139:Power off 2023-10-05T04:12:51.982 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T04:12:52.007 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-10-05T04:12:52.028 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-10-05T04:12:52.028 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T04:12:52.056 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-05T04:12:52.109 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-10-05T04:12:52.158 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-10-05T04:12:52.210 INFO:teuthology.orchestra.console.smithi031:Power on 2023-10-05T04:12:52.210 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-05T04:12:52.258 INFO:teuthology.orchestra.console.smithi139:Power on 2023-10-05T04:12:52.258 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-05T04:12:52.265 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On 2023-10-05T04:12:52.266 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T04:12:52.294 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-10-05T04:12:52.305 DEBUG:teuthology.orchestra.console.smithi139:power on output: Chassis Power Control: Up/On 2023-10-05T04:12:52.305 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T04:12:52.354 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-05T04:12:56.298 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T04:12:56.355 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T04:12:56.408 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-10-05T04:12:56.463 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-10-05T04:12:56.510 INFO:teuthology.orchestra.console.smithi031:Power on completed 2023-10-05T04:12:56.564 INFO:teuthology.orchestra.console.smithi139:Power on completed 2023-10-05T04:12:56.611 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2023-10-05T04:12:56.611 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-05T04:12:56.665 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-10-05T04:12:56.665 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-05T04:13:11.695 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-05T04:13:11.728 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-05T04:13:26.778 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-05T04:13:26.796 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-05T04:13:41.862 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-05T04:13:41.864 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-05T04:13:56.970 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-05T04:13:56.971 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-05T04:14:12.114 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-05T04:14:12.115 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-05T04:14:27.214 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-05T04:14:27.215 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-05T04:14:42.306 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-05T04:14:42.307 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-05T04:14:57.407 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-05T04:14:57.408 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-05T04:15:12.506 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-05T04:15:12.507 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-05T04:15:27.602 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-05T04:15:27.603 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-05T04:15:27.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T04:15:42.698 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-05T04:15:46.046 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-05T04:15:52.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T04:15:55.130 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-05T04:15:57.768 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-05T04:15:57.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T04:16:01.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T04:16:04.218 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-05T04:16:10.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T04:16:13.306 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-05T04:16:16.254 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-05T04:16:19.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T04:16:22.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T04:16:25.338 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-05T04:16:31.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T04:16:34.426 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-05T04:16:40.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T04:16:43.514 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-05T04:16:49.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T04:16:52.606 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-05T04:16:58.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T04:17:19.339 WARNING:teuthology.provision.fog.smithi031:timed out 2023-10-05T04:17:25.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T04:17:25.716 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-05T04:17:25.717 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-05T04:17:26.007 INFO:teuthology.provision.fog.smithi031:Node is ready 2023-10-05T04:17:26.007 DEBUG:teuthology.orchestra.run.smithi031:> hostname 2023-10-05T04:17:26.022 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com 2023-10-05T04:17:26.023 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts 2023-10-05T04:17:26.079 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031 2023-10-05T04:17:26.079 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-10-05T04:17:26.201 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts 2023-10-05T04:17:26.228 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts 2023-10-05T04:17:26.295 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname 2023-10-05T04:17:26.360 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-10-05T04:17:26.425 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-10-05T04:17:26.480 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T04:17:26.480 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.4 (Ootpa)" 2023-10-05T04:17:26.481 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel" 2023-10-05T04:17:26.481 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora" 2023-10-05T04:17:26.481 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.4" 2023-10-05T04:17:26.481 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2023-10-05T04:17:26.481 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-05T04:17:26.481 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-10-05T04:17:26.481 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-05T04:17:26.481 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T04:17:26.481 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T04:17:26.481 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T04:17:26.481 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-05T04:17:26.482 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T04:17:26.482 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-05T04:17:26.482 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T04:17:26.482 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-05T04:17:26.482 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2023-10-05T04:17:26.484 DEBUG:teuthology.parallel:result is None 2023-10-05T04:17:58.654 WARNING:teuthology.provision.fog.smithi139:timed out 2023-10-05T04:18:04.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T04:18:05.030 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-05T04:18:05.030 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-05T04:18:05.316 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-10-05T04:18:05.316 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-10-05T04:18:05.331 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-10-05T04:18:05.332 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-10-05T04:18:05.385 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-10-05T04:18:05.385 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-10-05T04:18:05.503 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-10-05T04:18:05.529 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-10-05T04:18:05.592 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-10-05T04:18:05.655 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-10-05T04:18:05.719 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-10-05T04:18:05.772 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T04:18:05.772 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.4 (Ootpa)" 2023-10-05T04:18:05.772 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-10-05T04:18:05.772 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-10-05T04:18:05.772 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.4" 2023-10-05T04:18:05.772 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-10-05T04:18:05.772 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-05T04:18:05.772 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-10-05T04:18:05.772 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-05T04:18:05.773 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T04:18:05.773 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T04:18:05.773 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T04:18:05.773 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-05T04:18:05.773 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T04:18:05.773 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-05T04:18:05.773 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T04:18:05.773 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-05T04:18:05.773 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-10-05T04:18:05.774 DEBUG:teuthology.parallel:result is None 2023-10-05T04:18:06.107 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2023-10-05T04:18:06.108 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-05T04:18:06.145 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-10-05T04:18:06.145 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-05T04:18:06.179 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2023-10-05T04:18:06.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-05T04:18:06.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T04:18:06.257 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-10-05T04:18:06.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-05T04:18:06.382 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-10-05T04:18:06.437 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-10-05T04:18:06.437 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-10-05T04:18:06.493 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T04:18:06.493 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.4 (Ootpa)" 2023-10-05T04:18:06.493 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel" 2023-10-05T04:18:06.493 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora" 2023-10-05T04:18:06.494 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.4" 2023-10-05T04:18:06.494 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2023-10-05T04:18:06.494 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-05T04:18:06.494 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-10-05T04:18:06.494 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-05T04:18:06.494 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T04:18:06.494 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T04:18:06.494 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T04:18:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-10-05T04:18:06.494 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T04:18:06.494 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-05T04:18:06.495 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T04:18:06.495 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-05T04:18:06.495 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-10-05T04:18:06.528 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-10-05T04:18:06.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-10-05T04:18:06.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T04:18:06.603 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-10-05T04:18:06.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-10-05T04:18:06.675 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-10-05T04:18:06.729 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-10-05T04:18:06.730 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-10-05T04:18:06.783 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-10-05T04:18:06.784 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.4 (Ootpa)" 2023-10-05T04:18:06.784 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-10-05T04:18:06.784 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-10-05T04:18:06.784 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.4" 2023-10-05T04:18:06.784 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-10-05T04:18:06.784 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-05T04:18:06.785 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-10-05T04:18:06.785 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-05T04:18:06.785 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-10-05T04:18:06.785 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-05T04:18:06.785 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T04:18:06.785 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-10-05T04:18:06.785 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-05T04:18:06.785 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-05T04:18:06.786 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-05T04:18:06.786 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-05T04:18:06.786 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-10-05T04:18:06.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T04:18:06.919 INFO:teuthology.dispatcher.supervisor:Running job 7410884 2023-10-05T04:18:06.919 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-04_19:55:00-fs-wip-yuri-testing-2023-10-04-0859-quincy-distro-default-smithi/7410884 --name yuriw-2023-10-04_19:55:00-fs-wip-yuri-testing-2023-10-04-0859-quincy-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}} -- /home/teuthworker/archive/yuriw-2023-10-04_19:55:00-fs-wip-yuri-testing-2023-10-04-0859-quincy-distro-default-smithi/7410884/orig.config.yaml 2023-10-05T04:18:06.921 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-04_19:55:00-fs-wip-yuri-testing-2023-10-04-0859-quincy-distro-default-smithi/7410884 2023-10-05T04:18:06.922 INFO:teuthology.dispatcher.supervisor:Job PID: 633488 2023-10-05T04:18:06.922 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-05T04:20:07.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T04:22:07.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T04:24:07.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T04:26:07.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T04:28:07.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T04:30:07.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T04:32:08.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T04:34:08.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T04:36:08.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T04:38:08.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T04:38:08.720 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-05T04:38:08.863 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-05T04:38:08.863 INFO:teuthology.nuke:Checking targets against current locks 2023-10-05T04:38:08.952 DEBUG:teuthology.nuke:shortname: smithi031 2023-10-05T04:38:08.952 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T04:38:08.984 DEBUG:teuthology.nuke:shortname: smithi139 2023-10-05T04:38:08.984 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T04:38:08.997 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-04_19:55:00-fs-wip-yuri-testing-2023-10-04-0859-quincy-distro-default-smithi/7410884', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 04:12:50.335816', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHFlIx8679tUP0wm5BJe11ZiG/lNAEu2xbyAGWzJrO+8JxfN5alAggmrwz5IVSbXex7Dr/Aw6evl/1rpewGRe2Q='} 2023-10-05T04:38:09.041 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-04_19:55:00-fs-wip-yuri-testing-2023-10-04-0859-quincy-distro-default-smithi/7410884', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 04:12:50.333895', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAEuF5KN30f43WXPdFbhqicPnciCyBgo1/e4wqHg4fVTQme1Q8nFOFFjv2HJzB6ohBplt8el23DnuVCZuAm3c8I='} 2023-10-05T04:38:09.078 INFO:teuthology.orchestra.console.smithi031:Power off 2023-10-05T04:38:09.078 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T04:38:09.125 INFO:teuthology.orchestra.console.smithi139:Power off 2023-10-05T04:38:09.126 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T04:38:09.133 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-10-05T04:38:09.134 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T04:38:09.157 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-10-05T04:38:09.157 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T04:38:09.166 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-10-05T04:38:09.187 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-05T04:38:09.267 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-10-05T04:38:09.288 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-10-05T04:38:09.449 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com 2023-10-05T04:38:09.475 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com