2023-10-10T11:36:18.424 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-10T11:36:18.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:36:18.584 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6d2419b670>, signals=[15]) 2023-10-10T11:36:18.586 INFO:teuthology.lock.ops:Start node 'smithi070.front.sepia.ceph.com' reimaging 2023-10-10T11:36:18.587 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T11:36:18.587 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2023-10-10T11:36:18.608 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging 2023-10-10T11:36:18.608 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T11:36:18.609 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-10-10T11:36:18.610 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /host {"name": "smithi070"} 2023-10-10T11:36:18.634 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /host {"name": "smithi092"} 2023-10-10T11:36:18.688 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-10T11:36:18.714 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-10T11:36:18.744 DEBUG:teuthology.provision.fog.smithi070:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-10T11:36:18.744 DEBUG:teuthology.provision.fog.smithi070:FOG request: PUT /host/175 {"imageID": 7} 2023-10-10T11:36:18.774 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-10T11:36:18.774 DEBUG:teuthology.provision.fog.smithi092:FOG request: PUT /host/197 {"imageID": 7} 2023-10-10T11:36:18.798 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of rhel 8.4 2023-10-10T11:36:18.799 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-10-10T11:36:18.825 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of rhel 8.4 2023-10-10T11:36:18.825 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-10T11:36:18.858 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T11:36:18.879 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T11:36:18.893 DEBUG:teuthology.provision.fog.smithi070:FOG request: POST /host/175/task {"taskTypeID": 1} 2023-10-10T11:36:18.914 DEBUG:teuthology.provision.fog.smithi092:FOG request: POST /host/197/task {"taskTypeID": 1} 2023-10-10T11:36:18.950 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-10-10T11:36:18.963 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-10T11:36:19.058 INFO:teuthology.orchestra.console.smithi092:Power off 2023-10-10T11:36:19.059 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T11:36:19.083 INFO:teuthology.orchestra.console.smithi070:Power off 2023-10-10T11:36:19.084 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T11:36:19.096 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-10-10T11:36:19.097 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:36:19.114 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2023-10-10T11:36:19.115 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:36:19.145 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-10T11:36:19.165 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-10-10T11:36:23.150 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:36:23.166 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:36:23.260 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-10T11:36:23.278 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-10-10T11:36:27.262 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:36:27.279 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:36:27.372 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-10T11:36:27.390 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-10-10T11:36:27.491 INFO:teuthology.orchestra.console.smithi070:Power off completed 2023-10-10T11:36:27.592 INFO:teuthology.orchestra.console.smithi070:Power on 2023-10-10T11:36:27.592 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T11:36:27.615 DEBUG:teuthology.orchestra.console.smithi070:power on output: Chassis Power Control: Up/On 2023-10-10T11:36:27.615 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:36:27.638 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-10-10T11:36:31.374 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:36:31.483 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-10-10T11:36:31.585 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-10-10T11:36:31.639 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:36:31.686 INFO:teuthology.orchestra.console.smithi092:Power on 2023-10-10T11:36:31.687 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T11:36:31.709 DEBUG:teuthology.orchestra.console.smithi092:power on output: Chassis Power Control: Up/On 2023-10-10T11:36:31.710 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:36:31.735 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-10-10T11:36:31.749 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-10-10T11:36:35.738 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:36:35.749 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:36:35.850 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-10-10T11:36:35.864 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2023-10-10T11:36:35.965 INFO:teuthology.orchestra.console.smithi070:Power on completed 2023-10-10T11:36:36.066 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish 2023-10-10T11:36:36.067 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-10-10T11:36:39.854 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:36:40.030 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2023-10-10T11:36:40.131 INFO:teuthology.orchestra.console.smithi092:Power on completed 2023-10-10T11:36:40.233 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2023-10-10T11:36:40.233 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-10T11:36:51.138 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-10-10T11:36:55.294 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-10T11:37:06.210 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-10-10T11:37:10.355 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-10T11:37:21.295 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-10-10T11:37:25.426 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-10T11:37:36.374 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-10-10T11:37:40.498 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-10T11:37:51.458 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-10-10T11:37:55.574 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-10T11:38:06.546 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-10-10T11:38:10.650 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-10T11:38:21.626 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-10-10T11:38:25.727 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-10T11:38:36.706 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-10-10T11:38:40.803 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-10T11:38:51.786 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-10-10T11:38:55.870 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-10T11:39:06.857 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-10-10T11:39:10.942 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-10T11:39:21.938 DEBUG:teuthology.provision.fog.smithi070:FOG request: GET /task/active None 2023-10-10T11:39:21.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:39:25.054 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-10-10T11:39:26.019 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-10-10T11:39:26.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:39:29.153 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-10T11:39:31.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:39:34.138 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-10-10T11:39:35.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:39:38.234 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-10T11:39:40.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:39:43.198 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-10-10T11:39:44.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:39:47.290 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-10T11:39:49.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:39:52.282 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-10-10T11:39:53.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:39:56.353 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-10T11:39:58.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:40:01.342 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-10-10T11:40:02.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:40:05.434 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-10T11:40:07.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:40:10.426 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2023-10-10T11:40:11.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:40:14.490 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-10-10T11:40:16.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:40:20.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:41:16.486 WARNING:teuthology.provision.fog.smithi070:timed out 2023-10-10T11:41:20.498 WARNING:teuthology.provision.fog.smithi092:timed out 2023-10-10T11:41:22.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:41:22.881 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T11:41:22.882 DEBUG:teuthology.orchestra.run.smithi070:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T11:41:23.156 INFO:teuthology.provision.fog.smithi070:Node is ready 2023-10-10T11:41:23.157 DEBUG:teuthology.orchestra.run.smithi070:> hostname 2023-10-10T11:41:23.172 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com 2023-10-10T11:41:23.172 DEBUG:teuthology.orchestra.run.smithi070:> grep smithi070.front.sepia.ceph.com /etc/hosts 2023-10-10T11:41:23.227 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070 2023-10-10T11:41:23.228 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2023-10-10T11:41:23.340 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hosts 2023-10-10T11:41:23.365 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/172.21.15.70/172.21.15.70/g' /etc/hosts 2023-10-10T11:41:23.429 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hostname 2023-10-10T11:41:23.493 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2023-10-10T11:41:23.556 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2023-10-10T11:41:23.610 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T11:41:23.611 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T11:41:23.611 INFO:teuthology.orchestra.run.smithi070.stdout:ID="rhel" 2023-10-10T11:41:23.611 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="fedora" 2023-10-10T11:41:23.611 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8.4" 2023-10-10T11:41:23.611 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2023-10-10T11:41:23.612 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T11:41:23.612 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2023-10-10T11:41:23.612 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T11:41:23.612 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T11:41:23.612 INFO:teuthology.orchestra.run.smithi070.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T11:41:23.613 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T11:41:23.613 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-10T11:41:23.613 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T11:41:23.613 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T11:41:23.613 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T11:41:23.613 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T11:41:23.614 INFO:teuthology.provision.fog.smithi070:Deploy complete! 2023-10-10T11:41:23.616 DEBUG:teuthology.parallel:result is None 2023-10-10T11:41:26.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:41:26.906 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T11:41:26.906 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T11:41:27.214 INFO:teuthology.provision.fog.smithi092:Node is ready 2023-10-10T11:41:27.214 DEBUG:teuthology.orchestra.run.smithi092:> hostname 2023-10-10T11:41:27.229 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092 2023-10-10T11:41:27.229 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092 /etc/hosts 2023-10-10T11:41:27.288 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092 2023-10-10T11:41:27.288 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-10-10T11:41:27.405 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092/smithi092/g' /etc/hosts 2023-10-10T11:41:27.430 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts 2023-10-10T11:41:27.498 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092/smithi092/g' /etc/hostname 2023-10-10T11:41:27.565 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-10-10T11:41:27.632 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-10-10T11:41:27.689 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T11:41:27.690 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T11:41:27.690 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-10-10T11:41:27.690 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-10-10T11:41:27.690 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.4" 2023-10-10T11:41:27.691 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-10-10T11:41:27.691 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T11:41:27.691 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-10-10T11:41:27.691 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T11:41:27.691 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T11:41:27.692 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T11:41:27.692 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T11:41:27.692 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-10T11:41:27.692 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T11:41:27.692 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T11:41:27.693 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T11:41:27.693 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T11:41:27.693 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2023-10-10T11:41:27.694 DEBUG:teuthology.parallel:result is None 2023-10-10T11:41:27.848 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com 2023-10-10T11:41:27.849 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-10T11:41:27.967 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com 2023-10-10T11:41:27.967 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-10T11:41:28.003 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server 2023-10-10T11:41:28.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-10-10T11:41:28.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:41:28.072 DEBUG:teuthology.orchestra.run.smithi070:> true 2023-10-10T11:41:28.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-10-10T11:41:28.141 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2023-10-10T11:41:28.194 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2023-10-10T11:41:28.195 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2023-10-10T11:41:28.252 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T11:41:28.253 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T11:41:28.253 INFO:teuthology.orchestra.run.smithi070.stdout:ID="rhel" 2023-10-10T11:41:28.253 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="fedora" 2023-10-10T11:41:28.254 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8.4" 2023-10-10T11:41:28.254 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2023-10-10T11:41:28.254 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T11:41:28.255 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2023-10-10T11:41:28.255 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T11:41:28.256 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T11:41:28.256 INFO:teuthology.orchestra.run.smithi070.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T11:41:28.256 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T11:41:28.257 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-10-10T11:41:28.257 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T11:41:28.258 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T11:41:28.258 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T11:41:28.258 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T11:41:28.260 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2023-10-10T11:41:28.286 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server 2023-10-10T11:41:28.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-10T11:41:28.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:41:28.357 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-10-10T11:41:28.425 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-10-10T11:41:28.425 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-10-10T11:41:28.483 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-10-10T11:41:28.483 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-10-10T11:41:28.540 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T11:41:28.541 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T11:41:28.541 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-10-10T11:41:28.541 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-10-10T11:41:28.541 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.4" 2023-10-10T11:41:28.542 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-10-10T11:41:28.542 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T11:41:28.542 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-10-10T11:41:28.542 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T11:41:28.542 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T11:41:28.543 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T11:41:28.543 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T11:41:28.543 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-10-10T11:41:28.543 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T11:41:28.543 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T11:41:28.544 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T11:41:28.544 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T11:41:28.544 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-10-10T11:41:28.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:41:28.671 INFO:teuthology.dispatcher.supervisor:Running job 7419587 2023-10-10T11:41:28.671 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419587 --name yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} -- /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419587/orig.config.yaml 2023-10-10T11:41:28.676 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419587 2023-10-10T11:41:28.677 INFO:teuthology.dispatcher.supervisor:Job PID: 2400297 2023-10-10T11:41:28.677 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-10T11:43:28.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:45:28.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:47:29.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:49:29.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:51:29.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:53:29.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:55:29.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:57:29.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:59:30.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T12:01:30.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T12:01:30.385 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-10T12:01:30.493 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-10T12:01:30.494 INFO:teuthology.nuke:Checking targets against current locks 2023-10-10T12:01:30.539 DEBUG:teuthology.nuke:shortname: smithi070 2023-10-10T12:01:30.539 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T12:01:30.559 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419587', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 11:36:17.430275', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEazRyVRPqMaWrtIq2E6oUI0k8q6sK/s5nwZq7eucUoNJRntiA66ebjTLeAJ1RXglBp6yBWPrkRf/lEPvNVLeUA='} 2023-10-10T12:01:30.566 DEBUG:teuthology.nuke:shortname: smithi092 2023-10-10T12:01:30.566 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T12:01:30.589 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419587', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 11:36:17.428400', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFes08gqZJdGEdpAnMt411XE1YQYtr1FJDk8+jD7wb6wZlALeW7SjloAo70ZQIJHb9JV2iiql6nrWVFeBf6cE5E='} 2023-10-10T12:01:30.603 INFO:teuthology.orchestra.console.smithi070:Power off 2023-10-10T12:01:30.604 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T12:01:30.624 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2023-10-10T12:01:30.625 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T12:01:30.637 INFO:teuthology.orchestra.console.smithi092:Power off 2023-10-10T12:01:30.638 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T12:01:30.645 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2023-10-10T12:01:30.658 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2023-10-10T12:01:30.658 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T12:01:30.677 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2023-10-10T12:01:30.746 INFO:teuthology.orchestra.console.smithi070:Power off completed 2023-10-10T12:01:30.779 INFO:teuthology.orchestra.console.smithi092:Power off completed 2023-10-10T12:01:30.901 INFO:teuthology.lock.ops:unlocked: smithi070.front.sepia.ceph.com 2023-10-10T12:01:30.926 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com