2023-06-27T00:18:45.206 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-27T00:18:45.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:18:45.208 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:18:45.360 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb373d6c430>, signals=[15]) 2023-06-27T00:18:45.362 INFO:teuthology.lock.ops:Start node 'smithi082.front.sepia.ceph.com' reimaging 2023-06-27T00:18:45.364 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: reset os type and version on server 2023-06-27T00:18:45.364 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-06-27T00:18:45.389 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging 2023-06-27T00:18:45.389 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server 2023-06-27T00:18:45.389 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-06-27T00:18:45.391 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /host {"name": "smithi082"} 2023-06-27T00:18:53.704 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /host {"name": "smithi151"} 2023-06-27T00:18:55.780 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-06-27T00:18:55.783 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-06-27T00:18:55.825 DEBUG:teuthology.provision.fog.smithi082:Requesting image smithi_rhel_8.4 (ID 7) 2023-06-27T00:18:55.825 DEBUG:teuthology.provision.fog.smithi082:FOG request: PUT /host/187 {"imageID": 7} 2023-06-27T00:18:55.826 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_rhel_8.4 (ID 7) 2023-06-27T00:18:55.826 DEBUG:teuthology.provision.fog.smithi151:FOG request: PUT /host/256 {"imageID": 7} 2023-06-27T00:18:55.869 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of rhel 8.4 2023-06-27T00:18:55.870 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-06-27T00:18:55.872 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of rhel 8.4 2023-06-27T00:18:55.873 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-06-27T00:18:55.932 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /tasktype {"name": "deploy"} 2023-06-27T00:18:55.935 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /tasktype {"name": "deploy"} 2023-06-27T00:18:55.968 DEBUG:teuthology.provision.fog.smithi151:FOG request: POST /host/256/task {"taskTypeID": 1} 2023-06-27T00:18:55.971 DEBUG:teuthology.provision.fog.smithi082:FOG request: POST /host/187/task {"taskTypeID": 1} 2023-06-27T00:18:56.020 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-06-27T00:18:56.023 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-06-27T00:18:56.138 INFO:teuthology.orchestra.console:Power off smithi082 2023-06-27T00:18:56.138 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T00:18:56.151 INFO:teuthology.orchestra.console:Power off smithi151 2023-06-27T00:18:56.152 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T00:18:56.159 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:18:56.171 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:18:56.280 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2023-06-27T00:18:56.291 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2023-06-27T00:18:56.381 INFO:teuthology.orchestra.console:Power on smithi082 2023-06-27T00:18:56.382 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-27T00:18:56.392 INFO:teuthology.orchestra.console:Power on smithi151 2023-06-27T00:18:56.393 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-27T00:18:56.403 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:18:56.417 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:19:00.429 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:19:00.438 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:19:05.540 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:19:05.549 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:19:10.652 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:19:10.660 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:19:15.763 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:19:15.771 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:19:15.974 INFO:teuthology.orchestra.console:Power on for smithi082 completed 2023-06-27T00:19:16.075 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2023-06-27T00:19:16.075 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-06-27T00:19:20.882 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:19:25.992 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:19:31.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:19:31.148 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-06-27T00:19:36.220 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:19:41.335 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:19:46.233 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-06-27T00:19:51.239 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:19:51.449 INFO:teuthology.orchestra.console:Power on for smithi151 completed 2023-06-27T00:19:51.550 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2023-06-27T00:19:51.551 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-06-27T00:20:06.340 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-06-27T00:20:16.349 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-06-27T00:20:31.464 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-06-27T00:20:31.466 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-06-27T00:20:56.580 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-06-27T00:20:56.581 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-06-27T00:21:14.402 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-06-27T00:21:14.403 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-06-27T00:21:35.068 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-06-27T00:21:35.069 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-06-27T00:21:40.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:21:43.088 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-06-27T00:21:49.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:21:52.144 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-06-27T00:21:55.040 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-06-27T00:22:00.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:22:05.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:22:08.112 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-06-27T00:22:14.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:22:22.192 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-06-27T00:22:23.600 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-06-27T00:22:28.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:22:29.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:22:34.609 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-06-27T00:22:37.680 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-06-27T00:22:40.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:22:45.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:22:53.680 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-06-27T00:22:59.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:23:23.248 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-06-27T00:23:29.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:23:32.308 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-06-27T00:23:38.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:23:43.920 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-27T00:23:43.921 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-27T00:23:45.617 WARNING:teuthology.provision.fog.smithi082:timed out 2023-06-27T00:23:51.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:23:56.965 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-27T00:23:56.965 DEBUG:teuthology.orchestra.run.smithi082:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-27T00:23:57.212 INFO:teuthology.provision.fog.smithi082:Node is ready 2023-06-27T00:23:57.213 DEBUG:teuthology.orchestra.run.smithi082:> hostname 2023-06-27T00:23:57.228 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com 2023-06-27T00:23:57.229 DEBUG:teuthology.orchestra.run.smithi082:> grep smithi082.front.sepia.ceph.com /etc/hosts 2023-06-27T00:23:57.285 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082 2023-06-27T00:23:57.286 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2023-06-27T00:23:57.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hosts 2023-06-27T00:23:57.426 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/172.21.15.82/172.21.15.82/g' /etc/hosts 2023-06-27T00:23:57.491 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi082.front.sepia.ceph.com/smithi082/g' /etc/hostname 2023-06-27T00:23:57.556 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2023-06-27T00:23:57.619 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-06-27T00:23:57.673 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Red Hat Enterprise Linux" 2023-06-27T00:23:57.673 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8.4 (Ootpa)" 2023-06-27T00:23:57.673 INFO:teuthology.orchestra.run.smithi082.stdout:ID="rhel" 2023-06-27T00:23:57.673 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="fedora" 2023-06-27T00:23:57.674 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8.4" 2023-06-27T00:23:57.674 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2023-06-27T00:23:57.674 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-27T00:23:57.674 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2023-06-27T00:23:57.674 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-27T00:23:57.674 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.redhat.com/" 2023-06-27T00:23:57.674 INFO:teuthology.orchestra.run.smithi082.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-27T00:23:57.675 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-27T00:23:57.675 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-06-27T00:23:57.675 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-27T00:23:57.675 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-27T00:23:57.675 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-27T00:23:57.675 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-27T00:23:57.676 INFO:teuthology.provision.fog.smithi082:Deploy complete! 2023-06-27T00:23:57.677 DEBUG:teuthology.parallel:result is None 2023-06-27T00:24:03.942 INFO:teuthology.provision.fog.smithi151:Node is ready 2023-06-27T00:24:03.943 DEBUG:teuthology.orchestra.run.smithi151:> hostname 2023-06-27T00:24:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:smithi036 2023-06-27T00:24:03.959 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi036 /etc/hosts 2023-06-27T00:24:04.012 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2023-06-27T00:24:04.013 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-06-27T00:24:04.145 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi036/smithi151/g' /etc/hosts 2023-06-27T00:24:04.169 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.36/172.21.15.151/g' /etc/hosts 2023-06-27T00:24:04.233 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi036/smithi151/g' /etc/hostname 2023-06-27T00:24:04.297 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-06-27T00:24:04.361 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-06-27T00:24:04.415 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Red Hat Enterprise Linux" 2023-06-27T00:24:04.416 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8.4 (Ootpa)" 2023-06-27T00:24:04.416 INFO:teuthology.orchestra.run.smithi151.stdout:ID="rhel" 2023-06-27T00:24:04.416 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="fedora" 2023-06-27T00:24:04.417 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8.4" 2023-06-27T00:24:04.417 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8" 2023-06-27T00:24:04.417 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-27T00:24:04.418 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-06-27T00:24:04.418 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-27T00:24:04.418 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.redhat.com/" 2023-06-27T00:24:04.418 INFO:teuthology.orchestra.run.smithi151.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-27T00:24:04.419 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-27T00:24:04.419 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-06-27T00:24:04.419 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-27T00:24:04.420 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-27T00:24:04.420 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-27T00:24:04.420 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-27T00:24:04.421 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2023-06-27T00:24:04.421 DEBUG:teuthology.parallel:result is None 2023-06-27T00:24:59.632 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com 2023-06-27T00:24:59.633 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-27T00:25:04.661 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com 2023-06-27T00:25:04.661 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-27T00:25:04.692 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server 2023-06-27T00:25:04.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-06-27T00:25:04.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:25:04.761 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-06-27T00:25:04.879 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2023-06-27T00:25:04.935 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2023-06-27T00:25:04.935 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-06-27T00:25:04.990 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Red Hat Enterprise Linux" 2023-06-27T00:25:04.990 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8.4 (Ootpa)" 2023-06-27T00:25:04.991 INFO:teuthology.orchestra.run.smithi082.stdout:ID="rhel" 2023-06-27T00:25:04.991 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="fedora" 2023-06-27T00:25:04.991 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8.4" 2023-06-27T00:25:04.991 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2023-06-27T00:25:04.991 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-27T00:25:04.991 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2023-06-27T00:25:04.992 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-27T00:25:04.992 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.redhat.com/" 2023-06-27T00:25:04.992 INFO:teuthology.orchestra.run.smithi082.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-27T00:25:04.992 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-27T00:25:04.992 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-06-27T00:25:04.992 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-27T00:25:04.993 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-27T00:25:04.993 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-27T00:25:04.993 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-27T00:25:04.993 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-06-27T00:25:10.018 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server 2023-06-27T00:25:10.019 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-06-27T00:25:10.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:25:15.090 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-06-27T00:25:15.211 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-06-27T00:25:15.266 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-06-27T00:25:15.266 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-06-27T00:25:15.320 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Red Hat Enterprise Linux" 2023-06-27T00:25:15.320 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8.4 (Ootpa)" 2023-06-27T00:25:15.320 INFO:teuthology.orchestra.run.smithi151.stdout:ID="rhel" 2023-06-27T00:25:15.321 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="fedora" 2023-06-27T00:25:15.321 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8.4" 2023-06-27T00:25:15.321 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8" 2023-06-27T00:25:15.321 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-27T00:25:15.321 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-06-27T00:25:15.321 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-27T00:25:15.321 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.redhat.com/" 2023-06-27T00:25:15.322 INFO:teuthology.orchestra.run.smithi151.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-27T00:25:15.322 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-27T00:25:15.322 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-06-27T00:25:15.322 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-27T00:25:15.322 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-27T00:25:15.322 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-27T00:25:15.322 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-27T00:25:15.323 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-06-27T00:25:25.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:25:25.984 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:25:31.089 INFO:teuthology.dispatcher.supervisor:Running job 7317194 2023-06-27T00:25:31.089 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317194 --name yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi --description fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} -- /home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317194/orig.config.yaml 2023-06-27T00:25:31.092 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317194 2023-06-27T00:25:31.094 INFO:teuthology.dispatcher.supervisor:Job PID: 26492 2023-06-27T00:25:31.094 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-27T00:27:31.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:27:31.194 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:29:36.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:29:36.385 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:31:41.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:31:41.558 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:33:46.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:33:46.731 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:35:51.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:35:51.902 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:37:52.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:37:52.082 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:39:56.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:39:56.913 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:42:02.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:42:02.102 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:44:07.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:44:07.167 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:44:08.090 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-27T00:44:08.200 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-27T00:44:08.201 INFO:teuthology.nuke:Checking targets against current locks 2023-06-27T00:44:08.252 DEBUG:teuthology.nuke:shortname: smithi082 2023-06-27T00:44:08.252 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-27T00:44:08.271 DEBUG:teuthology.nuke:shortname: smithi151 2023-06-27T00:44:08.272 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-27T00:44:08.274 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317194', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-27 00:18:34.367632', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvZdh2yAuVY7S5PJ9gdFITgbgfUDIvuHZeQ808YnKR5lnBnYboWUo1JAkoFHg1NE7KhXtfr1xbuEb7gJPBUxx1Vj/+glN8Y4+CaSfomHkwdUwWLmuS+cBq9p5bkskgiV+tfxxiesg/CyxIkMNjMxMyO75pmdCH9AhaOzq/jNlT3h2hxtWh98G3MXX1nqExPHD6z0/vpLVMkLVFjjswiXLNBASBjXxyCwxGFdmrNFgGfG26n+09om+82iXIuvgfPLxWLUJgNq68u/JPRKrNdoLc818IqO0ToDOth1Jk8DjlLSfDKEuH1hkk6ev58pcBKFztg3V8oRn6cAnTQlG4zDek9lupchlcyVaFDGltTDPabaVD7VjSfOuyphIuIGzI9Iz7oPJMsZ8r0PV06PUsjy+Y7x92J2ZYiiWyiDhSq8TqBGcCzcQ04Q05cTrPrnHyoxisWspUsJGoEvhlV7CqM/ZuzXtdqKHxYHOOPbEQ8m000Y1S62lXdH+ZZqAdv+w3nlU='} 2023-06-27T00:44:08.294 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317194', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-27 00:18:34.370037', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqZ6BFQmKnlV9RDd7Vg9JIkhss9xy2d46RXFT9Z596ZOpn8j2Zp2ySBX8q8cca79x0upwS5qVd84Sk2TtvEJzT0XcHaYnxHYUZBja7SUSge2YgS4d8O6s5l9kN2hUk7zz8FhdfG8jaUpXA9WXXYaDITnT7sT80c13bUIAKvFM/kStPvlNJAYs/u0NvLLCo1DsF5cM+q81h5lY7niChkcONZQAzD+dRdH1ZFPO+8Rl7TTrMgURsWZQIj+5TyH2ubfHHIE08B27EbkDM/kTu9f3KYREhU4RJtUHHtXsOH3tqYKlrOQeUg8T0LPAe0ZEzq4xJvG4TEizQz/taG/JmhWFI2EB31yWoC6+EsqcD/sj7aLQhiKOdonczo1kOgXfVYzwdPnXL8w+n1Vr4a67ENCwnikcfXZVsvs4Hf7jGRMftKgLxf98uWoiJuQevWg6JglIQXLNQULjTOynN59+hrOJts8h2AgFG8vE/H8WxCeoBmPYG3eXXQTni/k+kQphimEs='} 2023-06-27T00:44:08.327 INFO:teuthology.orchestra.console:Power off smithi082 2023-06-27T00:44:08.327 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T00:44:08.350 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:44:08.368 INFO:teuthology.orchestra.console:Power off smithi151 2023-06-27T00:44:08.368 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T00:44:08.391 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:44:08.478 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2023-06-27T00:44:08.517 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2023-06-27T00:44:08.639 INFO:teuthology.lock.ops:unlocked: smithi082.front.sepia.ceph.com 2023-06-27T00:44:08.663 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com