2023-06-23T00:07:41.011 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-23T00:07:41.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:07:41.013 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:07:41.173 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7a9e53b430>, signals=[15]) 2023-06-23T00:07:41.175 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging 2023-06-23T00:07:41.175 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server 2023-06-23T00:07:41.176 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-06-23T00:07:41.201 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging 2023-06-23T00:07:41.201 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server 2023-06-23T00:07:41.201 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-06-23T00:07:41.203 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /host {"name": "smithi046"} 2023-06-23T00:07:41.225 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /host {"name": "smithi092"} 2023-06-23T00:07:41.279 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-06-23T00:07:41.298 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-06-23T00:07:41.329 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_rhel_8.4 (ID 7) 2023-06-23T00:07:41.330 DEBUG:teuthology.provision.fog.smithi046:FOG request: PUT /host/151 {"imageID": 7} 2023-06-23T00:07:41.340 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_rhel_8.4 (ID 7) 2023-06-23T00:07:41.340 DEBUG:teuthology.provision.fog.smithi092:FOG request: PUT /host/197 {"imageID": 7} 2023-06-23T00:07:41.371 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of rhel 8.4 2023-06-23T00:07:41.371 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-06-23T00:07:41.377 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of rhel 8.4 2023-06-23T00:07:41.377 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:07:41.443 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /tasktype {"name": "deploy"} 2023-06-23T00:07:41.447 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /tasktype {"name": "deploy"} 2023-06-23T00:07:41.480 DEBUG:teuthology.provision.fog.smithi092:FOG request: POST /host/197/task {"taskTypeID": 1} 2023-06-23T00:07:41.483 DEBUG:teuthology.provision.fog.smithi046:FOG request: POST /host/151/task {"taskTypeID": 1} 2023-06-23T00:07:41.537 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:07:41.548 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-06-23T00:07:41.646 INFO:teuthology.orchestra.console:Power off smithi092 2023-06-23T00:07:41.647 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T00:07:41.662 INFO:teuthology.orchestra.console:Power off smithi046 2023-06-23T00:07:41.663 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T00:07:41.674 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:07:41.688 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:07:45.700 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:07:45.709 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:07:49.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:07:49.821 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:07:50.032 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2023-06-23T00:07:50.133 INFO:teuthology.orchestra.console:Power on smithi046 2023-06-23T00:07:50.134 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-23T00:07:50.158 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:07:53.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:07:54.139 INFO:teuthology.orchestra.console:Power off for smithi092 completed 2023-06-23T00:07:54.184 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:07:54.241 INFO:teuthology.orchestra.console:Power on smithi092 2023-06-23T00:07:54.241 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-23T00:07:54.262 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:07:58.284 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:07:58.296 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:07:58.508 INFO:teuthology.orchestra.console:Power on for smithi046 completed 2023-06-23T00:07:58.609 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2023-06-23T00:07:58.610 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-06-23T00:08:02.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:08:02.606 INFO:teuthology.orchestra.console:Power on for smithi092 completed 2023-06-23T00:08:02.707 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2023-06-23T00:08:02.707 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:08:13.708 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-06-23T00:08:17.784 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:08:28.810 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-06-23T00:08:32.860 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:08:43.912 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-06-23T00:08:47.944 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:08:59.021 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-06-23T00:09:03.027 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:09:14.124 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-06-23T00:09:18.104 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:09:29.220 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-06-23T00:09:33.176 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:09:44.308 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-06-23T00:09:48.244 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:09:59.440 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-06-23T00:10:03.320 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:10:14.540 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-06-23T00:10:18.408 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:10:29.625 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-06-23T00:10:33.476 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:10:44.708 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-06-23T00:10:44.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:10:47.856 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-06-23T00:10:48.540 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:10:53.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:10:56.912 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-06-23T00:11:02.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:11:03.606 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:11:06.000 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-06-23T00:11:12.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:11:15.060 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-06-23T00:11:18.684 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-06-23T00:11:18.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:11:21.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:11:21.812 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-06-23T00:11:24.148 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-06-23T00:11:27.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:11:30.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:11:30.896 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-06-23T00:11:33.232 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-06-23T00:11:36.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:11:39.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:11:39.952 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-06-23T00:11:45.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:11:49.012 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-06-23T00:11:55.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:11:58.096 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-06-23T00:12:04.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:12:07.156 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-06-23T00:12:13.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:12:31.728 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-06-23T00:12:37.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:12:39.239 WARNING:teuthology.provision.fog.smithi046:timed out 2023-06-23T00:12:40.788 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-06-23T00:12:45.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:12:45.602 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-23T00:12:45.603 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-23T00:12:45.854 INFO:teuthology.provision.fog.smithi046:Node is ready 2023-06-23T00:12:45.854 DEBUG:teuthology.orchestra.run.smithi046:> hostname 2023-06-23T00:12:45.910 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2023-06-23T00:12:45.911 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts 2023-06-23T00:12:45.968 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-06-23T00:12:45.969 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-06-23T00:12:46.097 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts 2023-06-23T00:12:46.125 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts 2023-06-23T00:12:46.191 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname 2023-06-23T00:12:46.259 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-06-23T00:12:46.326 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-06-23T00:12:46.381 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:12:46.382 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:12:46.382 INFO:teuthology.orchestra.run.smithi046.stdout:ID="rhel" 2023-06-23T00:12:46.383 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="fedora" 2023-06-23T00:12:46.383 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8.4" 2023-06-23T00:12:46.384 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:12:46.384 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:12:46.384 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-06-23T00:12:46.384 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:12:46.385 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:12:46.385 INFO:teuthology.orchestra.run.smithi046.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:12:46.385 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:12:46.385 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-06-23T00:12:46.385 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:12:46.386 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:12:46.386 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:12:46.386 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:12:46.387 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2023-06-23T00:12:46.388 DEBUG:teuthology.parallel:result is None 2023-06-23T00:12:46.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:12:49.840 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-06-23T00:12:55.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:12:56.161 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-23T00:12:56.161 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-23T00:13:16.458 INFO:teuthology.provision.fog.smithi092:Node is ready 2023-06-23T00:13:16.459 DEBUG:teuthology.orchestra.run.smithi092:> hostname 2023-06-23T00:13:16.515 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com 2023-06-23T00:13:16.515 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts 2023-06-23T00:13:16.569 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092 2023-06-23T00:13:16.570 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-06-23T00:13:16.699 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts 2023-06-23T00:13:16.724 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts 2023-06-23T00:13:16.789 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname 2023-06-23T00:13:16.853 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-06-23T00:13:16.916 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-06-23T00:13:16.970 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:13:16.970 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:13:16.970 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-06-23T00:13:16.970 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-06-23T00:13:16.970 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.4" 2023-06-23T00:13:16.971 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:13:16.971 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:13:16.971 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-06-23T00:13:16.971 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:13:16.972 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:13:16.972 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:13:16.972 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:13:16.972 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-06-23T00:13:16.972 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:13:16.972 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:13:16.972 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:13:16.973 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:13:16.973 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2023-06-23T00:13:16.973 DEBUG:teuthology.parallel:result is None 2023-06-23T00:13:17.132 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2023-06-23T00:13:17.133 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-23T00:13:17.162 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com 2023-06-23T00:13:17.163 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-23T00:13:17.189 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2023-06-23T00:13:17.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-06-23T00:13:17.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:13:17.258 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-06-23T00:13:17.384 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2023-06-23T00:13:17.440 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2023-06-23T00:13:17.441 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-06-23T00:13:17.496 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:13:17.496 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:13:17.496 INFO:teuthology.orchestra.run.smithi046.stdout:ID="rhel" 2023-06-23T00:13:17.496 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="fedora" 2023-06-23T00:13:17.496 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8.4" 2023-06-23T00:13:17.497 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:13:17.497 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:13:17.497 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2023-06-23T00:13:17.497 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:13:17.497 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:13:17.497 INFO:teuthology.orchestra.run.smithi046.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:13:17.498 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:13:17.498 INFO:teuthology.orchestra.run.smithi046.stdout: 2023-06-23T00:13:17.498 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:13:17.498 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:13:17.498 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:13:17.498 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:13:17.499 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-06-23T00:13:17.520 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server 2023-06-23T00:13:17.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-06-23T00:13:17.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T00:13:17.585 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-06-23T00:13:17.654 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-06-23T00:13:17.708 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-06-23T00:13:17.709 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-06-23T00:13:17.762 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-06-23T00:13:17.763 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.4 (Ootpa)" 2023-06-23T00:13:17.763 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-06-23T00:13:17.763 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-06-23T00:13:17.763 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.4" 2023-06-23T00:13:17.763 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-06-23T00:13:17.763 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-23T00:13:17.763 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-06-23T00:13:17.764 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-23T00:13:17.764 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-06-23T00:13:17.764 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-23T00:13:17.764 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T00:13:17.764 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-06-23T00:13:17.764 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T00:13:17.765 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-23T00:13:17.765 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-23T00:13:17.765 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-23T00:13:17.765 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-06-23T00:13:17.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:13:17.788 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:13:17.888 INFO:teuthology.dispatcher.supervisor:Running job 7311868 2023-06-23T00:13:17.888 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311868 --name yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} -- /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311868/orig.config.yaml 2023-06-23T00:13:17.892 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311868 2023-06-23T00:13:17.893 INFO:teuthology.dispatcher.supervisor:Job PID: 24181 2023-06-23T00:13:17.893 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-23T00:15:17.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:15:17.994 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:17:18.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:17:18.181 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:19:18.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:19:18.348 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:21:18.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:21:18.534 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:23:18.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:23:18.706 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:25:18.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:25:18.882 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:27:19.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:27:19.058 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:29:19.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:29:19.230 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:31:19.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:31:19.402 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:33:19.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:33:19.581 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:35:19.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:35:19.750 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:37:19.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T00:37:19.929 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T00:37:20.001 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-23T00:37:20.103 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-23T00:37:20.104 INFO:teuthology.nuke:Checking targets against current locks 2023-06-23T00:37:20.161 DEBUG:teuthology.nuke:shortname: smithi046 2023-06-23T00:37:20.162 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T00:37:20.183 DEBUG:teuthology.nuke:shortname: smithi092 2023-06-23T00:37:20.184 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T00:37:20.188 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311868', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:07:40.206513', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvTJqNaQ+J3i3R6/te6iNjJL1rMNPcwB74mD9ljP0AS5iGgWmU8wCv7+vvx/LeolSHWoZy71H5uLnl9YGNAVLKrzAnUvELcvu+Wxu/FmSL1qVJ/W8/ZwzbYpT0oMnzw+zTodR4NyV5TL/NShxPvChJMRTpPOdKHV8tJ2eyZgq+IwsewKlH0w06rwc+7RIEi22hKyrntwkjOZv4GKhJz78xfdCFMz43DsyyHFDEhgiJbyjiR5bTvtgIt3ubr0jEKDMO1ejh8NYXrfzreP4Kl1WArgVQMpFGZFChMy00bwgpk3i7uGq0UZ4wIsceC2IbiihY2PUQAtBQnzuGy+9zW/NC7TDOHq0SnR0Q2g2Dyh854vYPL4o+jG+nhnAtqCX4+ZGlAGwfdssjMNSV/GeQbsLrPFouX+gmn0PgxZcSxw/CdR8nVJumJhpvapAXxY1ninLfLa/mAt5LmJd9Fpnwbni1Alh9RTduz2SdwQJvcA41tdYY/2mHkwulpAMlrhE/6wE='} 2023-06-23T00:37:20.202 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311868', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:07:40.204950', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCTBg4JJ//6x7t/BMbe7QlNas0Xc6H9w2eSSOrKZoAsC7kPiBlOaYE99rS3E3FOV5fVooOMvcOc3EEjAqxeA5FUY7yOd9KRoI/vd3X3wrDvLG6hs/5tKtUMfiOksHGE7TJWEuysMkwF8VCYJvcHQDKjh4V/7y60STuVKpPKyWLnc7BbumIXuw91v6c+LqWp1R9XFoWQVoglStjAkLpDodW/VZUbDFN9z17kJTYIf9l553SAiKsuEwRqWOMkksS95hbeln5YWOPrIwcNMRCbVAsVtceJvjynjN69Jya8kLFyvKwCRlpNWj0JfKbP6dgy+dzHSu8GEFVgfXRRTuSgClzTce74ruBWKRhxaTsBUKzwa+7iS7bgOZIeSyp15SPsEEBlOMC+o8X3xxL/fIO/wDwT7C+SSYgSuqihHYF3546plIT2GozgJ/VOMBtTGKV/TuIE33A1Nz/uK8M+xZCDYgcl7JZtAUle2D/+4wMZO/9wBHkSvqhwBQAQL2l2BGMK9E='} 2023-06-23T00:37:20.242 INFO:teuthology.orchestra.console:Power off smithi046 2023-06-23T00:37:20.243 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T00:37:20.258 INFO:teuthology.orchestra.console:Power off smithi092 2023-06-23T00:37:20.259 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T00:37:20.267 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:37:20.278 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T00:37:20.388 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2023-06-23T00:37:20.399 INFO:teuthology.orchestra.console:Power off for smithi092 completed 2023-06-23T00:37:20.549 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com 2023-06-23T00:37:20.567 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com