2023-07-06T15:18:45.632 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-06T15:18:45.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:18:45.634 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:18:45.767 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fce7b813700>, signals=[15]) 2023-07-06T15:18:45.769 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2023-07-06T15:18:45.769 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T15:18:45.769 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-07-06T15:18:45.791 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-07-06T15:18:45.792 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T15:18:45.792 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-06T15:18:45.794 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"} 2023-07-06T15:18:45.816 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /host {"name": "smithi149"} 2023-07-06T15:18:45.860 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-06T15:18:45.893 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-06T15:18:45.903 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_centos_8.stream (ID 3) 2023-07-06T15:18:45.903 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 3} 2023-07-06T15:18:45.932 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_centos_8.stream (ID 3) 2023-07-06T15:18:45.932 DEBUG:teuthology.provision.fog.smithi149:FOG request: PUT /host/254 {"imageID": 3} 2023-07-06T15:18:45.946 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of centos 8.stream 2023-07-06T15:18:45.947 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:18:45.976 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 8.stream 2023-07-06T15:18:45.977 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:18:45.984 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T15:18:46.013 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1} 2023-07-06T15:18:46.017 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T15:18:46.054 DEBUG:teuthology.provision.fog.smithi149:FOG request: POST /host/254/task {"taskTypeID": 1} 2023-07-06T15:18:46.060 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:18:46.103 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:18:46.143 INFO:teuthology.orchestra.console:Power off smithi093 2023-07-06T15:18:46.143 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T15:18:46.164 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:46.178 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-06T15:18:46.179 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T15:18:46.198 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:50.191 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:50.221 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:54.306 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:54.330 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:54.541 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-06T15:18:54.642 INFO:teuthology.orchestra.console:Power on smithi149 2023-07-06T15:18:54.642 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T15:18:54.662 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:58.420 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:58.630 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2023-07-06T15:18:58.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:58.731 INFO:teuthology.orchestra.console:Power on smithi093 2023-07-06T15:18:58.732 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T15:18:58.750 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:19:02.775 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:19:02.793 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:19:03.049 INFO:teuthology.orchestra.console:Power on for smithi149 completed 2023-07-06T15:19:03.150 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-07-06T15:19:03.150 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:19:06.889 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:19:07.099 INFO:teuthology.orchestra.console:Power on for smithi093 completed 2023-07-06T15:19:07.200 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2023-07-06T15:19:07.200 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:19:18.241 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:19:22.285 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:19:33.325 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:19:37.365 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:19:48.425 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:19:52.442 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:20:03.519 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:20:07.517 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:20:18.603 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:20:22.601 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:20:33.684 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:20:37.684 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:20:48.772 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:20:52.771 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:21:03.878 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:21:07.865 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:21:18.962 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:21:22.944 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:21:34.064 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:21:38.035 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:21:49.154 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:21:53.107 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:22:04.241 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:22:08.174 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:22:19.318 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-06T15:22:19.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:22:23.237 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-06T15:22:23.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:22:37.808 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-06T15:22:41.648 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-06T15:22:43.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:22:46.864 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-06T15:22:47.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:22:50.704 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-06T15:22:52.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:22:55.920 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-06T15:22:56.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:22:59.760 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-06T15:23:01.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:04.976 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-06T15:23:05.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:08.816 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-06T15:23:10.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:14.032 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-06T15:23:14.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:17.872 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-06T15:23:20.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:23.088 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-06T15:23:23.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:29.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:47.440 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-06T15:23:53.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:56.528 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-06T15:24:02.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:24:03.211 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T15:24:03.212 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T15:24:23.876 WARNING:teuthology.provision.fog.smithi093:timed out 2023-07-06T15:24:28.344 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-07-06T15:24:28.344 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2023-07-06T15:24:28.367 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2023-07-06T15:24:28.368 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2023-07-06T15:24:28.428 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-07-06T15:24:28.428 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-06T15:24:28.544 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2023-07-06T15:24:28.574 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2023-07-06T15:24:28.644 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2023-07-06T15:24:28.712 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-06T15:24:28.780 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-06T15:24:28.837 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2023-07-06T15:24:28.837 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8" 2023-07-06T15:24:28.838 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2023-07-06T15:24:28.838 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2023-07-06T15:24:28.838 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8" 2023-07-06T15:24:28.838 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-07-06T15:24:28.838 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T15:24:28.838 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-07-06T15:24:28.838 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T15:24:28.839 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2023-07-06T15:24:28.839 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T15:24:28.839 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T15:24:28.839 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T15:24:28.840 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-07-06T15:24:28.841 DEBUG:teuthology.parallel:result is None 2023-07-06T15:24:29.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:24:30.080 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T15:24:30.080 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T15:24:30.358 INFO:teuthology.provision.fog.smithi093:Node is ready 2023-07-06T15:24:30.359 DEBUG:teuthology.orchestra.run.smithi093:> hostname 2023-07-06T15:24:30.380 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com 2023-07-06T15:24:30.380 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093.front.sepia.ceph.com /etc/hosts 2023-07-06T15:24:30.441 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2023-07-06T15:24:30.441 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-07-06T15:24:30.556 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hosts 2023-07-06T15:24:30.590 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts 2023-07-06T15:24:30.664 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hostname 2023-07-06T15:24:30.735 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-07-06T15:24:30.804 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-07-06T15:24:30.863 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream" 2023-07-06T15:24:30.863 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8" 2023-07-06T15:24:30.863 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos" 2023-07-06T15:24:30.864 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora" 2023-07-06T15:24:30.864 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8" 2023-07-06T15:24:30.864 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-07-06T15:24:30.864 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T15:24:30.864 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-07-06T15:24:30.864 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T15:24:30.864 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/" 2023-07-06T15:24:30.864 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T15:24:30.865 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T15:24:30.865 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T15:24:30.865 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2023-07-06T15:24:30.865 DEBUG:teuthology.parallel:result is None 2023-07-06T15:24:31.050 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2023-07-06T15:24:31.051 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-06T15:24:31.078 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-07-06T15:24:31.079 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-06T15:24:31.096 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2023-07-06T15:24:31.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-06T15:24:31.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:24:31.162 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-07-06T15:24:31.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-06T15:24:31.232 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-07-06T15:24:31.290 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-07-06T15:24:31.290 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-07-06T15:24:31.349 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream" 2023-07-06T15:24:31.349 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8" 2023-07-06T15:24:31.349 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos" 2023-07-06T15:24:31.349 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora" 2023-07-06T15:24:31.349 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8" 2023-07-06T15:24:31.349 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-07-06T15:24:31.350 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T15:24:31.350 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-07-06T15:24:31.350 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T15:24:31.350 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/" 2023-07-06T15:24:31.350 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T15:24:31.350 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T15:24:31.350 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T15:24:31.351 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-07-06T15:24:31.378 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-07-06T15:24:31.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-06T15:24:31.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:24:31.446 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-07-06T15:24:31.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-06T15:24:31.475 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-07-06T15:24:31.535 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-07-06T15:24:31.536 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-06T15:24:31.596 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2023-07-06T15:24:31.596 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8" 2023-07-06T15:24:31.596 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2023-07-06T15:24:31.596 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2023-07-06T15:24:31.596 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8" 2023-07-06T15:24:31.596 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-07-06T15:24:31.597 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T15:24:31.597 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-07-06T15:24:31.597 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T15:24:31.597 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2023-07-06T15:24:31.597 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T15:24:31.597 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T15:24:31.597 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T15:24:31.598 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-06T15:24:31.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:24:31.620 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:24:31.708 INFO:teuthology.dispatcher.supervisor:Running job 7328096 2023-07-06T15:24:31.708 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_akupczyk@teuthology --archive /home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328096 --name akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328096/orig.config.yaml 2023-07-06T15:24:31.712 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328096 2023-07-06T15:24:31.713 INFO:teuthology.dispatcher.supervisor:Job PID: 28572 2023-07-06T15:24:31.713 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-06T15:26:31.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:26:31.755 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:28:31.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:28:31.931 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:30:32.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:30:32.102 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:32:32.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:32:32.293 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:34:32.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:34:32.462 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:36:32.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:36:32.711 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:38:32.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:38:32.849 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:40:33.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:40:33.030 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:42:33.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:42:33.120 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:44:33.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:44:33.225 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:46:33.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:46:33.386 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:48:33.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:48:33.535 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:50:33.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:50:33.697 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:52:33.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:52:33.821 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:54:33.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:54:33.986 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:56:34.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:56:34.163 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:58:34.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:58:34.332 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:00:34.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:00:34.503 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:02:34.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:02:34.678 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:04:34.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:04:34.834 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:06:34.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:06:34.952 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:08:35.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:08:35.098 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:10:35.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:10:35.235 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:12:35.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:12:35.394 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:14:35.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:14:35.560 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:16:35.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:16:35.735 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:18:43.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:18:43.830 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:20:49.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:20:49.005 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:22:49.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:22:49.079 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:24:49.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:24:49.160 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:24:49.228 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-06T16:24:49.330 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-06T16:24:49.331 INFO:teuthology.nuke:Checking targets against current locks 2023-07-06T16:24:49.380 DEBUG:teuthology.nuke:shortname: smithi093 2023-07-06T16:24:49.381 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T16:24:49.395 DEBUG:teuthology.nuke:shortname: smithi149 2023-07-06T16:24:49.395 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T16:24:49.401 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328096', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 15:18:44.855180', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkyjFQS9EFj9t5mHcU0nMgzG9vMvZia4aShLWP1gtppLv9f5GtJT9iJ65XV8DxalQhQA3Dj/IF9B2zxOsHjqaVO1kzSIFBUSJm9RW+FcI5US0KgQdEuOIw5taywuBnE6tI67/an1jxBnU2yF9+Q+AwRLznYav31oj/hLOPYqUqAjopdgiR93EqBKdJhJH88bX1GEt3clRds8TpL637iSZye7aXcbbFZcXGUxgGuhwqyAwdLdD7+O5aDTxotSxRFhR7KZpViGyI8rY7OfkpRt/1DL3yVZItax4xmVO2qTRPyElCLvoqUgL44RSIfkYyWmfbIUA+9T6BAm+RRs2wINegk0bMkb1DEjSWL1mLRRF3LXIyLewbJ3M4jPuSXcizhA4n55ovuJkIdQDBwl6RhUm1fR/WJ7t/nzdG9mvD7rbqvKUuktWwoxbCYvi9MV863gIsoSPmiBqGzzO42KsV1q+zxu+gEGGpvbk7C9UihWyyIVx7ilbrc3u6e6w0BsJZZmM='} 2023-07-06T16:24:49.421 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328096', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 15:18:44.853510', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ5NgaLUvrnhe+Wg8kAd8Hn29xpElLFj040K9imdjCn42yIbSUspD0G4UIKnQLM6p8N3ySaVxqj4tXLmskWhOTI='} 2023-07-06T16:24:49.459 INFO:teuthology.orchestra.console:Power off smithi093 2023-07-06T16:24:49.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T16:24:49.474 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-06T16:24:49.475 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T16:24:49.483 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T16:24:49.493 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T16:24:49.605 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2023-07-06T16:24:49.616 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-06T16:24:49.769 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com 2023-07-06T16:24:49.778 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com