2023-07-13T23:03:10.970 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-13T23:03:10.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:03:10.972 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:03:11.136 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7094f58ee0>, signals=[15]) 2023-07-13T23:03:11.138 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2023-07-13T23:03:11.138 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T23:03:11.139 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-07-13T23:03:11.160 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging 2023-07-13T23:03:11.160 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T23:03:11.160 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-07-13T23:03:11.162 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /host {"name": "smithi008"} 2023-07-13T23:03:11.185 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /host {"name": "smithi177"} 2023-07-13T23:03:11.225 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-13T23:03:11.255 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-13T23:03:11.264 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_centos_8.stream (ID 3) 2023-07-13T23:03:11.264 DEBUG:teuthology.provision.fog.smithi008:FOG request: PUT /host/114 {"imageID": 3} 2023-07-13T23:03:11.290 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_centos_8.stream (ID 3) 2023-07-13T23:03:11.291 DEBUG:teuthology.provision.fog.smithi177:FOG request: PUT /host/282 {"imageID": 3} 2023-07-13T23:03:11.301 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 8.stream 2023-07-13T23:03:11.301 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-13T23:03:11.334 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of centos 8.stream 2023-07-13T23:03:11.334 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-13T23:03:11.395 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T23:03:11.415 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T23:03:11.431 DEBUG:teuthology.provision.fog.smithi008:FOG request: POST /host/114/task {"taskTypeID": 1} 2023-07-13T23:03:11.447 DEBUG:teuthology.provision.fog.smithi177:FOG request: POST /host/282/task {"taskTypeID": 1} 2023-07-13T23:03:11.483 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-13T23:03:11.498 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-13T23:03:11.613 INFO:teuthology.orchestra.console:Power off smithi008 2023-07-13T23:03:11.614 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:03:11.631 INFO:teuthology.orchestra.console:Power off smithi177 2023-07-13T23:03:11.631 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:03:11.643 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:03:11.655 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:03:15.672 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:03:15.681 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:03:19.788 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:03:19.796 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:03:19.999 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2023-07-13T23:03:20.007 INFO:teuthology.orchestra.console:Power off for smithi177 completed 2023-07-13T23:03:20.101 INFO:teuthology.orchestra.console:Power on smithi008 2023-07-13T23:03:20.102 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T23:03:20.111 INFO:teuthology.orchestra.console:Power on smithi177 2023-07-13T23:03:20.111 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T23:03:20.123 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:03:20.133 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:03:24.148 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:03:24.159 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:03:28.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:03:28.273 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:03:28.476 INFO:teuthology.orchestra.console:Power on for smithi008 completed 2023-07-13T23:03:28.483 INFO:teuthology.orchestra.console:Power on for smithi177 completed 2023-07-13T23:03:28.578 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2023-07-13T23:03:28.578 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-13T23:03:28.585 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish 2023-07-13T23:03:28.585 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-13T23:03:43.692 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-13T23:03:43.693 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-13T23:03:58.804 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-13T23:03:58.806 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-13T23:04:13.908 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-13T23:04:13.909 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-13T23:04:29.029 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-13T23:04:29.031 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-13T23:04:44.140 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-13T23:04:44.142 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-13T23:04:59.276 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-13T23:04:59.278 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-13T23:05:14.400 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-13T23:05:14.402 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-13T23:05:29.512 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-13T23:05:29.514 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-13T23:05:44.628 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-13T23:05:44.629 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-13T23:05:59.728 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-13T23:05:59.729 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-13T23:06:14.824 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-13T23:06:14.825 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-13T23:06:29.932 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None 2023-07-13T23:06:29.933 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-13T23:06:30.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:06:30.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:06:33.104 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-07-13T23:06:33.105 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-13T23:06:39.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:06:39.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:06:42.164 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-07-13T23:06:42.165 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-13T23:06:48.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:06:48.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:06:51.249 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-07-13T23:06:51.249 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-13T23:06:57.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:06:57.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:07:00.304 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-07-13T23:07:00.308 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-13T23:07:06.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:07:06.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:07:09.360 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-07-13T23:07:09.361 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-13T23:07:15.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:07:15.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:07:18.416 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-07-13T23:07:18.417 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-13T23:07:24.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:07:24.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:07:27.476 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-07-13T23:07:27.477 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-13T23:07:33.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:07:33.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:07:43.860 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-07-13T23:07:49.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:07:52.944 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-07-13T23:07:58.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:08:02.000 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-07-13T23:08:08.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:08:08.251 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T23:08:08.252 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T23:08:28.425 INFO:teuthology.provision.fog.smithi177:Node is ready 2023-07-13T23:08:28.426 DEBUG:teuthology.orchestra.run.smithi177:> hostname 2023-07-13T23:08:28.451 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com 2023-07-13T23:08:28.451 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts 2023-07-13T23:08:28.512 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177 2023-07-13T23:08:28.512 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2023-07-13T23:08:28.629 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts 2023-07-13T23:08:28.660 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts 2023-07-13T23:08:28.729 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname 2023-07-13T23:08:28.799 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2023-07-13T23:08:28.868 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-07-13T23:08:28.928 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2023-07-13T23:08:28.928 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8" 2023-07-13T23:08:28.929 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2023-07-13T23:08:28.929 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2023-07-13T23:08:28.930 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8" 2023-07-13T23:08:28.930 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:08:28.930 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T23:08:28.930 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-07-13T23:08:28.930 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T23:08:28.930 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2023-07-13T23:08:28.931 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:08:28.931 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:08:28.931 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T23:08:28.932 INFO:teuthology.provision.fog.smithi177:Deploy complete! 2023-07-13T23:08:28.933 DEBUG:teuthology.parallel:result is None 2023-07-13T23:08:33.483 WARNING:teuthology.provision.fog.smithi008:timed out 2023-07-13T23:08:39.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:08:39.721 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T23:08:39.721 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T23:08:39.980 INFO:teuthology.provision.fog.smithi008:Node is ready 2023-07-13T23:08:39.981 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2023-07-13T23:08:40.002 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2023-07-13T23:08:40.002 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2023-07-13T23:08:40.063 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2023-07-13T23:08:40.064 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-07-13T23:08:40.213 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2023-07-13T23:08:40.248 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2023-07-13T23:08:40.320 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2023-07-13T23:08:40.392 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-07-13T23:08:40.463 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-07-13T23:08:40.522 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-07-13T23:08:40.523 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8" 2023-07-13T23:08:40.523 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-07-13T23:08:40.523 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-07-13T23:08:40.523 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8" 2023-07-13T23:08:40.523 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:08:40.524 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T23:08:40.524 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-07-13T23:08:40.524 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T23:08:40.524 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-07-13T23:08:40.524 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:08:40.524 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:08:40.524 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T23:08:40.525 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2023-07-13T23:08:40.525 DEBUG:teuthology.parallel:result is None 2023-07-13T23:08:40.716 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2023-07-13T23:08:40.717 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T23:08:40.742 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com 2023-07-13T23:08:40.742 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T23:08:40.768 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2023-07-13T23:08:40.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-07-13T23:08:40.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:08:40.835 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-07-13T23:08:40.909 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-07-13T23:08:40.909 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-07-13T23:08:40.969 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-07-13T23:08:40.970 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-07-13T23:08:41.031 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-07-13T23:08:41.031 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8" 2023-07-13T23:08:41.031 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-07-13T23:08:41.031 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-07-13T23:08:41.032 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8" 2023-07-13T23:08:41.032 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:08:41.032 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T23:08:41.032 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-07-13T23:08:41.032 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T23:08:41.032 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-07-13T23:08:41.032 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:08:41.032 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:08:41.033 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T23:08:41.033 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-07-13T23:08:41.118 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server 2023-07-13T23:08:41.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-07-13T23:08:41.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:08:41.188 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-07-13T23:08:41.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-07-13T23:08:41.219 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2023-07-13T23:08:41.278 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2023-07-13T23:08:41.278 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-07-13T23:08:41.337 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2023-07-13T23:08:41.337 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8" 2023-07-13T23:08:41.337 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2023-07-13T23:08:41.338 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2023-07-13T23:08:41.338 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8" 2023-07-13T23:08:41.338 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:08:41.338 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T23:08:41.338 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-07-13T23:08:41.338 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T23:08:41.338 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2023-07-13T23:08:41.339 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:08:41.339 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:08:41.339 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T23:08:41.339 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-07-13T23:08:41.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:08:41.367 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:08:41.467 INFO:teuthology.dispatcher.supervisor:Running job 7336368 2023-07-13T23:08:41.467 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336368 --name rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336368/orig.config.yaml 2023-07-13T23:08:41.471 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336368 2023-07-13T23:08:41.472 INFO:teuthology.dispatcher.supervisor:Job PID: 20957 2023-07-13T23:08:41.472 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-13T23:10:41.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:10:41.475 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:12:41.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:12:41.551 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:14:41.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:14:41.628 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:16:41.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:16:41.713 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:18:41.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:18:41.801 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:20:41.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:20:41.889 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:22:41.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:22:41.958 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:24:42.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:24:42.037 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:26:42.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:26:42.115 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:28:42.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:28:42.206 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:30:42.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:30:42.300 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:32:42.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:32:42.380 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:34:52.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:34:52.545 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:35:02.617 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-13T23:35:05.301 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-13T23:35:05.302 INFO:teuthology.nuke:Checking targets against current locks 2023-07-13T23:35:05.347 DEBUG:teuthology.nuke:shortname: smithi008 2023-07-13T23:35:05.347 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T23:35:05.371 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336368', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 23:03:10.136772', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAARTyVarOdh26c1Rth5n7tHpRArm2nnxOFPSll5llVh7Dw2vikywZul7XtVejy4OiUf9uzvIF0CaSo0EwZ8lmiZCW8w8nJWZBZ1ewB2N7rm0RAZBnnwN/Lhj8KUmKfYp9fVMWVGBcTBuSsAyg5uEbGH5p4FaV94Ho7jw2H2yCOr1qT3KI1tJXf0Qg6OGwW6kCPO+eul3AlZGRaolYkqyPRD04MRQI/dvbrPIdy5OmUi8qrqzVVhBQTalpSz6/io1MVBgilNhTjwvvM502NDp/B2Cb0Ys1Iz4WcjtpN+3K/Ku5R84wpxonDxWc7dmdko9zwN+PSTBbMvNPZRkB6Y7z6nrr3PmG9P+kRgCOSHAiVV0Flz52lD2jpG81/aadpExuB4eZHmR0dK+3it6vPoQCQ2BHRyl5TLxOr8FnjaCncg3m8bhPi461DHH4x5KonAkNe0vetOIM8xNmkM9+32IijU3ztMcs1mfD6Bo4zwo2rZLFsQOqH1btiAE8A0kbfBE='} 2023-07-13T23:35:05.374 DEBUG:teuthology.nuke:shortname: smithi177 2023-07-13T23:35:05.374 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T23:35:05.408 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336368', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 23:03:10.134856', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCUvUYXl5FiaRzvYwxoQdtNX+XqcePEz0CuYq07U290Raekp2h42MFV8MrsxNeBWGJ1rapFdTQGvpgbot2j0syiGbEGQ9GgxsUC4CKmNTWD4/y0DRecQ/kBbh5dkBQShAqGRfp/RZBJTpKN44AakMPkbtF4Wvqhx2ZpnaLxXYds0CGEjSTDTQp2eolitGETn+jhVKRBQ83q1JW6A7hcfflp2WjmUhot+vH5PRJDf9q3+KzY1nvEyagG6Ef/IiNBHt0OFu/a8Qi1XU24GRUSOsL+wlHJacRilrNKHrP64Ba4znkhMZe1idWmwS+1M46MFS17OHkcWHwszNCVXzo7OutCKBI2BBMfIv+XmhdFOlmMQw0ofHYPaX2rpX3ZwE2g5kjvbTwPGABWWHOmX/5oeL0K3z0CMaA63+oGhvnBwiT1UcCRmfaJVkS2EGYtU96nWs2j8Lri1QlWn1e/wdM7RJ2ISbxVTepBwLA+FiGy4ihas6B7BqOM+xCW7oT2xxqyyYE='} 2023-07-13T23:35:05.441 INFO:teuthology.orchestra.console:Power off smithi008 2023-07-13T23:35:05.442 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:35:05.460 INFO:teuthology.orchestra.console:Power off smithi177 2023-07-13T23:35:05.461 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:35:05.473 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:35:05.487 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:35:05.601 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2023-07-13T23:35:15.741 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:35:15.784 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com 2023-07-13T23:35:20.852 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:35:21.064 INFO:teuthology.orchestra.console:Power off for smithi177 completed 2023-07-13T23:35:31.303 INFO:teuthology.lock.ops:unlocked: smithi177.front.sepia.ceph.com