2023-08-08T14:13:52.055 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-08T14:13:52.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:13:52.191 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1d1ee15f70>, signals=[15]) 2023-08-08T14:13:52.193 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging 2023-08-08T14:13:52.193 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T14:13:52.193 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-08-08T14:13:52.214 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging 2023-08-08T14:13:52.215 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T14:13:52.216 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-08-08T14:13:52.217 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /host {"name": "smithi023"} 2023-08-08T14:13:52.239 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /host {"name": "smithi089"} 2023-08-08T14:13:52.304 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-08T14:13:52.327 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-08T14:13:52.335 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_centos_8.stream (ID 3) 2023-08-08T14:13:52.336 DEBUG:teuthology.provision.fog.smithi023:FOG request: PUT /host/129 {"imageID": 3} 2023-08-08T14:13:52.372 DEBUG:teuthology.provision.fog.smithi089:Requesting image smithi_centos_8.stream (ID 3) 2023-08-08T14:13:52.372 DEBUG:teuthology.provision.fog.smithi089:FOG request: PUT /host/194 {"imageID": 3} 2023-08-08T14:13:52.377 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 8.stream 2023-08-08T14:13:52.377 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:13:52.416 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of centos 8.stream 2023-08-08T14:13:52.416 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-08T14:13:52.442 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T14:13:52.461 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T14:13:52.483 DEBUG:teuthology.provision.fog.smithi023:FOG request: POST /host/129/task {"taskTypeID": 1} 2023-08-08T14:13:52.497 DEBUG:teuthology.provision.fog.smithi089:FOG request: POST /host/194/task {"taskTypeID": 1} 2023-08-08T14:13:52.537 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:13:52.545 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-08T14:13:52.636 INFO:teuthology.orchestra.console.smithi023:Power off 2023-08-08T14:13:52.637 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T14:13:52.652 INFO:teuthology.orchestra.console.smithi089:Power off 2023-08-08T14:13:52.653 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T14:13:52.662 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2023-08-08T14:13:52.663 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T14:13:52.675 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-08-08T14:13:52.675 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T14:13:52.683 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-08-08T14:13:52.694 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-08-08T14:13:52.785 INFO:teuthology.orchestra.console.smithi023:Power off completed 2023-08-08T14:13:52.796 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-08-08T14:13:52.887 INFO:teuthology.orchestra.console.smithi023:Power on 2023-08-08T14:13:52.887 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T14:13:52.897 INFO:teuthology.orchestra.console.smithi089:Power on 2023-08-08T14:13:52.897 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T14:13:52.911 DEBUG:teuthology.orchestra.console.smithi023:power on output: Chassis Power Control: Up/On 2023-08-08T14:13:52.912 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T14:13:52.922 DEBUG:teuthology.orchestra.console.smithi089:power on output: Chassis Power Control: Up/On 2023-08-08T14:13:52.922 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T14:13:52.934 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-08-08T14:13:52.944 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-08-08T14:13:56.936 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T14:13:56.945 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T14:13:57.048 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-08-08T14:13:57.056 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-08-08T14:13:57.157 INFO:teuthology.orchestra.console.smithi089:Power on completed 2023-08-08T14:13:57.258 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2023-08-08T14:13:57.259 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-08T14:14:01.052 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T14:14:01.162 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-08-08T14:14:01.263 INFO:teuthology.orchestra.console.smithi023:Power on completed 2023-08-08T14:14:01.363 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2023-08-08T14:14:01.364 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:14:12.340 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-08T14:14:16.440 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:14:27.428 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-08T14:14:31.520 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:14:42.516 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-08T14:14:46.592 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:14:57.596 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-08T14:15:01.660 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:15:12.675 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-08T14:15:16.724 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:15:27.741 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-08T14:15:31.800 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:15:42.816 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-08T14:15:46.864 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:15:57.892 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-08T14:16:01.944 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:16:12.980 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-08T14:16:17.016 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:16:28.064 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-08T14:16:32.092 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:16:43.145 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-08T14:16:43.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:16:47.164 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:17:01.552 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-08T14:17:02.223 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:17:07.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:17:10.608 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-08T14:17:16.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:17:17.284 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-08-08T14:17:17.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:17:19.668 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-08T14:17:25.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:17:28.752 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-08T14:17:34.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:17:35.856 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-08-08T14:17:37.808 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-08T14:17:41.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:17:43.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:17:44.912 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-08-08T14:17:50.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:17:53.978 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-08-08T14:17:59.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:18:03.056 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-08-08T14:18:09.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:18:12.112 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-08-08T14:18:18.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:18:21.172 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-08-08T14:18:27.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:18:30.256 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-08-08T14:18:36.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:18:39.312 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-08-08T14:18:43.816 WARNING:teuthology.provision.fog.smithi089:timed out 2023-08-08T14:18:45.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:18:49.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:18:50.037 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T14:18:50.038 DEBUG:teuthology.orchestra.run.smithi089:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T14:18:50.279 INFO:teuthology.provision.fog.smithi089:Node is ready 2023-08-08T14:18:50.279 DEBUG:teuthology.orchestra.run.smithi089:> hostname 2023-08-08T14:18:50.339 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com 2023-08-08T14:18:50.339 DEBUG:teuthology.orchestra.run.smithi089:> grep smithi089.front.sepia.ceph.com /etc/hosts 2023-08-08T14:18:50.398 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089 2023-08-08T14:18:50.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-08-08T14:18:50.500 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hosts 2023-08-08T14:18:50.531 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/172.21.15.89/172.21.15.89/g' /etc/hosts 2023-08-08T14:18:50.599 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hostname 2023-08-08T14:18:50.667 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-08-08T14:18:50.734 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-08-08T14:18:50.792 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-08-08T14:18:50.792 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8" 2023-08-08T14:18:50.792 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-08-08T14:18:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-08-08T14:18:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8" 2023-08-08T14:18:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-08-08T14:18:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T14:18:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-08-08T14:18:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T14:18:50.793 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-08-08T14:18:50.794 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T14:18:50.794 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T14:18:50.794 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T14:18:50.794 INFO:teuthology.provision.fog.smithi089:Deploy complete! 2023-08-08T14:18:50.796 DEBUG:teuthology.parallel:result is None 2023-08-08T14:19:45.368 WARNING:teuthology.provision.fog.smithi023:timed out 2023-08-08T14:19:51.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:19:51.788 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T14:19:51.789 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T14:19:52.041 INFO:teuthology.provision.fog.smithi023:Node is ready 2023-08-08T14:19:52.041 DEBUG:teuthology.orchestra.run.smithi023:> hostname 2023-08-08T14:19:52.060 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com 2023-08-08T14:19:52.061 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts 2023-08-08T14:19:52.125 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023 2023-08-08T14:19:52.125 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-08-08T14:19:52.244 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts 2023-08-08T14:19:52.273 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts 2023-08-08T14:19:52.345 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname 2023-08-08T14:19:52.417 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-08-08T14:19:52.488 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-08-08T14:19:52.550 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2023-08-08T14:19:52.550 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8" 2023-08-08T14:19:52.550 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2023-08-08T14:19:52.550 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2023-08-08T14:19:52.551 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8" 2023-08-08T14:19:52.551 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8" 2023-08-08T14:19:52.551 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T14:19:52.551 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2023-08-08T14:19:52.551 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T14:19:52.551 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2023-08-08T14:19:52.552 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T14:19:52.552 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T14:19:52.552 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T14:19:52.552 INFO:teuthology.provision.fog.smithi023:Deploy complete! 2023-08-08T14:19:52.553 DEBUG:teuthology.parallel:result is None 2023-08-08T14:19:52.698 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com 2023-08-08T14:19:52.698 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T14:19:52.724 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com 2023-08-08T14:19:52.724 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T14:19:52.742 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server 2023-08-08T14:19:52.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-08-08T14:19:52.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:19:52.815 DEBUG:teuthology.orchestra.run.smithi023:> true 2023-08-08T14:19:52.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-08-08T14:19:52.887 DEBUG:teuthology.orchestra.run.smithi023:> uname -m 2023-08-08T14:19:52.947 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2023-08-08T14:19:52.948 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-08-08T14:19:53.009 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2023-08-08T14:19:53.010 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8" 2023-08-08T14:19:53.010 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2023-08-08T14:19:53.010 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2023-08-08T14:19:53.010 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8" 2023-08-08T14:19:53.010 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8" 2023-08-08T14:19:53.011 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T14:19:53.011 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2023-08-08T14:19:53.012 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T14:19:53.012 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2023-08-08T14:19:53.012 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T14:19:53.012 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T14:19:53.012 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T14:19:53.013 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-08-08T14:19:53.032 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server 2023-08-08T14:19:53.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-08-08T14:19:53.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T14:19:53.101 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-08-08T14:19:53.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-08-08T14:19:53.239 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-08-08T14:19:53.298 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-08-08T14:19:53.299 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-08-08T14:19:53.356 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-08-08T14:19:53.357 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8" 2023-08-08T14:19:53.357 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-08-08T14:19:53.357 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-08-08T14:19:53.357 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8" 2023-08-08T14:19:53.357 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-08-08T14:19:53.357 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-08T14:19:53.357 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-08-08T14:19:53.358 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-08T14:19:53.358 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-08-08T14:19:53.358 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T14:19:53.358 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-08T14:19:53.358 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T14:19:53.359 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-08-08T14:19:53.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:19:53.472 INFO:teuthology.dispatcher.supervisor:Running job 7362708 2023-08-08T14:19:53.473 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362708 --name vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/lockdep} -- /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362708/orig.config.yaml 2023-08-08T14:19:53.476 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362708 2023-08-08T14:19:53.477 INFO:teuthology.dispatcher.supervisor:Job PID: 27419 2023-08-08T14:19:53.477 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-08T14:21:53.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:23:53.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:25:53.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:27:54.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:29:54.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:31:54.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:33:54.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:35:54.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:37:54.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:39:55.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:41:55.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:43:55.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:45:55.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:47:55.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:49:55.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:51:56.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:53:56.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:55:56.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:57:56.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T14:59:56.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T15:01:56.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T15:03:57.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T15:05:57.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T15:07:57.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T15:09:57.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T15:11:57.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T15:13:57.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T15:15:58.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T15:17:58.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T15:19:58.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T15:21:58.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T15:23:58.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T15:23:58.929 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-08T15:23:59.108 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-08T15:23:59.109 INFO:teuthology.nuke:Checking targets against current locks 2023-08-08T15:23:59.153 DEBUG:teuthology.nuke:shortname: smithi023 2023-08-08T15:23:59.157 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T15:23:59.165 DEBUG:teuthology.nuke:shortname: smithi089 2023-08-08T15:23:59.166 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T15:23:59.179 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi023.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362708', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 14:13:51.252517', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+Zozoe74FlodFZyyIHIhrpsa6mdCXNY+bnXPRbduX/bzHoGsdS3w9ScRdbtygA33LWzuhqEkriZgOJQ3PqvxjbVBvwQ0YdhpUqL+Z43sluxTDeFM8tinps6PdfZPPC5THgLvBjWZd43l6xUaP2r0M4CtoAa+SHRwncSnOJkOhudCW6lERlz2rSWMRNITaVYcNjpvgzuE5Zzm/wlRErLZBHJraDU7l8OJ5dHSsi6P0iXxzKaGyBI7bW6WqwyPb+E+NpSNqIbcjkrcvYnB8hAnt1pbd8G/KuTxCEbZXkDoMocvxuWBEG7gdRwNTfzUU0B9NcWbh/z8img36wiyXtXy18xTjC9qOsONupNeTYcVZlPZZ3wJBo1aivMAG8xmV31Ff1PSEKuVjmGai5oFDNPxVm6vjY4ubtK/3G3kt0TPhlb7bcYiXPgDfFlwgG5yNDV9B2V7Ldbezu3Z6bDBAKiR5XBwcFxZhJhfNY1OfzFQaZwgcBiUd4hZY0wycdy2soHs='} 2023-08-08T15:23:59.183 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-08_11:25:00-fs-wip-vshankar-testing-20230808.093601-testing-default-smithi/7362708', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 14:13:51.250997', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC61L8fzFodxkdK/+mCXcyjMzMvo5Zn2Ojnv37GIkTr/TYYwgcpq449zH9uvIBD6e7Owhg5fcTaBtXVQcz9n2RDGY2lHu2g/+9/V3A+4e7MHXp4YgNyXuEPtD1yqZxqSOT0xfoOSb9UReHQ0Z1XBdNU6WxDgDgA/Ftz/FR1cdc/PuwnGg8kth7lYETaqAZK1h08+YmUK+vZcp4nJs9SlJnHgO9CCGjz79YDIiPaXF+5TZpyKReLlbnFou1g82cNJDb29PIdDNayWLIJ94kruyvXwDkxhPNPdnuTNcds5ue7pWg9VAfAVkFRuE/86QjaNFx0GCmu5dpwiCYcrtJZmnJKc/jUxFclhQ0UERSWJQ9FoBd3/tEE5XqbkySRCxWRd0UxzQOuJf4lfacQd+sne5SkA0HvA/Wy4qJCuBbWJTEFuLr6Upmj5DbSo/K+Xy9bTAM5MdMVmz4yrJweyD6+ZV4t5zGCLYq2TB7NZBs1tbd9hjGZE4lL7SPbHsaqRpv5gOc='} 2023-08-08T15:23:59.221 INFO:teuthology.orchestra.console.smithi023:Power off 2023-08-08T15:23:59.222 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T15:23:59.237 INFO:teuthology.orchestra.console.smithi089:Power off 2023-08-08T15:23:59.238 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T15:23:59.250 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2023-08-08T15:23:59.250 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T15:23:59.261 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-08-08T15:23:59.262 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T15:23:59.273 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-08-08T15:23:59.285 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-08-08T15:23:59.374 INFO:teuthology.orchestra.console.smithi023:Power off completed 2023-08-08T15:23:59.386 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-08-08T15:23:59.527 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com 2023-08-08T15:23:59.535 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com