2023-08-08T20:40:33.869 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-08T20:40:33.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T20:40:34.012 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4e4926af70>, signals=[15]) 2023-08-08T20:40:34.014 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging 2023-08-08T20:40:34.015 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T20:40:34.015 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-08-08T20:40:34.036 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-08-08T20:40:34.036 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T20:40:34.037 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-08-08T20:40:34.038 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /host {"name": "smithi096"} 2023-08-08T20:40:34.060 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-08-08T20:40:34.133 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-08T20:40:34.140 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-08T20:40:34.183 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_9.stream (ID 10) 2023-08-08T20:40:34.183 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 10} 2023-08-08T20:40:34.187 DEBUG:teuthology.provision.fog.smithi096:Requesting image smithi_centos_9.stream (ID 10) 2023-08-08T20:40:34.187 DEBUG:teuthology.provision.fog.smithi096:FOG request: PUT /host/201 {"imageID": 10} 2023-08-08T20:40:34.235 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 9.stream 2023-08-08T20:40:34.235 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-08T20:40:34.238 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of centos 9.stream 2023-08-08T20:40:34.239 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-08T20:40:34.312 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T20:40:34.325 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T20:40:34.357 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-08-08T20:40:34.360 DEBUG:teuthology.provision.fog.smithi096:FOG request: POST /host/201/task {"taskTypeID": 1} 2023-08-08T20:40:34.414 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-08T20:40:34.417 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-08T20:40:34.535 INFO:teuthology.orchestra.console.smithi098:Power off 2023-08-08T20:40:34.536 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T20:40:34.554 INFO:teuthology.orchestra.console.smithi096:Power off 2023-08-08T20:40:34.555 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T20:40:34.567 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-08-08T20:40:34.568 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T20:40:34.580 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2023-08-08T20:40:34.581 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T20:40:34.592 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-08T20:40:34.603 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-08-08T20:40:34.694 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-08-08T20:40:34.795 INFO:teuthology.orchestra.console.smithi098:Power on 2023-08-08T20:40:34.796 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T20:40:34.819 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2023-08-08T20:40:34.819 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T20:40:34.843 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-08T20:40:38.608 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T20:40:38.718 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-08-08T20:40:38.845 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T20:40:38.956 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-08-08T20:40:39.057 INFO:teuthology.orchestra.console.smithi098:Power on completed 2023-08-08T20:40:39.158 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-08-08T20:40:39.158 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-08T20:40:42.724 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T20:40:42.834 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-08-08T20:40:42.935 INFO:teuthology.orchestra.console.smithi096:Power off completed 2023-08-08T20:40:43.036 INFO:teuthology.orchestra.console.smithi096:Power on 2023-08-08T20:40:43.037 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T20:40:43.060 DEBUG:teuthology.orchestra.console.smithi096:power on output: Chassis Power Control: Up/On 2023-08-08T20:40:43.060 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T20:40:43.083 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-08-08T20:40:47.088 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T20:40:47.198 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-08-08T20:40:51.201 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T20:40:51.315 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-08-08T20:40:51.416 INFO:teuthology.orchestra.console.smithi096:Power on completed 2023-08-08T20:40:51.517 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish 2023-08-08T20:40:51.518 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-08T20:40:54.240 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-08T20:41:06.596 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-08T20:41:09.308 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-08T20:41:21.672 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-08T20:41:24.376 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-08T20:41:36.749 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-08T20:41:39.432 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-08T20:41:51.836 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-08T20:41:54.492 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-08T20:42:06.921 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-08T20:42:09.567 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-08T20:42:21.992 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-08T20:42:24.640 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-08T20:42:37.068 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-08T20:42:39.704 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-08T20:42:52.148 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-08T20:42:54.780 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-08T20:43:07.216 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-08T20:43:09.850 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-08-08T20:43:09.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:43:12.976 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-08T20:43:18.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:43:22.036 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-08T20:43:22.272 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-08T20:43:22.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:43:25.392 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-08-08T20:43:28.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:43:31.120 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-08T20:43:31.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:43:34.452 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-08-08T20:43:37.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:43:40.176 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-08T20:43:40.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:43:43.508 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-08-08T20:43:46.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:43:49.232 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-08T20:43:49.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:43:52.560 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-08-08T20:43:55.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:43:58.288 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-08T20:43:58.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:44:01.616 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-08-08T20:44:04.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:44:07.344 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-08-08T20:44:07.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:44:10.672 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-08-08T20:44:13.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:44:16.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:44:44.994 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T20:44:44.995 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T20:45:05.435 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-08-08T20:45:05.436 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-08-08T20:45:05.455 INFO:teuthology.orchestra.run.smithi098.stdout:smithi197 2023-08-08T20:45:05.456 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi197 /etc/hosts 2023-08-08T20:45:05.512 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197 2023-08-08T20:45:05.513 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-08-08T20:45:05.625 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi197/smithi098/g' /etc/hosts 2023-08-08T20:45:05.656 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.197/172.21.15.98/g' /etc/hosts 2023-08-08T20:45:05.726 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi197/smithi098/g' /etc/hostname 2023-08-08T20:45:05.793 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-08-08T20:45:05.861 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-08-08T20:45:05.916 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-08-08T20:45:05.916 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2023-08-08T20:45:05.916 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-08-08T20:45:05.916 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-08-08T20:45:05.917 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2023-08-08T20:45:05.917 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2023-08-08T20:45:05.917 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-08T20:45:05.917 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-08-08T20:45:05.917 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2023-08-08T20:45:05.917 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-08T20:45:05.917 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-08-08T20:45:05.918 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T20:45:05.918 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-08T20:45:05.918 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T20:45:05.919 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-08-08T20:45:05.920 DEBUG:teuthology.parallel:result is None 2023-08-08T20:45:16.688 WARNING:teuthology.provision.fog.smithi096:timed out 2023-08-08T20:45:22.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:45:22.895 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T20:45:22.896 DEBUG:teuthology.orchestra.run.smithi096:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T20:45:23.198 INFO:teuthology.provision.fog.smithi096:Node is ready 2023-08-08T20:45:23.198 DEBUG:teuthology.orchestra.run.smithi096:> hostname 2023-08-08T20:45:23.212 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com 2023-08-08T20:45:23.213 DEBUG:teuthology.orchestra.run.smithi096:> grep smithi096.front.sepia.ceph.com /etc/hosts 2023-08-08T20:45:23.267 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096 2023-08-08T20:45:23.267 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2023-08-08T20:45:23.380 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hosts 2023-08-08T20:45:23.410 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/172.21.15.96/172.21.15.96/g' /etc/hosts 2023-08-08T20:45:23.477 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hostname 2023-08-08T20:45:23.543 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2023-08-08T20:45:23.610 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-08-08T20:45:23.664 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2023-08-08T20:45:23.665 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="9" 2023-08-08T20:45:23.665 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2023-08-08T20:45:23.665 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2023-08-08T20:45:23.665 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="9" 2023-08-08T20:45:23.665 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el9" 2023-08-08T20:45:23.666 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-08T20:45:23.666 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-08-08T20:45:23.666 INFO:teuthology.orchestra.run.smithi096.stdout:LOGO="fedora-logo-icon" 2023-08-08T20:45:23.666 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-08T20:45:23.666 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2023-08-08T20:45:23.666 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T20:45:23.666 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-08T20:45:23.667 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T20:45:23.667 INFO:teuthology.provision.fog.smithi096:Deploy complete! 2023-08-08T20:45:23.667 DEBUG:teuthology.parallel:result is None 2023-08-08T20:45:23.809 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com 2023-08-08T20:45:23.810 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T20:45:23.837 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-08-08T20:45:23.838 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T20:45:23.855 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server 2023-08-08T20:45:23.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-08-08T20:45:23.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:45:23.938 DEBUG:teuthology.orchestra.run.smithi096:> true 2023-08-08T20:45:24.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-08-08T20:45:24.002 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2023-08-08T20:45:24.056 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2023-08-08T20:45:24.057 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-08-08T20:45:24.110 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2023-08-08T20:45:24.110 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="9" 2023-08-08T20:45:24.110 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2023-08-08T20:45:24.111 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2023-08-08T20:45:24.111 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="9" 2023-08-08T20:45:24.111 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el9" 2023-08-08T20:45:24.111 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-08T20:45:24.111 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-08-08T20:45:24.111 INFO:teuthology.orchestra.run.smithi096.stdout:LOGO="fedora-logo-icon" 2023-08-08T20:45:24.111 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-08T20:45:24.112 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2023-08-08T20:45:24.112 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T20:45:24.112 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-08T20:45:24.112 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T20:45:24.113 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-08-08T20:45:24.137 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-08-08T20:45:24.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-08-08T20:45:24.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T20:45:24.220 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-08-08T20:45:24.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-08-08T20:45:24.406 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-08-08T20:45:24.461 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-08-08T20:45:24.461 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-08-08T20:45:24.516 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-08-08T20:45:24.517 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2023-08-08T20:45:24.517 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-08-08T20:45:24.517 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-08-08T20:45:24.518 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2023-08-08T20:45:24.518 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2023-08-08T20:45:24.518 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-08T20:45:24.518 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-08-08T20:45:24.519 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2023-08-08T20:45:24.519 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-08T20:45:24.519 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-08-08T20:45:24.519 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T20:45:24.519 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-08T20:45:24.519 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T20:45:24.520 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-08-08T20:45:24.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T20:45:24.625 INFO:teuthology.dispatcher.supervisor:Running job 7363327 2023-08-08T20:45:24.625 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_prsrivas@teuthology --archive /home/teuthworker/archive/prsrivas-2023-08-08_16:45:21-rgw-wip-rgw-61916-test-failures-distro-default-smithi/7363327 --name prsrivas-2023-08-08_16:45:21-rgw-wip-rgw-61916-test-failures-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/prsrivas-2023-08-08_16:45:21-rgw-wip-rgw-61916-test-failures-distro-default-smithi/7363327/orig.config.yaml 2023-08-08T20:45:24.629 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/prsrivas-2023-08-08_16:45:21-rgw-wip-rgw-61916-test-failures-distro-default-smithi/7363327 2023-08-08T20:45:24.630 INFO:teuthology.dispatcher.supervisor:Job PID: 24310 2023-08-08T20:45:24.630 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-08T20:47:24.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T20:49:24.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T20:51:25.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T20:53:25.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T20:55:25.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T20:57:25.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T20:59:25.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:01:25.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:03:26.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:05:26.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:07:26.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:09:26.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:11:26.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:13:26.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:15:27.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:17:27.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:19:27.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:21:27.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:23:27.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:25:27.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:27:28.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:29:28.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:31:28.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:33:28.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:35:28.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:37:28.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:39:29.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:39:29.114 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-08T21:39:29.263 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-08T21:39:29.263 INFO:teuthology.nuke:Checking targets against current locks 2023-08-08T21:39:29.309 DEBUG:teuthology.nuke:shortname: smithi096 2023-08-08T21:39:29.310 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T21:39:29.335 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-08-08_16:45:21-rgw-wip-rgw-61916-test-failures-distro-default-smithi/7363327', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 20:40:33.029920', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAbUxkQgVZ7A6KHOBN44GZAblf1wuDJ+4fOa2O45zZ1JH+6Btg4QcT8pkiKcqtEP43l68RrZM3T7UTFPz8hdjH0='} 2023-08-08T21:39:29.338 DEBUG:teuthology.nuke:shortname: smithi098 2023-08-08T21:39:29.338 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T21:39:29.362 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-08-08_16:45:21-rgw-wip-rgw-61916-test-failures-distro-default-smithi/7363327', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 20:40:33.031515', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGnI5W94TLANc2SVHItwtU5ylYoNfgdZgmCqa0d7vD4zc2x431jCl9/200QvqcG824iV1bi8fDhNm+uOvSbgw7k='} 2023-08-08T21:39:29.389 INFO:teuthology.orchestra.console.smithi096:Power off 2023-08-08T21:39:29.389 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T21:39:29.410 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2023-08-08T21:39:29.411 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:39:29.429 INFO:teuthology.orchestra.console.smithi098:Power off 2023-08-08T21:39:29.430 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T21:39:29.440 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-08-08T21:39:29.451 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-08-08T21:39:29.451 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:39:29.474 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-08-08T21:39:29.541 INFO:teuthology.orchestra.console.smithi096:Power off completed 2023-08-08T21:39:29.575 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-08-08T21:39:29.688 INFO:teuthology.lock.ops:unlocked: smithi096.front.sepia.ceph.com 2023-08-08T21:39:29.723 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com