2023-11-03T15:05:41.647 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-03T15:05:41.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:05:41.795 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa90186bc10>, signals=[15]) 2023-11-03T15:05:41.797 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2023-11-03T15:05:41.797 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2023-11-03T15:05:41.798 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-11-03T15:05:41.815 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2023-11-03T15:05:41.816 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2023-11-03T15:05:41.816 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-11-03T15:05:41.817 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /host {"name": "smithi103"} 2023-11-03T15:05:41.841 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"} 2023-11-03T15:05:41.890 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-03T15:05:41.911 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-03T15:05:41.928 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_centos_9.stream (ID 10) 2023-11-03T15:05:41.928 DEBUG:teuthology.provision.fog.smithi103:FOG request: PUT /host/208 {"imageID": 10} 2023-11-03T15:05:41.953 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_9.stream (ID 10) 2023-11-03T15:05:41.954 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 10} 2023-11-03T15:05:41.981 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 9.stream 2023-11-03T15:05:41.982 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-03T15:05:41.999 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 9.stream 2023-11-03T15:05:41.999 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-03T15:05:42.040 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /tasktype {"name": "deploy"} 2023-11-03T15:05:42.050 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"} 2023-11-03T15:05:42.075 DEBUG:teuthology.provision.fog.smithi103:FOG request: POST /host/208/task {"taskTypeID": 1} 2023-11-03T15:05:42.105 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1} 2023-11-03T15:05:42.214 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-03T15:05:42.230 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-03T15:05:42.314 INFO:teuthology.orchestra.console.smithi103:Power off 2023-11-03T15:05:42.315 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T15:05:42.329 INFO:teuthology.orchestra.console.smithi112:Power off 2023-11-03T15:05:42.330 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T15:05:42.339 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-11-03T15:05:42.339 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T15:05:42.351 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-11-03T15:05:42.352 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T15:05:42.361 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-11-03T15:05:42.376 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-11-03T15:05:42.477 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-11-03T15:05:42.578 INFO:teuthology.orchestra.console.smithi112:Power on 2023-11-03T15:05:42.578 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-03T15:05:42.599 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2023-11-03T15:05:42.599 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T15:05:42.620 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-11-03T15:05:46.366 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T15:05:46.475 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-11-03T15:05:46.621 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T15:05:46.730 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-03T15:05:46.831 INFO:teuthology.orchestra.console.smithi112:Power on completed 2023-11-03T15:05:46.932 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2023-11-03T15:05:46.932 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-03T15:05:50.479 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T15:05:50.588 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-11-03T15:05:50.689 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-11-03T15:05:50.790 INFO:teuthology.orchestra.console.smithi103:Power on 2023-11-03T15:05:50.791 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-03T15:05:50.816 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2023-11-03T15:05:50.817 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T15:05:50.840 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-11-03T15:05:54.845 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T15:05:54.954 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-11-03T15:05:55.056 INFO:teuthology.orchestra.console.smithi103:Power on completed 2023-11-03T15:05:55.157 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2023-11-03T15:05:55.157 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-03T15:06:02.014 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-03T15:06:10.238 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-03T15:06:17.094 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-03T15:06:25.310 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-03T15:06:32.162 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-03T15:06:40.374 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-03T15:06:47.226 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-03T15:06:55.439 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-03T15:07:02.290 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-03T15:07:10.510 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-03T15:07:17.352 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-03T15:07:25.594 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-03T15:07:32.418 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-03T15:07:40.662 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-03T15:07:47.490 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-03T15:07:55.734 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-03T15:08:02.558 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-03T15:08:10.797 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-03T15:08:17.622 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-11-03T15:08:17.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:08:17.977 ERROR:teuthology.orchestra.connection:Error authenticating with smithi112.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-03T15:08:25.857 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-03T15:08:40.906 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-11-03T15:08:40.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:08:44.026 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-03T15:08:50.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:08:53.082 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-03T15:08:59.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:09:02.138 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-03T15:09:08.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:09:11.194 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-03T15:09:17.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:09:20.254 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-03T15:09:21.988 WARNING:teuthology.provision.fog.smithi112:timed out 2023-11-03T15:09:26.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:09:27.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:09:29.306 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-03T15:09:35.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:09:38.362 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-03T15:09:44.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:09:46.494 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-03T15:09:47.418 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-03T15:09:52.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:09:53.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:09:55.550 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-03T15:10:01.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:10:01.786 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-03T15:10:01.787 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-03T15:10:11.834 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-03T15:10:17.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:10:20.890 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-03T15:10:22.109 INFO:teuthology.provision.fog.smithi112:Node is ready 2023-11-03T15:10:22.110 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2023-11-03T15:10:22.130 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2023-11-03T15:10:22.131 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2023-11-03T15:10:22.189 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2023-11-03T15:10:22.189 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-11-03T15:10:22.303 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2023-11-03T15:10:22.334 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2023-11-03T15:10:22.402 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2023-11-03T15:10:22.470 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-11-03T15:10:22.536 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-11-03T15:10:22.591 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2023-11-03T15:10:22.592 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2023-11-03T15:10:22.593 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2023-11-03T15:10:22.593 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2023-11-03T15:10:22.593 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2023-11-03T15:10:22.593 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2023-11-03T15:10:22.594 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-03T15:10:22.594 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-11-03T15:10:22.594 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2023-11-03T15:10:22.594 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-03T15:10:22.595 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2023-11-03T15:10:22.595 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T15:10:22.595 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-03T15:10:22.595 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-03T15:10:22.596 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2023-11-03T15:10:22.598 DEBUG:teuthology.parallel:result is None 2023-11-03T15:10:26.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:10:29.950 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-11-03T15:10:35.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:10:36.282 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-03T15:10:36.283 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-03T15:10:51.721 INFO:teuthology.provision.fog.smithi103:Node is ready 2023-11-03T15:10:51.721 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2023-11-03T15:10:51.739 INFO:teuthology.orchestra.run.smithi103.stdout:smithi046 2023-11-03T15:10:51.740 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi046 /etc/hosts 2023-11-03T15:10:51.797 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-11-03T15:10:51.798 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-11-03T15:10:51.935 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi046/smithi103/g' /etc/hosts 2023-11-03T15:10:51.965 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.46/172.21.15.103/g' /etc/hosts 2023-11-03T15:10:52.035 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi046/smithi103/g' /etc/hostname 2023-11-03T15:10:52.103 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-11-03T15:10:52.171 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-11-03T15:10:52.227 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2023-11-03T15:10:52.229 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2023-11-03T15:10:52.229 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2023-11-03T15:10:52.230 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2023-11-03T15:10:52.230 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2023-11-03T15:10:52.230 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2023-11-03T15:10:52.230 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-03T15:10:52.230 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-11-03T15:10:52.231 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2023-11-03T15:10:52.231 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-03T15:10:52.231 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2023-11-03T15:10:52.231 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T15:10:52.231 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-03T15:10:52.232 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-03T15:10:52.232 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2023-11-03T15:10:52.232 DEBUG:teuthology.parallel:result is None 2023-11-03T15:10:52.415 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2023-11-03T15:10:52.415 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-03T15:10:52.440 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2023-11-03T15:10:52.441 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-03T15:10:52.458 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2023-11-03T15:10:52.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-11-03T15:10:52.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:10:52.541 DEBUG:teuthology.orchestra.run.smithi103:> true 2023-11-03T15:10:52.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-11-03T15:10:52.565 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2023-11-03T15:10:52.620 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2023-11-03T15:10:52.620 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-11-03T15:10:52.675 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2023-11-03T15:10:52.675 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2023-11-03T15:10:52.675 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2023-11-03T15:10:52.676 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2023-11-03T15:10:52.676 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2023-11-03T15:10:52.676 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2023-11-03T15:10:52.676 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-03T15:10:52.676 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-11-03T15:10:52.677 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2023-11-03T15:10:52.677 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-03T15:10:52.677 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2023-11-03T15:10:52.677 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T15:10:52.677 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-03T15:10:52.678 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-03T15:10:52.678 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-11-03T15:10:52.699 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2023-11-03T15:10:52.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-11-03T15:10:52.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T15:10:52.783 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-11-03T15:10:52.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-11-03T15:10:52.954 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-11-03T15:10:53.009 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-11-03T15:10:53.009 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-11-03T15:10:53.063 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2023-11-03T15:10:53.063 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2023-11-03T15:10:53.064 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2023-11-03T15:10:53.064 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2023-11-03T15:10:53.064 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2023-11-03T15:10:53.064 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2023-11-03T15:10:53.064 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-03T15:10:53.065 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-11-03T15:10:53.065 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2023-11-03T15:10:53.065 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-03T15:10:53.065 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2023-11-03T15:10:53.065 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-03T15:10:53.065 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-03T15:10:53.066 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-03T15:10:53.066 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-11-03T15:10:53.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:10:53.173 INFO:teuthology.dispatcher.supervisor:Running job 7443397 2023-11-03T15:10:53.173 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-11-01_19:26:09-rgw-wip-cbodley-testing-distro-default-smithi/7443397 --name cbodley-2023-11-01_19:26:09-rgw-wip-cbodley-testing-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/cbodley-2023-11-01_19:26:09-rgw-wip-cbodley-testing-distro-default-smithi/7443397/orig.config.yaml 2023-11-03T15:10:53.176 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-11-01_19:26:09-rgw-wip-cbodley-testing-distro-default-smithi/7443397 2023-11-03T15:10:53.177 INFO:teuthology.dispatcher.supervisor:Job PID: 949143 2023-11-03T15:10:53.177 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-03T15:12:53.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:14:53.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:16:53.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:18:53.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:20:53.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:22:53.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:24:53.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:26:53.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:28:53.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:30:53.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:32:53.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:34:53.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:36:54.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:38:54.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:40:54.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:42:54.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:44:54.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:46:54.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:48:54.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:50:54.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:52:54.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:54:54.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:56:54.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T15:58:54.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T16:00:55.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T16:02:55.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T16:04:55.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T16:06:55.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T16:08:55.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T16:10:55.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T16:12:55.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T16:14:55.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T16:16:55.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T16:18:55.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T16:18:55.686 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-03T16:18:55.836 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-03T16:18:55.836 INFO:teuthology.nuke:Checking targets against current locks 2023-11-03T16:18:55.883 DEBUG:teuthology.nuke:shortname: smithi103 2023-11-03T16:18:55.883 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-03T16:18:55.903 DEBUG:teuthology.nuke:shortname: smithi112 2023-11-03T16:18:55.904 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-03T16:18:55.908 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-11-01_19:26:09-rgw-wip-cbodley-testing-distro-default-smithi/7443397', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-03 15:05:40.832944', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAoORZ06tBwVFnkFG+ozabrXNiZhq9qpgQzalVzX2n7/+LG/LH53HPfgQoEdNbHRc7bSjrdTQ3QLJXrTYF7HKKU='} 2023-11-03T16:18:55.924 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-11-01_19:26:09-rgw-wip-cbodley-testing-distro-default-smithi/7443397', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-03 15:05:40.834359', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLUwGJwyTzADFGixKn3QPunc+vlKOgBkCgHFbeckJQCSjJZbc/9R0YJt1YItwXpsHNH8qyxi70RbV3JNvXxiv3w='} 2023-11-03T16:18:55.956 INFO:teuthology.orchestra.console.smithi103:Power off 2023-11-03T16:18:55.957 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T16:18:55.980 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-11-03T16:18:55.980 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T16:18:55.995 INFO:teuthology.orchestra.console.smithi112:Power off 2023-11-03T16:18:55.996 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T16:18:56.004 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-11-03T16:18:56.019 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-11-03T16:18:56.019 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T16:18:56.040 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-11-03T16:18:56.106 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-11-03T16:18:56.141 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-11-03T16:18:56.252 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com 2023-11-03T16:18:56.285 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com