2023-07-29T15:46:22.567 INFO:root:teuthology version: 0.0.1.dev172+g6114016 2023-07-29T15:46:22.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T15:46:22.715 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffb5efb2ee0>, signals=[15]) 2023-07-29T15:46:22.717 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2023-07-29T15:46:22.717 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2023-07-29T15:46:22.718 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-07-29T15:46:22.744 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2023-07-29T15:46:22.745 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2023-07-29T15:46:22.745 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-07-29T15:46:22.746 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /host {"name": "smithi072"} 2023-07-29T15:46:22.769 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /host {"name": "smithi103"} 2023-07-29T15:46:22.819 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-29T15:46:22.833 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-29T15:46:22.860 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_centos_9.stream (ID 10) 2023-07-29T15:46:22.861 DEBUG:teuthology.provision.fog.smithi072:FOG request: PUT /host/177 {"imageID": 10} 2023-07-29T15:46:22.874 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_centos_9.stream (ID 10) 2023-07-29T15:46:22.874 DEBUG:teuthology.provision.fog.smithi103:FOG request: PUT /host/208 {"imageID": 10} 2023-07-29T15:46:22.904 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of centos 9.stream 2023-07-29T15:46:22.905 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-29T15:46:22.917 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 9.stream 2023-07-29T15:46:22.918 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-29T15:46:22.946 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /tasktype {"name": "deploy"} 2023-07-29T15:46:22.956 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /tasktype {"name": "deploy"} 2023-07-29T15:46:22.981 DEBUG:teuthology.provision.fog.smithi072:FOG request: POST /host/177/task {"taskTypeID": 1} 2023-07-29T15:46:23.001 DEBUG:teuthology.provision.fog.smithi103:FOG request: POST /host/208/task {"taskTypeID": 1} 2023-07-29T15:46:23.038 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-29T15:46:23.053 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-29T15:46:23.119 INFO:teuthology.orchestra.console.smithi072:Power off 2023-07-29T15:46:23.120 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T15:46:23.134 INFO:teuthology.orchestra.console.smithi103:Power off 2023-07-29T15:46:23.135 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T15:46:23.146 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-07-29T15:46:23.147 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T15:46:23.158 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-07-29T15:46:23.158 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T15:46:23.171 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-07-29T15:46:23.179 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-07-29T15:46:27.172 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T15:46:27.181 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T15:46:27.283 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-07-29T15:46:27.290 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-07-29T15:46:31.288 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T15:46:31.297 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T15:46:31.399 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-07-29T15:46:31.406 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-07-29T15:46:35.405 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T15:46:35.414 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T15:46:35.516 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-07-29T15:46:35.525 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-07-29T15:46:35.618 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-07-29T15:46:35.626 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-07-29T15:46:35.720 INFO:teuthology.orchestra.console.smithi072:Power on 2023-07-29T15:46:35.721 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-29T15:46:35.729 INFO:teuthology.orchestra.console.smithi103:Power on 2023-07-29T15:46:35.730 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-29T15:46:35.740 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On 2023-07-29T15:46:35.741 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T15:46:35.752 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2023-07-29T15:46:35.752 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T15:46:35.761 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-07-29T15:46:35.772 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-07-29T15:46:39.764 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T15:46:39.773 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T15:46:39.875 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-07-29T15:46:39.883 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-07-29T15:46:43.880 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T15:46:43.889 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T15:46:43.991 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-07-29T15:46:44.000 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-07-29T15:46:44.093 INFO:teuthology.orchestra.console.smithi072:Power on completed 2023-07-29T15:46:44.101 INFO:teuthology.orchestra.console.smithi103:Power on completed 2023-07-29T15:46:44.195 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2023-07-29T15:46:44.195 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-29T15:46:44.202 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2023-07-29T15:46:44.202 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-29T15:46:59.260 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-29T15:46:59.262 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-29T15:47:14.332 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-29T15:47:14.333 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-29T15:47:29.404 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-29T15:47:29.405 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-29T15:47:44.472 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-29T15:47:44.473 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-29T15:47:59.536 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-29T15:47:59.538 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-29T15:48:14.624 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-29T15:48:14.625 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-29T15:48:29.712 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-29T15:48:29.713 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-29T15:48:44.802 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-29T15:48:44.803 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-29T15:48:59.889 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-29T15:48:59.891 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-29T15:49:14.972 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-29T15:49:14.974 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-29T15:49:30.056 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-29T15:49:30.058 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-29T15:49:45.138 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-07-29T15:49:45.140 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-29T15:49:45.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:49:45.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:49:48.272 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-29T15:49:48.273 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-29T15:49:54.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:49:54.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:49:57.328 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-29T15:49:57.329 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-29T15:50:03.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:50:03.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:50:06.384 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-29T15:50:06.385 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-29T15:50:12.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:50:12.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:50:15.440 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-29T15:50:15.472 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-29T15:50:21.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:50:21.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:50:24.500 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-29T15:50:24.528 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-29T15:50:30.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:50:30.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:50:33.584 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-29T15:50:33.585 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-07-29T15:50:39.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:50:39.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:50:42.676 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-29T15:50:48.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:51:39.644 WARNING:teuthology.provision.fog.smithi072:timed out 2023-07-29T15:51:45.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:51:45.873 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-29T15:51:45.874 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-29T15:51:46.248 INFO:teuthology.provision.fog.smithi072:Node is ready 2023-07-29T15:51:46.249 DEBUG:teuthology.orchestra.run.smithi072:> hostname 2023-07-29T15:51:46.264 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2023-07-29T15:51:46.264 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts 2023-07-29T15:51:46.319 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2023-07-29T15:51:46.320 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-07-29T15:51:46.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts 2023-07-29T15:51:46.462 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts 2023-07-29T15:51:46.530 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname 2023-07-29T15:51:46.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-07-29T15:51:46.664 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-07-29T15:51:46.720 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-07-29T15:51:46.720 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9" 2023-07-29T15:51:46.720 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-07-29T15:51:46.720 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-07-29T15:51:46.721 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9" 2023-07-29T15:51:46.721 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9" 2023-07-29T15:51:46.721 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-29T15:51:46.721 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-07-29T15:51:46.721 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon" 2023-07-29T15:51:46.721 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-29T15:51:46.721 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-07-29T15:51:46.722 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T15:51:46.722 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-29T15:51:46.722 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T15:51:46.723 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2023-07-29T15:51:46.724 DEBUG:teuthology.parallel:result is None 2023-07-29T15:51:48.684 WARNING:teuthology.provision.fog.smithi103:timed out 2023-07-29T15:51:54.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:51:55.115 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-29T15:51:55.116 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-29T15:51:55.390 INFO:teuthology.provision.fog.smithi103:Node is ready 2023-07-29T15:51:55.391 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2023-07-29T15:51:55.405 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2023-07-29T15:51:55.405 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts 2023-07-29T15:51:55.459 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2023-07-29T15:51:55.460 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-07-29T15:51:55.584 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts 2023-07-29T15:51:55.612 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2023-07-29T15:51:55.680 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname 2023-07-29T15:51:55.747 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-07-29T15:51:55.815 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-07-29T15:51:55.869 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2023-07-29T15:51:55.869 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2023-07-29T15:51:55.870 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2023-07-29T15:51:55.870 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2023-07-29T15:51:55.870 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2023-07-29T15:51:55.870 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2023-07-29T15:51:55.870 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-29T15:51:55.870 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-07-29T15:51:55.871 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2023-07-29T15:51:55.871 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-29T15:51:55.871 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2023-07-29T15:51:55.871 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T15:51:55.871 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-29T15:51:55.871 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T15:51:55.872 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2023-07-29T15:51:55.872 DEBUG:teuthology.parallel:result is None 2023-07-29T15:51:56.030 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2023-07-29T15:51:56.032 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-29T15:51:56.058 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2023-07-29T15:51:56.059 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-29T15:51:56.085 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2023-07-29T15:51:56.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-29T15:51:56.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:51:56.170 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-07-29T15:51:56.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-29T15:51:56.240 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-07-29T15:51:56.296 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-07-29T15:51:56.296 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-07-29T15:51:56.351 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-07-29T15:51:56.352 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9" 2023-07-29T15:51:56.352 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-07-29T15:51:56.352 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-07-29T15:51:56.352 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9" 2023-07-29T15:51:56.352 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9" 2023-07-29T15:51:56.353 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-29T15:51:56.353 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-07-29T15:51:56.353 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon" 2023-07-29T15:51:56.353 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-29T15:51:56.353 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-07-29T15:51:56.353 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T15:51:56.353 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-29T15:51:56.353 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T15:51:56.354 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-07-29T15:51:56.374 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2023-07-29T15:51:56.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-29T15:51:56.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T15:51:56.457 DEBUG:teuthology.orchestra.run.smithi103:> true 2023-07-29T15:51:56.522 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-29T15:51:56.522 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2023-07-29T15:51:56.576 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2023-07-29T15:51:56.576 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-07-29T15:51:56.629 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2023-07-29T15:51:56.630 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2023-07-29T15:51:56.630 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2023-07-29T15:51:56.630 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2023-07-29T15:51:56.630 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2023-07-29T15:51:56.631 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2023-07-29T15:51:56.631 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-29T15:51:56.631 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-07-29T15:51:56.631 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2023-07-29T15:51:56.631 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-29T15:51:56.631 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2023-07-29T15:51:56.631 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T15:51:56.631 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-29T15:51:56.632 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T15:51:56.632 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-07-29T15:51:56.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T15:51:56.758 INFO:teuthology.dispatcher.supervisor:Running job 7356838 2023-07-29T15:51:56.758 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-29_14:02:18-fs-reef-release-distro-default-smithi/7356838 --name yuriw-2023-07-29_14:02:18-fs-reef-release-distro-default-smithi --description fs/traceless/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} -- /home/teuthworker/archive/yuriw-2023-07-29_14:02:18-fs-reef-release-distro-default-smithi/7356838/orig.config.yaml 2023-07-29T15:51:56.762 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-29_14:02:18-fs-reef-release-distro-default-smithi/7356838 2023-07-29T15:51:56.763 INFO:teuthology.dispatcher.supervisor:Job PID: 25744 2023-07-29T15:51:56.763 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-29T15:53:56.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T15:55:57.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T15:57:57.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T15:59:57.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T16:01:57.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T16:03:57.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T16:05:57.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T16:07:58.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T16:09:58.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T16:09:58.327 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-29T16:09:58.436 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-29T16:09:58.437 INFO:teuthology.nuke:Checking targets against current locks 2023-07-29T16:09:58.493 DEBUG:teuthology.nuke:shortname: smithi072 2023-07-29T16:09:58.494 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T16:09:58.513 DEBUG:teuthology.nuke:shortname: smithi103 2023-07-29T16:09:58.513 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T16:09:58.519 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:02:18-fs-reef-release-distro-default-smithi/7356838', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 15:46:21.777207', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKCRRfdvXA0jZ0tTR+DIWTgqVcscBJ38XNo53G5fl2GTdvq9br0MfxSUC9/1eeRBxugDBhV2bEedDytiK6b/6m0='} 2023-07-29T16:09:58.539 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_14:02:18-fs-reef-release-distro-default-smithi/7356838', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 15:46:21.775541', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPuKI/16cx7HA/Vsy/qVPoJsrawXf8lReLB3E/Za9IGeuxj8PJgvXjsojFhXbdasvsz6WedgaJ7ciNZfc9iwFxs='} 2023-07-29T16:09:58.571 INFO:teuthology.orchestra.console.smithi072:Power off 2023-07-29T16:09:58.572 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T16:09:58.591 INFO:teuthology.orchestra.console.smithi103:Power off 2023-07-29T16:09:58.592 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T16:09:58.601 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-07-29T16:09:58.602 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:09:58.612 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-07-29T16:09:58.613 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T16:09:58.622 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-07-29T16:09:58.634 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-07-29T16:09:58.724 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-07-29T16:09:58.735 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-07-29T16:09:58.884 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com 2023-07-29T16:09:58.892 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com