2023-09-28T05:25:16.189 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-28T05:25:16.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:25:16.332 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5b94b46670>, signals=[15]) 2023-09-28T05:25:16.333 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2023-09-28T05:25:16.333 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2023-09-28T05:25:16.333 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-09-28T05:25:16.356 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2023-09-28T05:25:16.356 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2023-09-28T05:25:16.356 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-09-28T05:25:16.357 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /host {"name": "smithi084"} 2023-09-28T05:25:16.380 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"} 2023-09-28T05:25:16.429 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-28T05:25:16.446 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-28T05:25:16.478 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_centos_8.stream (ID 3) 2023-09-28T05:25:16.478 DEBUG:teuthology.provision.fog.smithi084:FOG request: PUT /host/189 {"imageID": 3} 2023-09-28T05:25:16.487 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_8.stream (ID 3) 2023-09-28T05:25:16.487 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 3} 2023-09-28T05:25:16.526 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream 2023-09-28T05:25:16.526 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-28T05:25:16.528 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 8.stream 2023-09-28T05:25:16.528 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-09-28T05:25:16.569 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /tasktype {"name": "deploy"} 2023-09-28T05:25:16.572 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"} 2023-09-28T05:25:16.611 DEBUG:teuthology.provision.fog.smithi084:FOG request: POST /host/189/task {"taskTypeID": 1} 2023-09-28T05:25:16.620 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1} 2023-09-28T05:25:16.689 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-09-28T05:25:16.701 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-28T05:25:16.772 INFO:teuthology.orchestra.console.smithi099:Power off 2023-09-28T05:25:16.772 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T05:25:16.784 INFO:teuthology.orchestra.console.smithi084:Power off 2023-09-28T05:25:16.784 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T05:25:16.793 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-09-28T05:25:16.793 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:25:16.802 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-09-28T05:25:16.803 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:25:16.812 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-09-28T05:25:16.822 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-09-28T05:25:16.913 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-09-28T05:25:16.923 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-09-28T05:25:17.014 INFO:teuthology.orchestra.console.smithi099:Power on 2023-09-28T05:25:17.014 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-28T05:25:17.024 INFO:teuthology.orchestra.console.smithi084:Power on 2023-09-28T05:25:17.024 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-28T05:25:17.034 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2023-09-28T05:25:17.034 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:25:17.042 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2023-09-28T05:25:17.042 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:25:17.053 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-09-28T05:25:17.062 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-09-28T05:25:21.058 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:25:21.065 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:25:21.167 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-09-28T05:25:21.173 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-09-28T05:25:21.274 INFO:teuthology.orchestra.console.smithi084:Power on completed 2023-09-28T05:25:21.374 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2023-09-28T05:25:21.375 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-09-28T05:25:25.172 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:25:25.281 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-09-28T05:25:25.381 INFO:teuthology.orchestra.console.smithi099:Power on completed 2023-09-28T05:25:25.482 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2023-09-28T05:25:25.482 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-28T05:25:36.446 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-09-28T05:25:40.538 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-28T05:25:51.502 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-09-28T05:25:55.586 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-28T05:26:06.566 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-09-28T05:26:10.646 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-28T05:26:21.630 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-09-28T05:26:25.710 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-28T05:26:36.693 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-09-28T05:26:40.762 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-28T05:26:51.759 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-09-28T05:26:55.826 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-28T05:27:06.820 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-09-28T05:27:10.880 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-28T05:27:21.890 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-09-28T05:27:25.939 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-28T05:27:36.952 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-09-28T05:27:41.003 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-28T05:27:52.022 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-09-28T05:27:56.066 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-28T05:28:07.094 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None 2023-09-28T05:28:07.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:28:11.126 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-09-28T05:28:11.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:28:25.722 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-09-28T05:28:29.562 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-09-28T05:28:31.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:28:34.778 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-09-28T05:28:35.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:28:38.618 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-09-28T05:28:40.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:28:43.834 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-09-28T05:28:44.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:28:47.674 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-09-28T05:28:49.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:28:52.894 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-09-28T05:28:53.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:28:56.730 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-09-28T05:28:58.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:29:02.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:29:05.786 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-09-28T05:29:11.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:29:43.609 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-28T05:29:43.610 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-28T05:29:58.900 WARNING:teuthology.provision.fog.smithi084:timed out 2023-09-28T05:30:04.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:30:05.117 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-28T05:30:05.118 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-28T05:30:05.394 INFO:teuthology.provision.fog.smithi084:Node is ready 2023-09-28T05:30:05.394 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2023-09-28T05:30:05.413 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2023-09-28T05:30:05.414 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2023-09-28T05:30:05.473 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2023-09-28T05:30:05.474 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-09-28T05:30:05.572 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2023-09-28T05:30:05.602 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2023-09-28T05:30:05.671 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2023-09-28T05:30:05.739 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-09-28T05:30:05.806 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-09-28T05:30:05.864 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2023-09-28T05:30:05.864 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8" 2023-09-28T05:30:05.864 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2023-09-28T05:30:05.864 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2023-09-28T05:30:05.864 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8" 2023-09-28T05:30:05.864 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2023-09-28T05:30:05.865 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-28T05:30:05.865 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-09-28T05:30:05.865 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-28T05:30:05.865 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2023-09-28T05:30:05.865 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T05:30:05.865 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T05:30:05.865 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-28T05:30:05.866 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2023-09-28T05:30:05.867 DEBUG:teuthology.parallel:result is None 2023-09-28T05:30:08.473 INFO:teuthology.provision.fog.smithi099:Node is ready 2023-09-28T05:30:08.473 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2023-09-28T05:30:08.497 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2023-09-28T05:30:08.498 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2023-09-28T05:30:08.558 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2023-09-28T05:30:08.559 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-09-28T05:30:08.681 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2023-09-28T05:30:08.712 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2023-09-28T05:30:08.782 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2023-09-28T05:30:08.852 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-09-28T05:30:08.919 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-09-28T05:30:08.978 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2023-09-28T05:30:08.978 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2023-09-28T05:30:08.978 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2023-09-28T05:30:08.978 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2023-09-28T05:30:08.978 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2023-09-28T05:30:08.978 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-09-28T05:30:08.978 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-28T05:30:08.978 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-09-28T05:30:08.979 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-28T05:30:08.979 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2023-09-28T05:30:08.979 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T05:30:08.979 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T05:30:08.979 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-28T05:30:08.979 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2023-09-28T05:30:08.980 DEBUG:teuthology.parallel:result is None 2023-09-28T05:30:09.124 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2023-09-28T05:30:09.124 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-28T05:30:09.150 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2023-09-28T05:30:09.150 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-28T05:30:09.174 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2023-09-28T05:30:09.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-09-28T05:30:09.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:30:09.241 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-09-28T05:30:09.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-09-28T05:30:09.315 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-09-28T05:30:09.373 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-09-28T05:30:09.374 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-09-28T05:30:09.432 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2023-09-28T05:30:09.432 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8" 2023-09-28T05:30:09.433 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2023-09-28T05:30:09.433 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2023-09-28T05:30:09.433 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8" 2023-09-28T05:30:09.433 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2023-09-28T05:30:09.433 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-28T05:30:09.433 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-09-28T05:30:09.433 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-28T05:30:09.433 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2023-09-28T05:30:09.433 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T05:30:09.433 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T05:30:09.433 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-28T05:30:09.434 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-09-28T05:30:09.457 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2023-09-28T05:30:09.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-09-28T05:30:09.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T05:30:09.525 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-09-28T05:30:09.550 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-09-28T05:30:09.550 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-09-28T05:30:09.608 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-09-28T05:30:09.608 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-09-28T05:30:09.666 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2023-09-28T05:30:09.666 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2023-09-28T05:30:09.666 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2023-09-28T05:30:09.666 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2023-09-28T05:30:09.666 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2023-09-28T05:30:09.666 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-09-28T05:30:09.666 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-28T05:30:09.666 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-09-28T05:30:09.666 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-28T05:30:09.666 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2023-09-28T05:30:09.667 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T05:30:09.667 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T05:30:09.667 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-28T05:30:09.667 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-09-28T05:30:09.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:30:09.782 INFO:teuthology.dispatcher.supervisor:Running job 7403653 2023-09-28T05:30:09.782 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403653 --name yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403653/orig.config.yaml 2023-09-28T05:30:09.784 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403653 2023-09-28T05:30:09.785 INFO:teuthology.dispatcher.supervisor:Job PID: 1856470 2023-09-28T05:30:09.785 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-28T05:32:09.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:34:09.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:36:10.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:38:10.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:40:10.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:42:10.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:44:10.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:46:10.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:48:11.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:50:11.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:52:11.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T05:52:11.452 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-28T05:52:11.560 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-28T05:52:11.561 INFO:teuthology.nuke:Checking targets against current locks 2023-09-28T05:52:11.607 DEBUG:teuthology.nuke:shortname: smithi084 2023-09-28T05:52:11.607 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T05:52:11.627 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403653', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 05:25:15.437892', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUEykCeRU2+DMKloGz9TUDK4neCcw+vB6NhuaOmTHoH3yZSWgjhWeIAtHUOZfPaMNZPwuCd6aXobadobVYLBss='} 2023-09-28T05:52:11.631 DEBUG:teuthology.nuke:shortname: smithi099 2023-09-28T05:52:11.632 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T05:52:11.654 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403653', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 05:25:15.436148', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxZipEH4wkOfTiTUOdyLrg/ErEMdHBWuPHc11GuoKmz6eH6UdB6RGl7DzJ5oeG3TlOLrivoB8/vbuAj+KIJi3g='} 2023-09-28T05:52:11.673 INFO:teuthology.orchestra.console.smithi084:Power off 2023-09-28T05:52:11.673 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T05:52:11.693 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-09-28T05:52:11.694 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:52:11.712 INFO:teuthology.orchestra.console.smithi099:Power off 2023-09-28T05:52:11.713 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T05:52:11.720 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-09-28T05:52:11.732 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-09-28T05:52:11.732 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T05:52:11.754 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-09-28T05:52:11.821 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-09-28T05:52:11.855 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-09-28T05:52:11.969 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com 2023-09-28T05:52:12.001 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com