2023-10-18T08:33:22.874 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-18T08:33:22.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T08:33:23.019 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f74d141e670>, signals=[15]) 2023-10-18T08:33:23.020 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2023-10-18T08:33:23.021 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T08:33:23.021 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-10-18T08:33:23.042 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging 2023-10-18T08:33:23.042 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T08:33:23.043 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-10-18T08:33:23.045 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /host {"name": "smithi040"} 2023-10-18T08:33:23.067 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /host {"name": "smithi144"} 2023-10-18T08:33:23.121 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-18T08:33:23.143 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-18T08:33:23.163 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_9.stream (ID 10) 2023-10-18T08:33:23.163 DEBUG:teuthology.provision.fog.smithi040:FOG request: PUT /host/145 {"imageID": 10} 2023-10-18T08:33:23.184 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_centos_9.stream (ID 10) 2023-10-18T08:33:23.184 DEBUG:teuthology.provision.fog.smithi144:FOG request: PUT /host/249 {"imageID": 10} 2023-10-18T08:33:23.206 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 9.stream 2023-10-18T08:33:23.207 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-18T08:33:23.252 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of centos 9.stream 2023-10-18T08:33:23.252 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-18T08:33:23.266 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T08:33:23.300 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T08:33:23.303 DEBUG:teuthology.provision.fog.smithi040:FOG request: POST /host/145/task {"taskTypeID": 1} 2023-10-18T08:33:23.333 DEBUG:teuthology.provision.fog.smithi144:FOG request: POST /host/249/task {"taskTypeID": 1} 2023-10-18T08:33:23.364 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-18T08:33:23.410 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-18T08:33:23.458 INFO:teuthology.orchestra.console.smithi040:Power off 2023-10-18T08:33:23.458 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T08:33:23.480 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-10-18T08:33:23.481 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T08:33:23.498 INFO:teuthology.orchestra.console.smithi144:Power off 2023-10-18T08:33:23.498 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T08:33:23.506 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-10-18T08:33:23.518 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-10-18T08:33:23.519 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T08:33:23.543 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-18T08:33:27.511 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T08:33:27.545 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T08:33:27.620 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-10-18T08:33:27.653 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-18T08:33:31.622 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T08:33:31.654 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T08:33:31.731 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-10-18T08:33:31.762 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-18T08:33:31.833 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-10-18T08:33:31.933 INFO:teuthology.orchestra.console.smithi040:Power on 2023-10-18T08:33:31.934 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T08:33:31.954 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On 2023-10-18T08:33:31.955 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T08:33:31.975 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-10-18T08:33:35.767 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T08:33:35.876 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-10-18T08:33:35.977 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T08:33:35.984 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-10-18T08:33:36.085 INFO:teuthology.orchestra.console.smithi144:Power on 2023-10-18T08:33:36.085 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T08:33:36.094 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-10-18T08:33:36.106 DEBUG:teuthology.orchestra.console.smithi144:power on output: Chassis Power Control: Up/On 2023-10-18T08:33:36.107 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T08:33:36.127 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-10-18T08:33:40.099 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T08:33:40.129 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T08:33:40.209 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-10-18T08:33:40.237 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-10-18T08:33:40.311 INFO:teuthology.orchestra.console.smithi040:Power on completed 2023-10-18T08:33:40.411 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2023-10-18T08:33:40.412 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-18T08:33:44.240 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T08:33:44.348 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-10-18T08:33:44.449 INFO:teuthology.orchestra.console.smithi144:Power on completed 2023-10-18T08:33:44.549 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish 2023-10-18T08:33:44.550 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-18T08:33:55.477 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-18T08:33:59.618 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-18T08:34:10.543 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-18T08:34:14.678 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-18T08:34:25.618 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-18T08:34:29.734 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-18T08:34:40.686 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-18T08:34:44.795 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-18T08:34:55.754 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-18T08:34:59.857 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-18T08:35:10.824 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-18T08:35:14.914 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-18T08:35:25.901 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-18T08:35:29.974 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-18T08:35:40.965 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-18T08:35:45.038 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-18T08:35:56.026 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-18T08:36:00.098 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-18T08:36:11.084 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-18T08:36:11.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T08:36:15.150 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-10-18T08:36:15.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T08:36:29.690 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-10-18T08:36:33.530 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-10-18T08:36:35.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T08:36:38.746 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-10-18T08:36:39.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T08:36:42.586 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-10-18T08:36:44.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T08:36:47.802 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-10-18T08:36:48.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T08:36:51.642 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-10-18T08:36:53.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T08:36:56.858 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-10-18T08:36:57.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T08:37:00.698 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-10-18T08:37:02.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T08:37:06.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T08:37:09.758 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-10-18T08:37:15.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T08:38:02.910 WARNING:teuthology.provision.fog.smithi040:timed out 2023-10-18T08:38:08.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T08:38:09.172 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T08:38:09.172 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T08:38:09.532 INFO:teuthology.provision.fog.smithi040:Node is ready 2023-10-18T08:38:09.533 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2023-10-18T08:38:09.548 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2023-10-18T08:38:09.549 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2023-10-18T08:38:09.604 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2023-10-18T08:38:09.605 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-10-18T08:38:09.725 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2023-10-18T08:38:09.757 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2023-10-18T08:38:09.829 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2023-10-18T08:38:09.900 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-10-18T08:38:09.971 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-10-18T08:38:10.025 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-10-18T08:38:10.025 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2023-10-18T08:38:10.025 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-10-18T08:38:10.026 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-10-18T08:38:10.026 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2023-10-18T08:38:10.026 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2023-10-18T08:38:10.026 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-18T08:38:10.026 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-10-18T08:38:10.027 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2023-10-18T08:38:10.027 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-18T08:38:10.027 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-10-18T08:38:10.027 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T08:38:10.027 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-18T08:38:10.028 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T08:38:10.028 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2023-10-18T08:38:10.030 DEBUG:teuthology.parallel:result is None 2023-10-18T08:38:15.770 WARNING:teuthology.provision.fog.smithi144:timed out 2023-10-18T08:38:21.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T08:38:22.095 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T08:38:22.095 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T08:38:22.427 INFO:teuthology.provision.fog.smithi144:Node is ready 2023-10-18T08:38:22.428 DEBUG:teuthology.orchestra.run.smithi144:> hostname 2023-10-18T08:38:22.443 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com 2023-10-18T08:38:22.443 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144.front.sepia.ceph.com /etc/hosts 2023-10-18T08:38:22.496 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144 2023-10-18T08:38:22.496 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-10-18T08:38:22.596 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hosts 2023-10-18T08:38:22.625 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts 2023-10-18T08:38:22.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hostname 2023-10-18T08:38:22.757 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-10-18T08:38:22.822 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-10-18T08:38:22.875 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2023-10-18T08:38:22.875 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2023-10-18T08:38:22.876 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2023-10-18T08:38:22.876 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2023-10-18T08:38:22.876 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2023-10-18T08:38:22.876 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2023-10-18T08:38:22.876 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-18T08:38:22.877 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-10-18T08:38:22.877 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2023-10-18T08:38:22.877 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-18T08:38:22.877 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2023-10-18T08:38:22.878 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T08:38:22.878 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-18T08:38:22.878 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T08:38:22.878 INFO:teuthology.provision.fog.smithi144:Deploy complete! 2023-10-18T08:38:22.879 DEBUG:teuthology.parallel:result is None 2023-10-18T08:38:23.045 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2023-10-18T08:38:23.046 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T08:38:23.072 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com 2023-10-18T08:38:23.072 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T08:38:23.098 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2023-10-18T08:38:23.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-10-18T08:38:23.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T08:38:23.197 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-10-18T08:38:23.377 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-10-18T08:38:23.377 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-10-18T08:38:23.431 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-10-18T08:38:23.432 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-10-18T08:38:23.486 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-10-18T08:38:23.487 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2023-10-18T08:38:23.487 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-10-18T08:38:23.487 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-10-18T08:38:23.487 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2023-10-18T08:38:23.488 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2023-10-18T08:38:23.488 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-18T08:38:23.488 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-10-18T08:38:23.488 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2023-10-18T08:38:23.488 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-18T08:38:23.489 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-10-18T08:38:23.489 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T08:38:23.489 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-18T08:38:23.489 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T08:38:23.490 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-10-18T08:38:23.514 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server 2023-10-18T08:38:23.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-18T08:38:23.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T08:38:23.598 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-10-18T08:38:23.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-10-18T08:38:23.666 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-10-18T08:38:23.719 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-10-18T08:38:23.720 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-10-18T08:38:23.773 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2023-10-18T08:38:23.774 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2023-10-18T08:38:23.774 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2023-10-18T08:38:23.774 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2023-10-18T08:38:23.775 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2023-10-18T08:38:23.775 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2023-10-18T08:38:23.775 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-18T08:38:23.775 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-10-18T08:38:23.775 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2023-10-18T08:38:23.776 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-18T08:38:23.776 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2023-10-18T08:38:23.776 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T08:38:23.776 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-18T08:38:23.776 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T08:38:23.777 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-10-18T08:38:23.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T08:38:23.887 INFO:teuthology.dispatcher.supervisor:Running job 7430719 2023-10-18T08:38:23.887 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430719 --name pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} -- /home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430719/orig.config.yaml 2023-10-18T08:38:23.890 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430719 2023-10-18T08:38:23.891 INFO:teuthology.dispatcher.supervisor:Job PID: 1340674 2023-10-18T08:38:23.891 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-18T08:40:23.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T08:42:24.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T08:44:24.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T08:46:24.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T08:48:24.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T08:50:24.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T08:52:25.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T08:54:25.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T08:56:25.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T08:58:25.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T09:00:25.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T09:02:25.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T09:04:26.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T09:06:26.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T09:08:26.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T09:10:26.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T09:12:26.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T09:12:26.760 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-18T09:12:26.948 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-18T09:12:26.949 INFO:teuthology.nuke:Checking targets against current locks 2023-10-18T09:12:26.993 DEBUG:teuthology.nuke:shortname: smithi040 2023-10-18T09:12:26.994 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T09:12:27.020 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430719', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 08:33:22.094210', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPru1b2IMuAaQvQ9WGQJurxzltIS6eqOeara4xXFpywLI6lhSRJD685TuJEGHY9LjnxtK5bfzffsA2ujB/Fq6ZE='} 2023-10-18T09:12:27.023 DEBUG:teuthology.nuke:shortname: smithi144 2023-10-18T09:12:27.024 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T09:12:27.043 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-16_23:59:58-fs-wip-batrick-testing-20231016.203825-distro-default-smithi/7430719', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 08:33:22.095952', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDKHTBvPWMvPC4sZtXUB9Xz9kdZblgeqYUCDaBSavudWyKwn8Od7f360DtIrNn+UGrWbBln0nEK2o6UC5gDSAS4='} 2023-10-18T09:12:27.069 INFO:teuthology.orchestra.console.smithi040:Power off 2023-10-18T09:12:27.069 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T09:12:27.092 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-10-18T09:12:27.092 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T09:12:27.107 INFO:teuthology.orchestra.console.smithi144:Power off 2023-10-18T09:12:27.108 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T09:12:27.116 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-10-18T09:12:27.128 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-10-18T09:12:27.129 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T09:12:27.149 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-10-18T09:12:27.217 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-10-18T09:12:27.250 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-10-18T09:12:27.368 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com 2023-10-18T09:12:27.401 INFO:teuthology.lock.ops:unlocked: smithi144.front.sepia.ceph.com