2023-08-31T19:10:30.445 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-31T19:10:30.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T19:10:30.587 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f89ba669670>, signals=[15]) 2023-08-31T19:10:30.588 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging 2023-08-31T19:10:30.589 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server 2023-08-31T19:10:30.589 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2023-08-31T19:10:30.609 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging 2023-08-31T19:10:30.610 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server 2023-08-31T19:10:30.610 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-08-31T19:10:30.611 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /host {"name": "smithi019"} 2023-08-31T19:10:30.635 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /host {"name": "smithi089"} 2023-08-31T19:10:30.689 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-31T19:10:30.702 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-31T19:10:30.730 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_centos_9.stream (ID 10) 2023-08-31T19:10:30.730 DEBUG:teuthology.provision.fog.smithi019:FOG request: PUT /host/125 {"imageID": 10} 2023-08-31T19:10:30.739 DEBUG:teuthology.provision.fog.smithi089:Requesting image smithi_centos_9.stream (ID 10) 2023-08-31T19:10:30.739 DEBUG:teuthology.provision.fog.smithi089:FOG request: PUT /host/194 {"imageID": 10} 2023-08-31T19:10:30.773 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of centos 9.stream 2023-08-31T19:10:30.773 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-31T19:10:30.776 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of centos 9.stream 2023-08-31T19:10:30.776 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-31T19:10:30.846 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /tasktype {"name": "deploy"} 2023-08-31T19:10:30.851 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /tasktype {"name": "deploy"} 2023-08-31T19:10:30.884 DEBUG:teuthology.provision.fog.smithi019:FOG request: POST /host/125/task {"taskTypeID": 1} 2023-08-31T19:10:30.888 DEBUG:teuthology.provision.fog.smithi089:FOG request: POST /host/194/task {"taskTypeID": 1} 2023-08-31T19:10:30.936 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-31T19:10:30.955 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-31T19:10:31.049 INFO:teuthology.orchestra.console.smithi019:Power off 2023-08-31T19:10:31.050 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T19:10:31.063 INFO:teuthology.orchestra.console.smithi089:Power off 2023-08-31T19:10:31.063 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T19:10:31.073 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2023-08-31T19:10:31.073 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:10:31.083 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-08-31T19:10:31.083 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:10:31.093 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-08-31T19:10:31.104 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-08-31T19:10:31.195 INFO:teuthology.orchestra.console.smithi019:Power off completed 2023-08-31T19:10:31.206 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-08-31T19:10:31.296 INFO:teuthology.orchestra.console.smithi019:Power on 2023-08-31T19:10:31.297 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-31T19:10:31.308 INFO:teuthology.orchestra.console.smithi089:Power on 2023-08-31T19:10:31.308 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-31T19:10:31.317 DEBUG:teuthology.orchestra.console.smithi019:power on output: Chassis Power Control: Up/On 2023-08-31T19:10:31.318 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:10:31.328 DEBUG:teuthology.orchestra.console.smithi089:power on output: Chassis Power Control: Up/On 2023-08-31T19:10:31.328 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:10:31.339 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-08-31T19:10:31.352 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-08-31T19:10:35.342 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:10:35.352 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:10:35.451 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-08-31T19:10:35.460 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-08-31T19:10:39.454 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:10:39.461 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:10:39.563 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-08-31T19:10:39.569 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-08-31T19:10:39.665 INFO:teuthology.orchestra.console.smithi019:Power on completed 2023-08-31T19:10:39.670 INFO:teuthology.orchestra.console.smithi089:Power on completed 2023-08-31T19:10:39.766 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish 2023-08-31T19:10:39.767 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-31T19:10:39.771 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2023-08-31T19:10:39.771 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-31T19:10:54.863 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-31T19:10:54.865 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-31T19:11:09.954 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-31T19:11:09.955 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-31T19:11:25.053 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-31T19:11:25.055 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-31T19:11:40.146 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-31T19:11:40.147 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-31T19:11:55.246 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-31T19:11:55.247 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-31T19:12:10.362 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-31T19:12:10.364 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-31T19:12:25.466 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-31T19:12:25.468 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-31T19:12:40.562 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-31T19:12:40.563 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-31T19:12:55.694 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-31T19:12:55.695 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-31T19:13:10.783 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-08-31T19:13:10.785 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-08-31T19:13:10.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:13:10.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:13:13.957 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-08-31T19:13:13.958 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-31T19:13:19.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:13:19.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:13:23.038 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-08-31T19:13:23.039 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-31T19:13:29.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:13:29.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:13:32.122 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-08-31T19:13:32.122 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-31T19:13:38.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:13:38.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:13:41.178 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-08-31T19:13:41.179 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-31T19:13:47.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:13:47.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:13:50.266 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-08-31T19:13:50.266 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-31T19:13:56.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:13:56.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:13:59.358 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-08-31T19:13:59.359 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-31T19:14:05.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:14:05.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:14:08.446 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-31T19:14:14.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:14:32.986 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-31T19:14:38.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:14:42.042 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-08-31T19:14:48.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:14:48.260 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-31T19:14:48.261 DEBUG:teuthology.orchestra.run.smithi089:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-31T19:15:05.365 WARNING:teuthology.provision.fog.smithi019:timed out 2023-08-31T19:15:11.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:15:11.594 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-31T19:15:11.595 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-31T19:15:11.921 INFO:teuthology.provision.fog.smithi019:Node is ready 2023-08-31T19:15:11.921 DEBUG:teuthology.orchestra.run.smithi019:> hostname 2023-08-31T19:15:11.937 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com 2023-08-31T19:15:11.937 DEBUG:teuthology.orchestra.run.smithi019:> grep smithi019.front.sepia.ceph.com /etc/hosts 2023-08-31T19:15:11.993 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019 2023-08-31T19:15:11.996 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2023-08-31T19:15:12.122 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hosts 2023-08-31T19:15:12.155 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/172.21.15.19/172.21.15.19/g' /etc/hosts 2023-08-31T19:15:12.228 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hostname 2023-08-31T19:15:12.300 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2023-08-31T19:15:12.371 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2023-08-31T19:15:12.426 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2023-08-31T19:15:12.426 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2023-08-31T19:15:12.426 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2023-08-31T19:15:12.427 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2023-08-31T19:15:12.427 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2023-08-31T19:15:12.427 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2023-08-31T19:15:12.427 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-31T19:15:12.427 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2023-08-31T19:15:12.428 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2023-08-31T19:15:12.428 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-31T19:15:12.428 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2023-08-31T19:15:12.428 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T19:15:12.428 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-31T19:15:12.429 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-31T19:15:12.429 INFO:teuthology.provision.fog.smithi019:Deploy complete! 2023-08-31T19:15:12.431 DEBUG:teuthology.parallel:result is None 2023-08-31T19:15:14.393 INFO:teuthology.provision.fog.smithi089:Node is ready 2023-08-31T19:15:14.394 DEBUG:teuthology.orchestra.run.smithi089:> hostname 2023-08-31T19:15:14.413 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com 2023-08-31T19:15:14.413 DEBUG:teuthology.orchestra.run.smithi089:> grep smithi089.front.sepia.ceph.com /etc/hosts 2023-08-31T19:15:14.471 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089 2023-08-31T19:15:14.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-08-31T19:15:14.615 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hosts 2023-08-31T19:15:14.646 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/172.21.15.89/172.21.15.89/g' /etc/hosts 2023-08-31T19:15:14.716 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hostname 2023-08-31T19:15:14.786 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-08-31T19:15:14.854 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-08-31T19:15:14.909 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-08-31T19:15:14.909 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2023-08-31T19:15:14.909 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-08-31T19:15:14.909 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-08-31T19:15:14.910 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2023-08-31T19:15:14.910 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2023-08-31T19:15:14.910 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-31T19:15:14.910 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-08-31T19:15:14.910 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2023-08-31T19:15:14.911 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-31T19:15:14.911 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-08-31T19:15:14.911 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T19:15:14.911 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-31T19:15:14.912 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-31T19:15:14.912 INFO:teuthology.provision.fog.smithi089:Deploy complete! 2023-08-31T19:15:14.912 DEBUG:teuthology.parallel:result is None 2023-08-31T19:15:15.077 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com 2023-08-31T19:15:15.078 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-31T19:15:15.104 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com 2023-08-31T19:15:15.104 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-31T19:15:15.121 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server 2023-08-31T19:15:15.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-08-31T19:15:15.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:15:15.218 DEBUG:teuthology.orchestra.run.smithi019:> true 2023-08-31T19:15:15.294 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-08-31T19:15:15.294 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2023-08-31T19:15:15.351 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2023-08-31T19:15:15.351 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2023-08-31T19:15:15.408 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2023-08-31T19:15:15.408 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2023-08-31T19:15:15.408 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2023-08-31T19:15:15.409 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2023-08-31T19:15:15.409 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2023-08-31T19:15:15.409 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2023-08-31T19:15:15.409 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-31T19:15:15.409 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2023-08-31T19:15:15.410 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2023-08-31T19:15:15.410 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-31T19:15:15.410 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2023-08-31T19:15:15.410 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T19:15:15.410 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-31T19:15:15.411 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-31T19:15:15.411 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2023-08-31T19:15:15.429 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server 2023-08-31T19:15:15.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-08-31T19:15:15.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:15:15.512 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-08-31T19:15:15.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-08-31T19:15:15.585 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-08-31T19:15:15.640 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-08-31T19:15:15.640 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-08-31T19:15:15.694 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-08-31T19:15:15.695 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2023-08-31T19:15:15.695 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-08-31T19:15:15.695 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-08-31T19:15:15.695 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2023-08-31T19:15:15.696 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2023-08-31T19:15:15.696 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-31T19:15:15.696 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-08-31T19:15:15.696 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2023-08-31T19:15:15.696 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-31T19:15:15.697 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-08-31T19:15:15.697 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T19:15:15.697 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-31T19:15:15.697 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-31T19:15:15.698 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-08-31T19:15:15.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T19:15:15.901 INFO:teuthology.dispatcher.supervisor:Running job 7385827 2023-08-31T19:15:15.985 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385827 --name pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}} -- /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385827/orig.config.yaml 2023-08-31T19:15:15.989 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385827 2023-08-31T19:15:15.989 INFO:teuthology.dispatcher.supervisor:Job PID: 2371803 2023-08-31T19:15:15.990 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-31T19:17:16.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T19:17:16.161 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-31T19:17:16.276 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-31T19:17:16.277 INFO:teuthology.nuke:Checking targets against current locks 2023-08-31T19:17:16.331 DEBUG:teuthology.nuke:shortname: smithi019 2023-08-31T19:17:16.331 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T19:17:16.346 DEBUG:teuthology.nuke:shortname: smithi089 2023-08-31T19:17:16.346 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T19:17:16.350 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385827', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 19:10:29.650233', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFSOtSrJ4LDiNzjUEsBjjIVGHzWpYFnyNsaT/I3qdL+F509JWlTFTVvU4yVXp/4NPL6BMYqGGF63YQLmyQjC7EI='} 2023-08-31T19:17:16.376 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385827', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 19:10:29.652137', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOadsoT4Q5RhSA7X+lvz4g/q8VuSdDzIrnCiB/T3990UmnbBcZdDgMhCv0TA2gdS+EOmVAcHCHdd4m243nvq6vc='} 2023-08-31T19:17:16.404 INFO:teuthology.orchestra.console.smithi019:Power off 2023-08-31T19:17:16.405 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T19:17:16.421 INFO:teuthology.orchestra.console.smithi089:Power off 2023-08-31T19:17:16.422 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T19:17:16.430 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2023-08-31T19:17:16.431 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:17:16.441 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-08-31T19:17:16.443 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:17:16.452 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-08-31T19:17:16.463 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-08-31T19:17:16.554 INFO:teuthology.orchestra.console.smithi019:Power off completed 2023-08-31T19:17:16.564 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-08-31T19:17:16.702 INFO:teuthology.lock.ops:unlocked: smithi019.front.sepia.ceph.com 2023-08-31T19:17:16.709 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com