2024-03-20T21:52:36.425 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-20T21:52:36.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:52:36.603 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe6a76acc10>, signals=[15]) 2024-03-20T21:52:36.603 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2024-03-20T21:52:36.603 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2024-03-20T21:52:36.603 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-03-20T21:52:36.625 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging 2024-03-20T21:52:36.626 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server 2024-03-20T21:52:36.626 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-03-20T21:52:36.650 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging 2024-03-20T21:52:36.650 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server 2024-03-20T21:52:36.650 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-03-20T21:52:36.725 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_centos_9.stream (ID 10) 2024-03-20T21:52:36.771 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_centos_9.stream (ID 10) 2024-03-20T21:52:36.774 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of centos 9.stream 2024-03-20T21:52:36.777 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_centos_9.stream (ID 10) 2024-03-20T21:52:36.811 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of centos 9.stream 2024-03-20T21:52:36.814 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of centos 9.stream 2024-03-20T21:52:37.073 INFO:teuthology.orchestra.console.smithi038:Power off 2024-03-20T21:52:37.073 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-20T21:52:37.094 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2024-03-20T21:52:37.094 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T21:52:37.115 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-03-20T21:52:37.124 INFO:teuthology.orchestra.console.smithi092:Power off 2024-03-20T21:52:37.124 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-20T21:52:37.137 INFO:teuthology.orchestra.console.smithi177:Power off 2024-03-20T21:52:37.137 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-20T21:52:37.147 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2024-03-20T21:52:37.147 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T21:52:37.157 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2024-03-20T21:52:37.157 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T21:52:37.168 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2024-03-20T21:52:37.178 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-03-20T21:52:37.216 INFO:teuthology.orchestra.console.smithi038:Power off completed 2024-03-20T21:52:37.269 INFO:teuthology.orchestra.console.smithi092:Power off completed 2024-03-20T21:52:37.278 INFO:teuthology.orchestra.console.smithi177:Power off completed 2024-03-20T21:52:37.317 INFO:teuthology.orchestra.console.smithi038:Power on 2024-03-20T21:52:37.318 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-20T21:52:37.341 DEBUG:teuthology.orchestra.console.smithi038:power on output: Chassis Power Control: Up/On 2024-03-20T21:52:37.341 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T21:52:37.364 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-03-20T21:52:37.370 INFO:teuthology.orchestra.console.smithi092:Power on 2024-03-20T21:52:37.370 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-20T21:52:37.379 INFO:teuthology.orchestra.console.smithi177:Power on 2024-03-20T21:52:37.379 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-20T21:52:37.391 DEBUG:teuthology.orchestra.console.smithi092:power on output: Chassis Power Control: Up/On 2024-03-20T21:52:37.391 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T21:52:37.400 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On 2024-03-20T21:52:37.400 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T21:52:37.413 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2024-03-20T21:52:37.425 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-03-20T21:52:41.366 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T21:52:41.414 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T21:52:41.426 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T21:52:41.475 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-03-20T21:52:41.523 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2024-03-20T21:52:41.534 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-03-20T21:52:41.577 INFO:teuthology.orchestra.console.smithi038:Power on completed 2024-03-20T21:52:41.677 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2024-03-20T21:52:45.528 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T21:52:45.535 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T21:52:45.637 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2024-03-20T21:52:45.644 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-03-20T21:52:45.738 INFO:teuthology.orchestra.console.smithi092:Power on completed 2024-03-20T21:52:45.744 INFO:teuthology.orchestra.console.smithi177:Power on completed 2024-03-20T21:52:45.839 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2024-03-20T21:52:45.845 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish 2024-03-20T21:55:12.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:55:15.902 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-03-20T21:55:16.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:55:19.998 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-20T21:55:21.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:55:24.958 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-03-20T21:55:26.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:55:29.054 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-20T21:55:30.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:55:31.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:55:34.014 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-03-20T21:55:35.038 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-20T21:55:35.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:55:38.114 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-20T21:55:40.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:55:41.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:55:43.070 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-03-20T21:55:44.098 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-20T21:55:44.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:55:47.166 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-20T21:55:49.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:55:50.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:55:52.126 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-03-20T21:55:53.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:55:53.182 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-20T21:55:56.222 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-20T21:55:58.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:55:59.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:56:01.182 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-03-20T21:56:02.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:56:02.238 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-20T21:56:05.278 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-20T21:56:07.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:56:08.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:56:11.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:56:11.294 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-20T21:56:17.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:56:20.354 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-20T21:56:26.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:57:07.227 WARNING:teuthology.provision.fog.smithi038:timed out 2024-03-20T21:57:11.289 WARNING:teuthology.provision.fog.smithi092:timed out 2024-03-20T21:57:13.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:57:13.501 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-20T21:57:13.502 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-20T21:57:13.828 INFO:teuthology.provision.fog.smithi038:Node is ready 2024-03-20T21:57:13.828 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2024-03-20T21:57:13.843 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2024-03-20T21:57:13.844 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2024-03-20T21:57:13.900 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2024-03-20T21:57:13.900 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2024-03-20T21:57:14.026 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2024-03-20T21:57:14.058 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2024-03-20T21:57:14.129 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2024-03-20T21:57:14.200 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2024-03-20T21:57:14.270 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-03-20T21:57:14.325 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2024-03-20T21:57:14.325 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="9" 2024-03-20T21:57:14.325 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2024-03-20T21:57:14.325 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2024-03-20T21:57:14.325 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="9" 2024-03-20T21:57:14.325 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el9" 2024-03-20T21:57:14.325 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T21:57:14.325 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-03-20T21:57:14.325 INFO:teuthology.orchestra.run.smithi038.stdout:LOGO="fedora-logo-icon" 2024-03-20T21:57:14.326 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T21:57:14.326 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2024-03-20T21:57:14.326 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T21:57:14.326 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T21:57:14.326 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T21:57:14.327 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2024-03-20T21:57:14.328 DEBUG:teuthology.parallel:result is None 2024-03-20T21:57:17.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:57:17.492 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-20T21:57:17.493 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-20T21:57:17.819 INFO:teuthology.provision.fog.smithi092:Node is ready 2024-03-20T21:57:17.820 DEBUG:teuthology.orchestra.run.smithi092:> hostname 2024-03-20T21:57:17.835 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com 2024-03-20T21:57:17.835 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts 2024-03-20T21:57:17.891 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092 2024-03-20T21:57:17.891 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2024-03-20T21:57:17.995 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts 2024-03-20T21:57:18.023 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts 2024-03-20T21:57:18.090 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname 2024-03-20T21:57:18.158 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2024-03-20T21:57:18.224 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-03-20T21:57:18.278 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-03-20T21:57:18.278 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-03-20T21:57:18.278 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-03-20T21:57:18.278 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-03-20T21:57:18.279 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-03-20T21:57:18.279 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-03-20T21:57:18.279 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T21:57:18.279 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-03-20T21:57:18.279 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-03-20T21:57:18.279 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T21:57:18.279 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-03-20T21:57:18.279 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T21:57:18.279 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T21:57:18.279 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T21:57:18.279 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2024-03-20T21:57:18.280 DEBUG:teuthology.parallel:result is None 2024-03-20T21:57:26.369 WARNING:teuthology.provision.fog.smithi177:timed out 2024-03-20T21:57:32.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:57:32.695 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-20T21:57:32.695 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-20T21:57:33.026 INFO:teuthology.provision.fog.smithi177:Node is ready 2024-03-20T21:57:33.026 DEBUG:teuthology.orchestra.run.smithi177:> hostname 2024-03-20T21:57:33.040 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com 2024-03-20T21:57:33.041 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts 2024-03-20T21:57:33.096 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177 2024-03-20T21:57:33.096 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2024-03-20T21:57:33.211 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts 2024-03-20T21:57:33.239 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts 2024-03-20T21:57:33.307 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname 2024-03-20T21:57:33.373 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2024-03-20T21:57:33.439 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-03-20T21:57:33.494 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-03-20T21:57:33.494 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-03-20T21:57:33.494 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-03-20T21:57:33.494 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-03-20T21:57:33.494 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-03-20T21:57:33.494 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-03-20T21:57:33.494 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T21:57:33.494 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-03-20T21:57:33.495 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-03-20T21:57:33.495 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T21:57:33.495 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-03-20T21:57:33.495 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T21:57:33.495 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T21:57:33.495 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T21:57:33.495 INFO:teuthology.provision.fog.smithi177:Deploy complete! 2024-03-20T21:57:33.495 DEBUG:teuthology.parallel:result is None 2024-03-20T21:57:33.711 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2024-03-20T21:57:33.712 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-20T21:57:33.731 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com 2024-03-20T21:57:33.731 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-20T21:57:33.747 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com 2024-03-20T21:57:33.748 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-20T21:57:33.765 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2024-03-20T21:57:33.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-03-20T21:57:33.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:57:33.869 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-03-20T21:57:34.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-03-20T21:57:34.049 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2024-03-20T21:57:34.103 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2024-03-20T21:57:34.104 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-03-20T21:57:34.159 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2024-03-20T21:57:34.159 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="9" 2024-03-20T21:57:34.159 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2024-03-20T21:57:34.159 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2024-03-20T21:57:34.159 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="9" 2024-03-20T21:57:34.160 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el9" 2024-03-20T21:57:34.160 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T21:57:34.160 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2024-03-20T21:57:34.160 INFO:teuthology.orchestra.run.smithi038.stdout:LOGO="fedora-logo-icon" 2024-03-20T21:57:34.160 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T21:57:34.160 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2024-03-20T21:57:34.160 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T21:57:34.160 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T21:57:34.160 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T21:57:34.161 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-03-20T21:57:34.181 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server 2024-03-20T21:57:34.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-03-20T21:57:34.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:57:34.266 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-03-20T21:57:34.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-03-20T21:57:34.432 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-03-20T21:57:34.486 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-03-20T21:57:34.486 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-03-20T21:57:34.540 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-03-20T21:57:34.540 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-03-20T21:57:34.540 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-03-20T21:57:34.540 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-03-20T21:57:34.540 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-03-20T21:57:34.540 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-03-20T21:57:34.540 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T21:57:34.540 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-03-20T21:57:34.540 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-03-20T21:57:34.540 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T21:57:34.540 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-03-20T21:57:34.540 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T21:57:34.540 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T21:57:34.541 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T21:57:34.541 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-03-20T21:57:34.573 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server 2024-03-20T21:57:34.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-03-20T21:57:34.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T21:57:34.668 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-03-20T21:57:34.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-03-20T21:57:34.738 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-03-20T21:57:34.793 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-03-20T21:57:34.793 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-03-20T21:57:34.848 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-03-20T21:57:34.849 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-03-20T21:57:34.849 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-03-20T21:57:34.849 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-03-20T21:57:34.849 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-03-20T21:57:34.849 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-03-20T21:57:34.849 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T21:57:34.849 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-03-20T21:57:34.849 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-03-20T21:57:34.849 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T21:57:34.849 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-03-20T21:57:34.849 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T21:57:34.849 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T21:57:34.849 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T21:57:34.850 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-03-20T21:57:34.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T21:57:34.967 INFO:teuthology.dispatcher.supervisor:Running job 7613063 2024-03-20T21:57:34.967 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7613063 --name pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7613063/orig.config.yaml 2024-03-20T21:57:34.970 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7613063 2024-03-20T21:57:34.971 INFO:teuthology.dispatcher.supervisor:Job PID: 455802 2024-03-20T21:57:34.971 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-20T21:59:34.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:01:35.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:03:35.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:05:35.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:07:35.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:09:35.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:11:35.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:13:35.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:15:35.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:17:35.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:19:35.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:21:35.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:23:35.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:25:35.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:27:36.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:29:36.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:31:36.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:33:36.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:35:36.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:37:36.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:39:36.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:41:36.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:43:36.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:45:36.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:47:36.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T22:47:36.968 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1