2024-03-20T18:31:28.086 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-20T18:31:28.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T18:31:28.255 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ffb66451f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ffb673b3c10>, signals=[15])
2024-03-20T18:31:28.256 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging
2024-03-20T18:31:28.256 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server
2024-03-20T18:31:28.256 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2024-03-20T18:31:28.273 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging
2024-03-20T18:31:28.273 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server
2024-03-20T18:31:28.273 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server
2024-03-20T18:31:28.298 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging
2024-03-20T18:31:28.298 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server
2024-03-20T18:31:28.298 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server
2024-03-20T18:31:28.404 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_centos_9.stream (ID 10)
2024-03-20T18:31:28.410 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_centos_9.stream (ID 10)
2024-03-20T18:31:28.428 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_centos_9.stream (ID 10)
2024-03-20T18:31:28.453 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of centos 9.stream
2024-03-20T18:31:28.456 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 9.stream
2024-03-20T18:31:28.473 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of centos 9.stream
2024-03-20T18:31:28.743 INFO:teuthology.orchestra.console.smithi118:Power off
2024-03-20T18:31:28.744 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-20T18:31:28.756 INFO:teuthology.orchestra.console.smithi151:Power off
2024-03-20T18:31:28.756 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-20T18:31:28.769 INFO:teuthology.orchestra.console.smithi043:Power off
2024-03-20T18:31:28.769 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-20T18:31:28.776 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off
2024-03-20T18:31:28.777 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:28.785 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off
2024-03-20T18:31:28.785 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:28.793 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off
2024-03-20T18:31:28.793 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:28.802 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on
2024-03-20T18:31:28.806 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2024-03-20T18:31:28.815 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on
2024-03-20T18:31:32.806 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:32.813 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:32.819 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:32.916 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on
2024-03-20T18:31:32.922 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2024-03-20T18:31:32.928 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on
2024-03-20T18:31:36.921 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:36.929 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:36.936 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:37.032 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off
2024-03-20T18:31:37.038 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2024-03-20T18:31:37.046 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2024-03-20T18:31:37.133 INFO:teuthology.orchestra.console.smithi118:Power off completed
2024-03-20T18:31:37.139 INFO:teuthology.orchestra.console.smithi151:Power off completed
2024-03-20T18:31:37.146 INFO:teuthology.orchestra.console.smithi043:Power off completed
2024-03-20T18:31:37.235 INFO:teuthology.orchestra.console.smithi118:Power on
2024-03-20T18:31:37.235 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-20T18:31:37.243 INFO:teuthology.orchestra.console.smithi151:Power on
2024-03-20T18:31:37.243 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-20T18:31:37.250 INFO:teuthology.orchestra.console.smithi043:Power on
2024-03-20T18:31:37.250 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-20T18:31:37.258 DEBUG:teuthology.orchestra.console.smithi118:power on output: Chassis Power Control: Up/On
2024-03-20T18:31:37.259 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:37.268 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On
2024-03-20T18:31:37.268 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:37.277 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On
2024-03-20T18:31:37.277 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:37.287 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off
2024-03-20T18:31:37.290 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2024-03-20T18:31:37.299 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2024-03-20T18:31:41.290 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:41.298 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:41.305 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:41.400 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off
2024-03-20T18:31:41.407 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2024-03-20T18:31:41.415 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2024-03-20T18:31:45.401 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:45.408 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:45.416 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-20T18:31:45.511 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on
2024-03-20T18:31:45.517 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2024-03-20T18:31:45.612 INFO:teuthology.orchestra.console.smithi118:Power on completed
2024-03-20T18:31:45.617 INFO:teuthology.orchestra.console.smithi151:Power on completed
2024-03-20T18:31:45.642 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on
2024-03-20T18:31:45.713 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish
2024-03-20T18:31:45.718 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish
2024-03-20T18:31:45.742 INFO:teuthology.orchestra.console.smithi043:Power on completed
2024-03-20T18:31:45.843 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2024-03-20T18:34:16.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:34:19.870 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-03-20T18:34:25.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:34:28.958 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-03-20T18:34:31.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:34:34.942 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-03-20T18:34:34.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:34:38.014 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-03-20T18:34:40.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:34:43.998 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-03-20T18:34:44.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:34:46.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:34:47.070 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-03-20T18:34:50.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:34:50.018 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-03-20T18:34:53.058 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-03-20T18:34:53.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:34:56.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:34:56.126 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2024-03-20T18:34:59.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:34:59.106 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-03-20T18:35:02.114 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-03-20T18:35:02.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:35:05.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:35:08.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:35:08.190 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-03-20T18:35:11.198 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-03-20T18:35:14.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:35:17.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:35:17.246 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-03-20T18:35:20.254 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-03-20T18:35:23.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:35:26.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:35:26.306 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-03-20T18:35:29.310 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-03-20T18:35:32.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:35:35.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:35:35.390 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-03-20T18:35:41.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:35:44.450 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-03-20T18:35:50.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:35:53.534 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-03-20T18:35:59.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:36:02.130 WARNING:teuthology.provision.fog.smithi043:timed out
2024-03-20T18:36:08.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:36:08.544 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-20T18:36:08.544 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-20T18:36:08.872 INFO:teuthology.provision.fog.smithi043:Node is ready
2024-03-20T18:36:08.872 DEBUG:teuthology.orchestra.run.smithi043:> hostname
2024-03-20T18:36:08.887 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2024-03-20T18:36:08.888 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts
2024-03-20T18:36:08.943 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2024-03-20T18:36:08.943 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2024-03-20T18:36:09.057 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts
2024-03-20T18:36:09.088 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts
2024-03-20T18:36:09.159 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname
2024-03-20T18:36:09.229 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2024-03-20T18:36:09.300 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2024-03-20T18:36:09.356 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream"
2024-03-20T18:36:09.356 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9"
2024-03-20T18:36:09.356 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos"
2024-03-20T18:36:09.356 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora"
2024-03-20T18:36:09.356 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9"
2024-03-20T18:36:09.356 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9"
2024-03-20T18:36:09.356 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T18:36:09.356 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2024-03-20T18:36:09.356 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon"
2024-03-20T18:36:09.356 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T18:36:09.357 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/"
2024-03-20T18:36:09.357 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T18:36:09.357 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T18:36:09.357 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T18:36:09.357 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2024-03-20T18:36:09.359 DEBUG:teuthology.parallel:result is None
2024-03-20T18:36:35.342 WARNING:teuthology.provision.fog.smithi151:timed out
2024-03-20T18:36:41.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:36:41.600 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-20T18:36:41.601 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-20T18:36:41.924 INFO:teuthology.provision.fog.smithi151:Node is ready
2024-03-20T18:36:41.925 DEBUG:teuthology.orchestra.run.smithi151:> hostname
2024-03-20T18:36:41.942 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com
2024-03-20T18:36:41.942 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts
2024-03-20T18:36:41.997 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151
2024-03-20T18:36:41.997 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2024-03-20T18:36:42.106 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts
2024-03-20T18:36:42.133 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts
2024-03-20T18:36:42.201 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname
2024-03-20T18:36:42.268 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2024-03-20T18:36:42.335 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release
2024-03-20T18:36:42.389 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream"
2024-03-20T18:36:42.389 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9"
2024-03-20T18:36:42.390 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos"
2024-03-20T18:36:42.390 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora"
2024-03-20T18:36:42.390 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9"
2024-03-20T18:36:42.390 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9"
2024-03-20T18:36:42.390 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T18:36:42.390 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31"
2024-03-20T18:36:42.390 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon"
2024-03-20T18:36:42.390 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T18:36:42.390 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/"
2024-03-20T18:36:42.390 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T18:36:42.390 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T18:36:42.390 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T18:36:42.391 INFO:teuthology.provision.fog.smithi151:Deploy complete!
2024-03-20T18:36:42.391 DEBUG:teuthology.parallel:result is None
2024-03-20T18:36:59.554 WARNING:teuthology.provision.fog.smithi118:timed out
2024-03-20T18:37:05.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:37:05.790 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-20T18:37:05.790 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-20T18:37:06.136 INFO:teuthology.provision.fog.smithi118:Node is ready
2024-03-20T18:37:06.136 DEBUG:teuthology.orchestra.run.smithi118:> hostname
2024-03-20T18:37:06.150 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com
2024-03-20T18:37:06.151 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi118.front.sepia.ceph.com /etc/hosts
2024-03-20T18:37:06.206 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118
2024-03-20T18:37:06.206 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118
2024-03-20T18:37:06.325 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hosts
2024-03-20T18:37:06.353 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts
2024-03-20T18:37:06.421 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hostname
2024-03-20T18:37:06.489 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118
2024-03-20T18:37:06.554 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release
2024-03-20T18:37:06.609 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream"
2024-03-20T18:37:06.609 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9"
2024-03-20T18:37:06.609 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos"
2024-03-20T18:37:06.609 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora"
2024-03-20T18:37:06.609 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9"
2024-03-20T18:37:06.609 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9"
2024-03-20T18:37:06.609 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T18:37:06.609 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31"
2024-03-20T18:37:06.609 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon"
2024-03-20T18:37:06.610 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T18:37:06.610 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/"
2024-03-20T18:37:06.610 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T18:37:06.610 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T18:37:06.610 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T18:37:06.610 INFO:teuthology.provision.fog.smithi118:Deploy complete!
2024-03-20T18:37:06.611 DEBUG:teuthology.parallel:result is None
2024-03-20T18:37:06.827 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com
2024-03-20T18:37:06.827 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-20T18:37:06.852 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com
2024-03-20T18:37:06.853 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-20T18:37:06.877 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com
2024-03-20T18:37:06.877 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-20T18:37:06.904 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server
2024-03-20T18:37:06.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2024-03-20T18:37:06.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:37:07.012 DEBUG:teuthology.orchestra.run.smithi043:> true
2024-03-20T18:37:07.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com'
2024-03-20T18:37:07.193 DEBUG:teuthology.orchestra.run.smithi043:> uname -m
2024-03-20T18:37:07.248 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64
2024-03-20T18:37:07.249 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2024-03-20T18:37:07.304 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream"
2024-03-20T18:37:07.304 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9"
2024-03-20T18:37:07.304 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos"
2024-03-20T18:37:07.304 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora"
2024-03-20T18:37:07.304 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9"
2024-03-20T18:37:07.304 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9"
2024-03-20T18:37:07.304 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T18:37:07.304 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2024-03-20T18:37:07.304 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon"
2024-03-20T18:37:07.305 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T18:37:07.305 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/"
2024-03-20T18:37:07.305 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T18:37:07.305 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T18:37:07.305 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T18:37:07.305 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2024-03-20T18:37:07.328 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server
2024-03-20T18:37:07.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com'
2024-03-20T18:37:07.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:37:07.419 DEBUG:teuthology.orchestra.run.smithi118:> true
2024-03-20T18:37:07.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com'
2024-03-20T18:37:07.489 DEBUG:teuthology.orchestra.run.smithi118:> uname -m
2024-03-20T18:37:07.543 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64
2024-03-20T18:37:07.543 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release
2024-03-20T18:37:07.598 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream"
2024-03-20T18:37:07.598 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9"
2024-03-20T18:37:07.598 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos"
2024-03-20T18:37:07.598 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora"
2024-03-20T18:37:07.598 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9"
2024-03-20T18:37:07.598 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9"
2024-03-20T18:37:07.598 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T18:37:07.598 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31"
2024-03-20T18:37:07.598 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon"
2024-03-20T18:37:07.598 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T18:37:07.599 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/"
2024-03-20T18:37:07.599 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T18:37:07.599 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T18:37:07.599 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T18:37:07.599 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server
2024-03-20T18:37:07.627 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server
2024-03-20T18:37:07.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com'
2024-03-20T18:37:07.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-20T18:37:07.719 DEBUG:teuthology.orchestra.run.smithi151:> true
2024-03-20T18:37:07.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com'
2024-03-20T18:37:07.885 DEBUG:teuthology.orchestra.run.smithi151:> uname -m
2024-03-20T18:37:07.940 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64
2024-03-20T18:37:07.941 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release
2024-03-20T18:37:07.995 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream"
2024-03-20T18:37:07.995 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9"
2024-03-20T18:37:07.995 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos"
2024-03-20T18:37:07.995 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora"
2024-03-20T18:37:07.995 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9"
2024-03-20T18:37:07.995 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9"
2024-03-20T18:37:07.995 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-20T18:37:07.995 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31"
2024-03-20T18:37:07.996 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon"
2024-03-20T18:37:07.996 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-20T18:37:07.996 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/"
2024-03-20T18:37:07.996 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-20T18:37:07.996 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-20T18:37:07.996 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-20T18:37:07.996 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server
2024-03-20T18:37:08.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T18:37:08.126 INFO:teuthology.dispatcher.supervisor:Running job 7612919
2024-03-20T18:37:08.126 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7612919 --name pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/test_o_trunc}} -- /home/teuthworker/archive/pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7612919/orig.config.yaml
2024-03-20T18:37:08.129 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-20_18:16:52-fs-wip-batrick-testing-20240320.145742-distro-default-smithi/7612919
2024-03-20T18:37:08.130 INFO:teuthology.dispatcher.supervisor:Job PID: 3605924
2024-03-20T18:37:08.130 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-20T18:39:08.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T18:41:08.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T18:43:08.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T18:45:08.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T18:47:08.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T18:49:09.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T18:51:09.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T18:53:09.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T18:55:09.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T18:57:09.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T18:59:09.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:01:10.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:03:10.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:05:10.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:07:10.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:09:10.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:11:10.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:13:11.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:15:11.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:17:11.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:19:11.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:21:11.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-20T19:21:11.951 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1