2024-03-15T13:41:34.924 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-15T13:41:34.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:41:35.100 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f7f7f947f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f7f809bbc10>, signals=[15])
2024-03-15T13:41:35.100 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging
2024-03-15T13:41:35.101 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server
2024-03-15T13:41:35.101 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2024-03-15T13:41:35.121 INFO:teuthology.lock.ops:Start node 'smithi106.front.sepia.ceph.com' reimaging
2024-03-15T13:41:35.121 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: reset os type and version on server
2024-03-15T13:41:35.121 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2024-03-15T13:41:35.146 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging
2024-03-15T13:41:35.146 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server
2024-03-15T13:41:35.146 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server
2024-03-15T13:41:35.237 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_centos_9.stream (ID 10)
2024-03-15T13:41:35.263 DEBUG:teuthology.provision.fog.smithi106:Requesting image smithi_centos_9.stream (ID 10)
2024-03-15T13:41:35.266 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_centos_9.stream (ID 10)
2024-03-15T13:41:35.299 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 9.stream
2024-03-15T13:41:35.317 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 9.stream
2024-03-15T13:41:35.328 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of centos 9.stream
2024-03-15T13:41:35.547 INFO:teuthology.orchestra.console.smithi194:Power off
2024-03-15T13:41:35.547 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-15T13:41:35.560 INFO:teuthology.orchestra.console.smithi106:Power off
2024-03-15T13:41:35.561 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-15T13:41:35.571 INFO:teuthology.orchestra.console.smithi066:Power off
2024-03-15T13:41:35.572 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-15T13:41:35.579 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off
2024-03-15T13:41:35.579 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:35.588 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off
2024-03-15T13:41:35.588 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:35.596 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off
2024-03-15T13:41:35.596 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:35.603 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2024-03-15T13:41:35.610 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on
2024-03-15T13:41:35.617 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2024-03-15T13:41:39.609 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:39.616 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:39.622 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:39.717 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2024-03-15T13:41:39.723 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on
2024-03-15T13:41:39.730 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2024-03-15T13:41:43.722 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:43.729 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:43.735 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:43.831 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2024-03-15T13:41:43.837 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off
2024-03-15T13:41:43.844 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2024-03-15T13:41:43.938 INFO:teuthology.orchestra.console.smithi106:Power off completed
2024-03-15T13:41:43.945 INFO:teuthology.orchestra.console.smithi066:Power off completed
2024-03-15T13:41:44.039 INFO:teuthology.orchestra.console.smithi106:Power on
2024-03-15T13:41:44.039 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-15T13:41:44.047 INFO:teuthology.orchestra.console.smithi066:Power on
2024-03-15T13:41:44.048 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-15T13:41:44.061 DEBUG:teuthology.orchestra.console.smithi106:power on output: Chassis Power Control: Up/On
2024-03-15T13:41:44.061 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:44.069 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On
2024-03-15T13:41:44.069 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:44.082 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off
2024-03-15T13:41:44.113 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2024-03-15T13:41:47.836 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:47.944 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2024-03-15T13:41:48.045 INFO:teuthology.orchestra.console.smithi194:Power off completed
2024-03-15T13:41:48.082 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:48.114 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:48.146 INFO:teuthology.orchestra.console.smithi194:Power on
2024-03-15T13:41:48.147 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-15T13:41:48.168 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On
2024-03-15T13:41:48.168 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:48.188 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2024-03-15T13:41:48.190 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off
2024-03-15T13:41:48.222 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2024-03-15T13:41:52.193 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:52.200 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:52.223 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:52.302 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2024-03-15T13:41:52.309 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on
2024-03-15T13:41:52.331 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2024-03-15T13:41:52.410 INFO:teuthology.orchestra.console.smithi106:Power on completed
2024-03-15T13:41:52.431 INFO:teuthology.orchestra.console.smithi066:Power on completed
2024-03-15T13:41:52.511 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish
2024-03-15T13:41:52.532 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish
2024-03-15T13:41:56.307 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T13:41:56.417 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2024-03-15T13:41:56.518 INFO:teuthology.orchestra.console.smithi194:Power on completed
2024-03-15T13:41:56.618 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish
2024-03-15T13:44:23.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:44:27.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:44:41.758 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-03-15T13:44:45.854 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-03-15T13:44:47.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:44:50.814 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-03-15T13:44:51.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:44:54.910 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-03-15T13:44:56.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:44:59.870 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-03-15T13:45:00.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:45:03.969 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-03-15T13:45:05.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:45:08.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:45:08.930 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-03-15T13:45:09.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:45:13.054 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-03-15T13:45:14.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:45:19.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:45:27.074 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-15T13:45:33.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:45:36.158 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-15T13:45:42.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:45:45.246 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-15T13:45:51.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:45:54.334 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-15T13:46:00.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:46:03.390 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-15T13:46:09.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:46:12.478 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-15T13:46:14.939 WARNING:teuthology.provision.fog.smithi106:timed out
2024-03-15T13:46:18.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:46:19.062 WARNING:teuthology.provision.fog.smithi194:timed out
2024-03-15T13:46:20.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:46:21.176 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-15T13:46:21.177 DEBUG:teuthology.orchestra.run.smithi106:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-15T13:46:21.515 INFO:teuthology.provision.fog.smithi106:Node is ready
2024-03-15T13:46:21.515 DEBUG:teuthology.orchestra.run.smithi106:> hostname
2024-03-15T13:46:21.531 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com
2024-03-15T13:46:21.531 DEBUG:teuthology.orchestra.run.smithi106:> grep smithi106.front.sepia.ceph.com /etc/hosts
2024-03-15T13:46:21.534 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-15T13:46:21.587 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106
2024-03-15T13:46:21.587 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106
2024-03-15T13:46:21.693 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hosts
2024-03-15T13:46:21.722 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/172.21.15.106/172.21.15.106/g' /etc/hosts
2024-03-15T13:46:21.790 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hostname
2024-03-15T13:46:21.857 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106
2024-03-15T13:46:21.924 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release
2024-03-15T13:46:21.978 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream"
2024-03-15T13:46:21.978 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9"
2024-03-15T13:46:21.979 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos"
2024-03-15T13:46:21.979 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora"
2024-03-15T13:46:21.979 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9"
2024-03-15T13:46:21.979 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9"
2024-03-15T13:46:21.979 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-15T13:46:21.979 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31"
2024-03-15T13:46:21.979 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon"
2024-03-15T13:46:21.979 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-15T13:46:21.979 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/"
2024-03-15T13:46:21.979 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-15T13:46:21.979 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-15T13:46:21.979 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-15T13:46:21.980 INFO:teuthology.provision.fog.smithi106:Deploy complete!
2024-03-15T13:46:21.981 DEBUG:teuthology.parallel:result is None
2024-03-15T13:46:25.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:46:25.363 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-15T13:46:25.363 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-15T13:46:25.679 INFO:teuthology.provision.fog.smithi194:Node is ready
2024-03-15T13:46:25.680 DEBUG:teuthology.orchestra.run.smithi194:> hostname
2024-03-15T13:46:25.694 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com
2024-03-15T13:46:25.694 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts
2024-03-15T13:46:25.749 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194
2024-03-15T13:46:25.749 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194
2024-03-15T13:46:25.842 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts
2024-03-15T13:46:25.870 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts
2024-03-15T13:46:25.937 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname
2024-03-15T13:46:26.004 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194
2024-03-15T13:46:26.070 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release
2024-03-15T13:46:26.124 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream"
2024-03-15T13:46:26.124 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9"
2024-03-15T13:46:26.124 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos"
2024-03-15T13:46:26.125 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora"
2024-03-15T13:46:26.125 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9"
2024-03-15T13:46:26.125 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9"
2024-03-15T13:46:26.125 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-15T13:46:26.125 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31"
2024-03-15T13:46:26.125 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon"
2024-03-15T13:46:26.125 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-15T13:46:26.125 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/"
2024-03-15T13:46:26.125 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-15T13:46:26.125 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-15T13:46:26.125 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-15T13:46:26.125 INFO:teuthology.provision.fog.smithi194:Deploy complete!
2024-03-15T13:46:26.126 DEBUG:teuthology.parallel:result is None
2024-03-15T13:46:27.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:46:30.590 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-15T13:46:36.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:46:39.646 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-15T13:46:45.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:46:48.702 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2024-03-15T13:46:54.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:47:54.769 WARNING:teuthology.provision.fog.smithi066:timed out
2024-03-15T13:48:00.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:48:01.051 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-15T13:48:01.051 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-15T13:48:01.391 INFO:teuthology.provision.fog.smithi066:Node is ready
2024-03-15T13:48:01.392 DEBUG:teuthology.orchestra.run.smithi066:> hostname
2024-03-15T13:48:01.407 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com
2024-03-15T13:48:01.407 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts
2024-03-15T13:48:01.463 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066
2024-03-15T13:48:01.463 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066
2024-03-15T13:48:01.582 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts
2024-03-15T13:48:01.614 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts
2024-03-15T13:48:01.685 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname
2024-03-15T13:48:01.756 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066
2024-03-15T13:48:01.826 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release
2024-03-15T13:48:01.881 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream"
2024-03-15T13:48:01.881 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9"
2024-03-15T13:48:01.882 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos"
2024-03-15T13:48:01.882 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora"
2024-03-15T13:48:01.882 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9"
2024-03-15T13:48:01.882 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9"
2024-03-15T13:48:01.882 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-15T13:48:01.882 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2024-03-15T13:48:01.882 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon"
2024-03-15T13:48:01.882 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-15T13:48:01.882 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/"
2024-03-15T13:48:01.882 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-15T13:48:01.882 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-15T13:48:01.882 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-15T13:48:01.883 INFO:teuthology.provision.fog.smithi066:Deploy complete!
2024-03-15T13:48:01.883 DEBUG:teuthology.parallel:result is None
2024-03-15T13:48:02.097 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com
2024-03-15T13:48:02.097 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-15T13:48:02.118 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com
2024-03-15T13:48:02.118 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-15T13:48:02.135 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com
2024-03-15T13:48:02.135 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-15T13:48:02.152 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server
2024-03-15T13:48:02.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com'
2024-03-15T13:48:02.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:48:02.257 DEBUG:teuthology.orchestra.run.smithi066:> true
2024-03-15T13:48:02.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com'
2024-03-15T13:48:02.324 DEBUG:teuthology.orchestra.run.smithi066:> uname -m
2024-03-15T13:48:02.379 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64
2024-03-15T13:48:02.379 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release
2024-03-15T13:48:02.434 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream"
2024-03-15T13:48:02.434 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9"
2024-03-15T13:48:02.434 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos"
2024-03-15T13:48:02.434 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora"
2024-03-15T13:48:02.435 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9"
2024-03-15T13:48:02.435 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9"
2024-03-15T13:48:02.435 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-15T13:48:02.435 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2024-03-15T13:48:02.435 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon"
2024-03-15T13:48:02.435 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-15T13:48:02.435 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/"
2024-03-15T13:48:02.435 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-15T13:48:02.435 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-15T13:48:02.435 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-15T13:48:02.436 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2024-03-15T13:48:02.460 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server
2024-03-15T13:48:02.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com'
2024-03-15T13:48:02.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:48:02.546 DEBUG:teuthology.orchestra.run.smithi106:> true
2024-03-15T13:48:02.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com'
2024-03-15T13:48:02.716 DEBUG:teuthology.orchestra.run.smithi106:> uname -m
2024-03-15T13:48:02.771 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64
2024-03-15T13:48:02.772 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release
2024-03-15T13:48:02.826 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream"
2024-03-15T13:48:02.826 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9"
2024-03-15T13:48:02.827 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos"
2024-03-15T13:48:02.827 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora"
2024-03-15T13:48:02.827 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9"
2024-03-15T13:48:02.827 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9"
2024-03-15T13:48:02.827 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-15T13:48:02.827 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31"
2024-03-15T13:48:02.827 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon"
2024-03-15T13:48:02.827 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-15T13:48:02.827 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/"
2024-03-15T13:48:02.827 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-15T13:48:02.827 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-15T13:48:02.827 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-15T13:48:02.828 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2024-03-15T13:48:02.851 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server
2024-03-15T13:48:02.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com'
2024-03-15T13:48:02.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T13:48:02.939 DEBUG:teuthology.orchestra.run.smithi194:> true
2024-03-15T13:48:03.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com'
2024-03-15T13:48:03.108 DEBUG:teuthology.orchestra.run.smithi194:> uname -m
2024-03-15T13:48:03.163 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64
2024-03-15T13:48:03.163 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release
2024-03-15T13:48:03.217 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream"
2024-03-15T13:48:03.217 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9"
2024-03-15T13:48:03.217 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos"
2024-03-15T13:48:03.218 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora"
2024-03-15T13:48:03.218 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9"
2024-03-15T13:48:03.218 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9"
2024-03-15T13:48:03.218 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-15T13:48:03.218 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31"
2024-03-15T13:48:03.218 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon"
2024-03-15T13:48:03.218 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-15T13:48:03.218 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/"
2024-03-15T13:48:03.218 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-15T13:48:03.218 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-15T13:48:03.218 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-15T13:48:03.219 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server
2024-03-15T13:48:03.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:48:03.337 INFO:teuthology.dispatcher.supervisor:Running job 7602215
2024-03-15T13:48:03.337 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602215 --name pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/test_o_trunc}} -- /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602215/orig.config.yaml
2024-03-15T13:48:03.352 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602215
2024-03-15T13:48:03.352 INFO:teuthology.dispatcher.supervisor:Job PID: 1664698
2024-03-15T13:48:03.353 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-15T13:50:03.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:52:03.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:54:03.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:56:03.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T13:58:04.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:00:04.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:02:04.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:04:04.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:06:04.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:08:04.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:10:05.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:12:05.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:14:05.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:16:05.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:18:05.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:20:05.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:22:06.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:24:06.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:26:06.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:28:06.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T14:28:06.638 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1