2024-03-01T18:20:10.580 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-03-01T18:20:10.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:20:10.754 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fddfc84bf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fddfd7eac10>, signals=[15])
2024-03-01T18:20:10.755 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2024-03-01T18:20:10.755 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2024-03-01T18:20:10.755 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-03-01T18:20:10.772 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging
2024-03-01T18:20:10.772 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server
2024-03-01T18:20:10.772 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2024-03-01T18:20:10.797 INFO:teuthology.lock.ops:Start node 'smithi165.front.sepia.ceph.com' reimaging
2024-03-01T18:20:10.797 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: reset os type and version on server
2024-03-01T18:20:10.797 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2024-03-01T18:20:10.892 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_9.stream (ID 10)
2024-03-01T18:20:10.909 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_centos_9.stream (ID 10)
2024-03-01T18:20:10.935 DEBUG:teuthology.provision.fog.smithi165:Requesting image smithi_centos_9.stream (ID 10)
2024-03-01T18:20:10.939 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 9.stream
2024-03-01T18:20:10.956 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of centos 9.stream
2024-03-01T18:20:10.978 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 9.stream
2024-03-01T18:20:11.158 INFO:teuthology.orchestra.console.smithi119:Power off
2024-03-01T18:20:11.158 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-01T18:20:11.183 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2024-03-01T18:20:11.183 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:11.197 INFO:teuthology.orchestra.console.smithi149:Power off
2024-03-01T18:20:11.197 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-01T18:20:11.206 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-03-01T18:20:11.216 INFO:teuthology.orchestra.console.smithi165:Power off
2024-03-01T18:20:11.217 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-01T18:20:11.224 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off
2024-03-01T18:20:11.225 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:11.238 DEBUG:teuthology.orchestra.console.smithi165:power off output: Chassis Power Control: Down/Off
2024-03-01T18:20:11.239 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:11.259 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-03-01T18:20:11.260 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-03-01T18:20:15.208 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:15.260 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:15.268 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:15.317 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-03-01T18:20:15.370 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-03-01T18:20:15.377 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-03-01T18:20:19.319 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:19.371 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:19.378 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:19.428 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-03-01T18:20:19.480 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-03-01T18:20:19.486 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off
2024-03-01T18:20:19.587 INFO:teuthology.orchestra.console.smithi165:Power off completed
2024-03-01T18:20:19.687 INFO:teuthology.orchestra.console.smithi165:Power on
2024-03-01T18:20:19.688 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-01T18:20:19.709 DEBUG:teuthology.orchestra.console.smithi165:power on output: Chassis Power Control: Up/On
2024-03-01T18:20:19.709 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:19.730 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off
2024-03-01T18:20:23.432 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:23.480 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:23.542 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-03-01T18:20:23.589 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-03-01T18:20:23.643 INFO:teuthology.orchestra.console.smithi119:Power off completed
2024-03-01T18:20:23.691 INFO:teuthology.orchestra.console.smithi149:Power off completed
2024-03-01T18:20:23.731 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:23.744 INFO:teuthology.orchestra.console.smithi119:Power on
2024-03-01T18:20:23.745 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-01T18:20:23.765 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On
2024-03-01T18:20:23.765 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:23.784 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-03-01T18:20:23.792 INFO:teuthology.orchestra.console.smithi149:Power on
2024-03-01T18:20:23.792 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-01T18:20:23.815 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On
2024-03-01T18:20:23.815 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:23.836 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-03-01T18:20:23.839 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off
2024-03-01T18:20:27.791 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:27.837 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:27.844 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:27.902 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-03-01T18:20:27.946 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off
2024-03-01T18:20:27.962 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-03-01T18:20:28.003 INFO:teuthology.orchestra.console.smithi119:Power on completed
2024-03-01T18:20:28.063 INFO:teuthology.orchestra.console.smithi165:Power on completed
2024-03-01T18:20:28.104 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2024-03-01T18:20:28.164 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish
2024-03-01T18:20:31.948 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-01T18:20:32.058 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on
2024-03-01T18:20:32.159 INFO:teuthology.orchestra.console.smithi149:Power on completed
2024-03-01T18:20:32.260 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish
2024-03-01T18:23:13.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:13.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:17.020 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-01T18:23:17.021 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-01T18:23:17.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:21.053 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-03-01T18:23:23.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:23.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:26.076 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-01T18:23:26.076 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-01T18:23:27.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:30.108 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-03-01T18:23:32.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:32.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:35.132 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-01T18:23:35.132 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-01T18:23:36.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:39.164 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-03-01T18:23:41.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:41.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:44.188 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-01T18:23:44.188 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-01T18:23:45.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:48.220 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-03-01T18:23:50.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:50.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:53.244 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-01T18:23:53.244 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-01T18:23:54.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:57.276 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-03-01T18:23:59.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:23:59.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:24:02.300 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-01T18:24:02.300 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-03-01T18:24:03.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:24:06.332 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149
2024-03-01T18:24:08.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:24:08.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:24:11.360 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-01T18:24:12.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:24:17.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:24:20.444 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-01T18:24:26.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:25:08.351 WARNING:teuthology.provision.fog.smithi119:timed out
2024-03-01T18:25:12.340 WARNING:teuthology.provision.fog.smithi149:timed out
2024-03-01T18:25:14.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:25:14.692 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-01T18:25:14.693 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-01T18:25:15.017 INFO:teuthology.provision.fog.smithi119:Node is ready
2024-03-01T18:25:15.017 DEBUG:teuthology.orchestra.run.smithi119:> hostname
2024-03-01T18:25:15.032 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com
2024-03-01T18:25:15.032 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts
2024-03-01T18:25:15.085 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2024-03-01T18:25:15.085 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-03-01T18:25:15.210 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts
2024-03-01T18:25:15.238 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts
2024-03-01T18:25:15.305 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname
2024-03-01T18:25:15.372 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-03-01T18:25:15.436 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-03-01T18:25:15.489 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream"
2024-03-01T18:25:15.490 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9"
2024-03-01T18:25:15.490 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos"
2024-03-01T18:25:15.490 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora"
2024-03-01T18:25:15.490 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9"
2024-03-01T18:25:15.490 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9"
2024-03-01T18:25:15.490 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T18:25:15.490 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2024-03-01T18:25:15.490 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon"
2024-03-01T18:25:15.490 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T18:25:15.490 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/"
2024-03-01T18:25:15.490 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T18:25:15.490 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T18:25:15.490 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T18:25:15.491 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2024-03-01T18:25:15.493 DEBUG:teuthology.parallel:result is None
2024-03-01T18:25:18.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:25:18.560 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-01T18:25:18.560 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-01T18:25:18.880 INFO:teuthology.provision.fog.smithi149:Node is ready
2024-03-01T18:25:18.881 DEBUG:teuthology.orchestra.run.smithi149:> hostname
2024-03-01T18:25:18.895 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com
2024-03-01T18:25:18.895 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts
2024-03-01T18:25:18.950 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149
2024-03-01T18:25:18.950 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2024-03-01T18:25:19.066 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts
2024-03-01T18:25:19.094 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts
2024-03-01T18:25:19.161 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname
2024-03-01T18:25:19.228 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149
2024-03-01T18:25:19.294 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2024-03-01T18:25:19.348 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream"
2024-03-01T18:25:19.348 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9"
2024-03-01T18:25:19.348 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos"
2024-03-01T18:25:19.348 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora"
2024-03-01T18:25:19.348 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9"
2024-03-01T18:25:19.348 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9"
2024-03-01T18:25:19.349 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T18:25:19.349 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2024-03-01T18:25:19.349 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon"
2024-03-01T18:25:19.349 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T18:25:19.349 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/"
2024-03-01T18:25:19.349 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T18:25:19.349 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T18:25:19.349 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T18:25:19.349 INFO:teuthology.provision.fog.smithi149:Deploy complete!
2024-03-01T18:25:19.350 DEBUG:teuthology.parallel:result is None
2024-03-01T18:25:26.460 WARNING:teuthology.provision.fog.smithi165:timed out
2024-03-01T18:25:32.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:25:32.738 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-01T18:25:32.739 DEBUG:teuthology.orchestra.run.smithi165:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-01T18:25:33.071 INFO:teuthology.provision.fog.smithi165:Node is ready
2024-03-01T18:25:33.071 DEBUG:teuthology.orchestra.run.smithi165:> hostname
2024-03-01T18:25:33.086 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com
2024-03-01T18:25:33.086 DEBUG:teuthology.orchestra.run.smithi165:> grep smithi165.front.sepia.ceph.com /etc/hosts
2024-03-01T18:25:33.141 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165
2024-03-01T18:25:33.142 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165
2024-03-01T18:25:33.247 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hosts
2024-03-01T18:25:33.274 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/172.21.15.165/172.21.15.165/g' /etc/hosts
2024-03-01T18:25:33.342 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hostname
2024-03-01T18:25:33.409 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165
2024-03-01T18:25:33.475 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release
2024-03-01T18:25:33.529 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream"
2024-03-01T18:25:33.530 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9"
2024-03-01T18:25:33.530 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos"
2024-03-01T18:25:33.530 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora"
2024-03-01T18:25:33.530 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9"
2024-03-01T18:25:33.530 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9"
2024-03-01T18:25:33.530 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T18:25:33.530 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2024-03-01T18:25:33.530 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon"
2024-03-01T18:25:33.530 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T18:25:33.530 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/"
2024-03-01T18:25:33.530 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T18:25:33.530 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T18:25:33.530 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T18:25:33.531 INFO:teuthology.provision.fog.smithi165:Deploy complete!
2024-03-01T18:25:33.531 DEBUG:teuthology.parallel:result is None
2024-03-01T18:25:33.775 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2024-03-01T18:25:33.775 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-01T18:25:33.797 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com
2024-03-01T18:25:33.798 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-01T18:25:33.813 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com
2024-03-01T18:25:33.813 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-01T18:25:33.831 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2024-03-01T18:25:33.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-03-01T18:25:33.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:25:33.921 DEBUG:teuthology.orchestra.run.smithi119:> true
2024-03-01T18:25:34.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-03-01T18:25:34.090 DEBUG:teuthology.orchestra.run.smithi119:> uname -m
2024-03-01T18:25:34.145 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2024-03-01T18:25:34.145 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-03-01T18:25:34.199 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream"
2024-03-01T18:25:34.199 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9"
2024-03-01T18:25:34.199 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos"
2024-03-01T18:25:34.199 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora"
2024-03-01T18:25:34.200 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9"
2024-03-01T18:25:34.200 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9"
2024-03-01T18:25:34.200 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T18:25:34.200 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2024-03-01T18:25:34.200 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon"
2024-03-01T18:25:34.200 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T18:25:34.200 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/"
2024-03-01T18:25:34.200 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T18:25:34.200 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T18:25:34.200 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T18:25:34.201 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-03-01T18:25:34.222 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server
2024-03-01T18:25:34.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com'
2024-03-01T18:25:34.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:25:34.309 DEBUG:teuthology.orchestra.run.smithi149:> true
2024-03-01T18:25:34.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com'
2024-03-01T18:25:34.478 DEBUG:teuthology.orchestra.run.smithi149:> uname -m
2024-03-01T18:25:34.532 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64
2024-03-01T18:25:34.533 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release
2024-03-01T18:25:34.587 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream"
2024-03-01T18:25:34.587 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9"
2024-03-01T18:25:34.587 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos"
2024-03-01T18:25:34.587 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora"
2024-03-01T18:25:34.588 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9"
2024-03-01T18:25:34.588 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9"
2024-03-01T18:25:34.588 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T18:25:34.588 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31"
2024-03-01T18:25:34.588 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon"
2024-03-01T18:25:34.588 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T18:25:34.588 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/"
2024-03-01T18:25:34.588 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T18:25:34.588 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T18:25:34.588 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T18:25:34.589 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server
2024-03-01T18:25:34.614 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server
2024-03-01T18:25:34.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com'
2024-03-01T18:25:34.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-01T18:25:34.700 DEBUG:teuthology.orchestra.run.smithi165:> true
2024-03-01T18:25:34.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com'
2024-03-01T18:25:34.767 DEBUG:teuthology.orchestra.run.smithi165:> uname -m
2024-03-01T18:25:34.822 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64
2024-03-01T18:25:34.823 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release
2024-03-01T18:25:34.877 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream"
2024-03-01T18:25:34.877 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9"
2024-03-01T18:25:34.877 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos"
2024-03-01T18:25:34.877 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora"
2024-03-01T18:25:34.878 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9"
2024-03-01T18:25:34.878 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9"
2024-03-01T18:25:34.878 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-01T18:25:34.878 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2024-03-01T18:25:34.878 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon"
2024-03-01T18:25:34.878 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-01T18:25:34.878 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/"
2024-03-01T18:25:34.878 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-01T18:25:34.878 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-01T18:25:34.878 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-01T18:25:34.879 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2024-03-01T18:25:34.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:25:34.990 INFO:teuthology.dispatcher.supervisor:Running job 7577696
2024-03-01T18:25:34.990 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi/7577696 --name rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/dbench}} -- /home/teuthworker/archive/rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi/7577696/orig.config.yaml
2024-03-01T18:25:34.993 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-03-01_17:28:49-fs-main-2024feb28-testing-default-smithi/7577696
2024-03-01T18:25:34.993 INFO:teuthology.dispatcher.supervisor:Job PID: 2502314
2024-03-01T18:25:34.993 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-01T18:27:35.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:29:35.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:31:35.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:33:35.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:35:35.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:37:35.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:39:36.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:41:36.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:43:36.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:45:36.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:47:36.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:49:36.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:51:37.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:53:37.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:55:37.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:57:37.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T18:59:37.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:01:37.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:03:38.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:05:38.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:07:38.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:09:38.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-01T19:09:38.790 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1