2024-04-08T05:10:31.229 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-08T05:10:31.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:10:31.389 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f19b29cef40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f19b3a03c10>, signals=[15])
2024-04-08T05:10:31.389 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging
2024-04-08T05:10:31.390 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server
2024-04-08T05:10:31.390 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2024-04-08T05:10:31.409 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging
2024-04-08T05:10:31.409 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server
2024-04-08T05:10:31.409 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-04-08T05:10:31.433 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging
2024-04-08T05:10:31.434 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server
2024-04-08T05:10:31.434 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2024-04-08T05:10:31.533 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_centos_9.stream (ID 10)
2024-04-08T05:10:31.541 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_centos_9.stream (ID 10)
2024-04-08T05:10:31.565 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_centos_9.stream (ID 10)
2024-04-08T05:10:31.582 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 9.stream
2024-04-08T05:10:31.587 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of centos 9.stream
2024-04-08T05:10:31.623 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 9.stream
2024-04-08T05:10:31.849 INFO:teuthology.orchestra.console.smithi113:Power off
2024-04-08T05:10:31.849 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-08T05:10:31.862 INFO:teuthology.orchestra.console.smithi136:Power off
2024-04-08T05:10:31.862 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-08T05:10:31.874 INFO:teuthology.orchestra.console.smithi037:Power off
2024-04-08T05:10:31.874 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-08T05:10:31.882 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off
2024-04-08T05:10:31.883 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:31.890 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off
2024-04-08T05:10:31.891 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:31.899 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off
2024-04-08T05:10:31.899 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:31.907 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on
2024-04-08T05:10:31.912 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2024-04-08T05:10:31.920 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on
2024-04-08T05:10:35.911 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:35.918 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:35.925 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:36.021 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on
2024-04-08T05:10:36.027 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2024-04-08T05:10:36.033 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on
2024-04-08T05:10:40.026 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:40.032 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:40.039 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:40.135 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on
2024-04-08T05:10:40.140 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2024-04-08T05:10:40.149 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on
2024-04-08T05:10:44.140 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:44.147 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:44.154 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:44.249 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-04-08T05:10:44.256 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2024-04-08T05:10:44.262 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off
2024-04-08T05:10:44.350 INFO:teuthology.orchestra.console.smithi113:Power off completed
2024-04-08T05:10:44.356 INFO:teuthology.orchestra.console.smithi136:Power off completed
2024-04-08T05:10:44.364 INFO:teuthology.orchestra.console.smithi037:Power off completed
2024-04-08T05:10:44.451 INFO:teuthology.orchestra.console.smithi113:Power on
2024-04-08T05:10:44.451 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-08T05:10:44.459 INFO:teuthology.orchestra.console.smithi136:Power on
2024-04-08T05:10:44.459 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-08T05:10:44.468 INFO:teuthology.orchestra.console.smithi037:Power on
2024-04-08T05:10:44.468 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-08T05:10:44.480 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On
2024-04-08T05:10:44.481 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:44.488 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On
2024-04-08T05:10:44.488 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:44.495 DEBUG:teuthology.orchestra.console.smithi037:power on output: Chassis Power Control: Up/On
2024-04-08T05:10:44.496 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:44.504 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-04-08T05:10:44.511 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2024-04-08T05:10:44.519 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off
2024-04-08T05:10:48.506 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:48.513 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:48.520 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:48.616 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on
2024-04-08T05:10:48.622 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2024-04-08T05:10:48.629 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on
2024-04-08T05:10:48.717 INFO:teuthology.orchestra.console.smithi113:Power on completed
2024-04-08T05:10:48.730 INFO:teuthology.orchestra.console.smithi037:Power on completed
2024-04-08T05:10:48.819 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish
2024-04-08T05:10:48.831 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish
2024-04-08T05:10:52.627 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:10:52.737 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2024-04-08T05:10:52.837 INFO:teuthology.orchestra.console.smithi136:Power on completed
2024-04-08T05:10:52.938 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2024-04-08T05:13:04.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:13:04.639 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-08T05:13:23.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:13:26.722 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-04-08T05:13:32.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:13:35.778 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-04-08T05:13:41.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:13:44.830 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-04-08T05:13:49.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:13:50.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:13:52.734 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-08T05:13:53.886 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-04-08T05:13:58.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:13:59.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:14:01.797 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-08T05:14:02.942 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-04-08T05:14:07.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:14:08.643 WARNING:teuthology.provision.fog.smithi037:timed out
2024-04-08T05:14:08.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:14:10.878 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-08T05:14:12.002 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-04-08T05:14:14.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:14:16.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:14:18.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:14:19.934 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-08T05:14:21.054 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-04-08T05:14:25.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:14:27.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:14:28.990 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-08T05:14:33.346 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-08T05:14:33.347 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-08T05:14:34.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:14:38.046 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-08T05:14:44.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:14:47.102 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-08T05:14:53.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:14:53.729 INFO:teuthology.provision.fog.smithi037:Node is ready
2024-04-08T05:14:53.730 DEBUG:teuthology.orchestra.run.smithi037:> hostname
2024-04-08T05:14:53.749 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com
2024-04-08T05:14:53.749 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts
2024-04-08T05:14:53.807 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037
2024-04-08T05:14:53.807 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037
2024-04-08T05:14:53.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts
2024-04-08T05:14:53.980 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts
2024-04-08T05:14:54.053 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname
2024-04-08T05:14:54.125 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037
2024-04-08T05:14:54.196 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release
2024-04-08T05:14:54.253 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream"
2024-04-08T05:14:54.253 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9"
2024-04-08T05:14:54.253 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos"
2024-04-08T05:14:54.253 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora"
2024-04-08T05:14:54.253 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9"
2024-04-08T05:14:54.253 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9"
2024-04-08T05:14:54.253 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-08T05:14:54.253 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2024-04-08T05:14:54.253 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon"
2024-04-08T05:14:54.254 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-08T05:14:54.254 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/"
2024-04-08T05:14:54.254 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-08T05:14:54.254 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-08T05:14:54.254 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-08T05:14:54.255 INFO:teuthology.provision.fog.smithi037:Deploy complete!
2024-04-08T05:14:54.256 DEBUG:teuthology.parallel:result is None
2024-04-08T05:15:27.061 WARNING:teuthology.provision.fog.smithi136:timed out
2024-04-08T05:15:33.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:15:33.408 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-08T05:15:33.408 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-08T05:15:33.732 INFO:teuthology.provision.fog.smithi136:Node is ready
2024-04-08T05:15:33.733 DEBUG:teuthology.orchestra.run.smithi136:> hostname
2024-04-08T05:15:33.747 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com
2024-04-08T05:15:33.747 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts
2024-04-08T05:15:33.802 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2024-04-08T05:15:33.803 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2024-04-08T05:15:33.929 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts
2024-04-08T05:15:33.958 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts
2024-04-08T05:15:34.025 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname
2024-04-08T05:15:34.092 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2024-04-08T05:15:34.158 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2024-04-08T05:15:34.213 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream"
2024-04-08T05:15:34.213 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9"
2024-04-08T05:15:34.214 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos"
2024-04-08T05:15:34.214 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora"
2024-04-08T05:15:34.214 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9"
2024-04-08T05:15:34.214 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9"
2024-04-08T05:15:34.214 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-08T05:15:34.214 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2024-04-08T05:15:34.214 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon"
2024-04-08T05:15:34.214 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-08T05:15:34.214 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/"
2024-04-08T05:15:34.214 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-08T05:15:34.214 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-08T05:15:34.214 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-08T05:15:34.215 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2024-04-08T05:15:34.215 DEBUG:teuthology.parallel:result is None
2024-04-08T05:15:53.106 WARNING:teuthology.provision.fog.smithi113:timed out
2024-04-08T05:15:59.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:15:59.428 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-08T05:15:59.428 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-08T05:15:59.768 INFO:teuthology.provision.fog.smithi113:Node is ready
2024-04-08T05:15:59.768 DEBUG:teuthology.orchestra.run.smithi113:> hostname
2024-04-08T05:15:59.783 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113.front.sepia.ceph.com
2024-04-08T05:15:59.783 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113.front.sepia.ceph.com /etc/hosts
2024-04-08T05:15:59.839 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113
2024-04-08T05:15:59.839 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-04-08T05:15:59.935 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hosts
2024-04-08T05:15:59.962 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts
2024-04-08T05:16:00.030 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hostname
2024-04-08T05:16:00.097 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-04-08T05:16:00.163 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-04-08T05:16:00.218 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream"
2024-04-08T05:16:00.218 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9"
2024-04-08T05:16:00.218 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos"
2024-04-08T05:16:00.218 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora"
2024-04-08T05:16:00.218 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9"
2024-04-08T05:16:00.218 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9"
2024-04-08T05:16:00.218 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-08T05:16:00.218 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31"
2024-04-08T05:16:00.219 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon"
2024-04-08T05:16:00.219 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-08T05:16:00.219 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/"
2024-04-08T05:16:00.219 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-08T05:16:00.219 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-08T05:16:00.219 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-08T05:16:00.219 INFO:teuthology.provision.fog.smithi113:Deploy complete!
2024-04-08T05:16:00.220 DEBUG:teuthology.parallel:result is None
2024-04-08T05:16:00.468 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com
2024-04-08T05:16:00.468 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-08T05:16:00.493 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com
2024-04-08T05:16:00.493 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-08T05:16:00.518 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2024-04-08T05:16:00.518 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-08T05:16:00.544 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server
2024-04-08T05:16:00.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com'
2024-04-08T05:16:00.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:16:00.650 DEBUG:teuthology.orchestra.run.smithi037:> true
2024-04-08T05:16:00.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com'
2024-04-08T05:16:00.837 DEBUG:teuthology.orchestra.run.smithi037:> uname -m
2024-04-08T05:16:00.891 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64
2024-04-08T05:16:00.892 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release
2024-04-08T05:16:00.947 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream"
2024-04-08T05:16:00.947 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9"
2024-04-08T05:16:00.947 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos"
2024-04-08T05:16:00.947 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora"
2024-04-08T05:16:00.947 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9"
2024-04-08T05:16:00.947 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9"
2024-04-08T05:16:00.947 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-08T05:16:00.947 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2024-04-08T05:16:00.948 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon"
2024-04-08T05:16:00.948 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-08T05:16:00.948 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/"
2024-04-08T05:16:00.948 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-08T05:16:00.948 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-08T05:16:00.948 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-08T05:16:00.948 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2024-04-08T05:16:00.968 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server
2024-04-08T05:16:00.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-04-08T05:16:00.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:16:01.059 DEBUG:teuthology.orchestra.run.smithi113:> true
2024-04-08T05:16:01.128 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-04-08T05:16:01.128 DEBUG:teuthology.orchestra.run.smithi113:> uname -m
2024-04-08T05:16:01.182 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64
2024-04-08T05:16:01.183 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-04-08T05:16:01.238 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream"
2024-04-08T05:16:01.238 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9"
2024-04-08T05:16:01.238 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos"
2024-04-08T05:16:01.238 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora"
2024-04-08T05:16:01.239 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9"
2024-04-08T05:16:01.239 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9"
2024-04-08T05:16:01.239 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-08T05:16:01.239 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31"
2024-04-08T05:16:01.239 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon"
2024-04-08T05:16:01.239 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-08T05:16:01.239 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/"
2024-04-08T05:16:01.239 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-08T05:16:01.239 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-08T05:16:01.239 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-08T05:16:01.240 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-04-08T05:16:01.260 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2024-04-08T05:16:01.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2024-04-08T05:16:01.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:16:01.348 DEBUG:teuthology.orchestra.run.smithi136:> true
2024-04-08T05:16:01.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com'
2024-04-08T05:16:01.517 DEBUG:teuthology.orchestra.run.smithi136:> uname -m
2024-04-08T05:16:01.572 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2024-04-08T05:16:01.572 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2024-04-08T05:16:01.627 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream"
2024-04-08T05:16:01.627 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9"
2024-04-08T05:16:01.627 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos"
2024-04-08T05:16:01.627 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora"
2024-04-08T05:16:01.627 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9"
2024-04-08T05:16:01.627 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9"
2024-04-08T05:16:01.627 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-08T05:16:01.627 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2024-04-08T05:16:01.627 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon"
2024-04-08T05:16:01.628 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-08T05:16:01.628 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/"
2024-04-08T05:16:01.628 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-08T05:16:01.628 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-08T05:16:01.628 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-08T05:16:01.628 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2024-04-08T05:16:01.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:16:01.745 INFO:teuthology.dispatcher.supervisor:Running job 7645347
2024-04-08T05:16:01.745 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-04-08_04:51:09-fs:workload-wip-64730-testing-default-smithi/7645347 --name vshankar-2024-04-08_04:51:09-fs:workload-wip-64730-testing-default-smithi --description fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/fsx}} -- /home/teuthworker/archive/vshankar-2024-04-08_04:51:09-fs:workload-wip-64730-testing-default-smithi/7645347/orig.config.yaml
2024-04-08T05:16:01.748 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-04-08_04:51:09-fs:workload-wip-64730-testing-default-smithi/7645347
2024-04-08T05:16:01.749 INFO:teuthology.dispatcher.supervisor:Job PID: 2322953
2024-04-08T05:16:01.749 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-08T05:18:01.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:20:01.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:22:01.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:24:01.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:26:02.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:28:02.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:30:02.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:32:02.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:34:02.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:36:02.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:38:02.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:40:02.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:42:02.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:44:02.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:46:02.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:48:02.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:50:02.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:50:03.012 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1