2024-04-17T10:17:31.860 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-17T10:17:31.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T10:17:32.038 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f749b66ef70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f749c6cec10>, signals=[15])
2024-04-17T10:17:32.039 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging
2024-04-17T10:17:32.039 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T10:17:32.039 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2024-04-17T10:17:32.059 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging
2024-04-17T10:17:32.059 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T10:17:32.059 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2024-04-17T10:17:32.084 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging
2024-04-17T10:17:32.084 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T10:17:32.084 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2024-04-17T10:17:32.165 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T10:17:32.196 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T10:17:32.206 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 9.stream
2024-04-17T10:17:32.219 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T10:17:32.250 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 9.stream
2024-04-17T10:17:32.259 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 9.stream
2024-04-17T10:17:32.532 INFO:teuthology.orchestra.console.smithi027:Power off
2024-04-17T10:17:32.533 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T10:17:32.546 INFO:teuthology.orchestra.console.smithi081:Power off
2024-04-17T10:17:32.546 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T10:17:32.558 INFO:teuthology.orchestra.console.smithi145:Power off
2024-04-17T10:17:32.558 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T10:17:32.565 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off
2024-04-17T10:17:32.566 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T10:17:32.573 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2024-04-17T10:17:32.573 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T10:17:32.581 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off
2024-04-17T10:17:32.582 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T10:17:32.590 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-17T10:17:32.595 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2024-04-17T10:17:32.602 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off
2024-04-17T10:17:32.691 INFO:teuthology.orchestra.console.smithi027:Power off completed
2024-04-17T10:17:32.696 INFO:teuthology.orchestra.console.smithi081:Power off completed
2024-04-17T10:17:32.702 INFO:teuthology.orchestra.console.smithi145:Power off completed
2024-04-17T10:17:32.793 INFO:teuthology.orchestra.console.smithi027:Power on
2024-04-17T10:17:32.793 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T10:17:32.801 INFO:teuthology.orchestra.console.smithi081:Power on
2024-04-17T10:17:32.802 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T10:17:32.809 INFO:teuthology.orchestra.console.smithi145:Power on
2024-04-17T10:17:32.809 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T10:17:32.817 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On
2024-04-17T10:17:32.818 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T10:17:32.826 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On
2024-04-17T10:17:32.827 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T10:17:32.835 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On
2024-04-17T10:17:32.836 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T10:17:32.843 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-17T10:17:32.848 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2024-04-17T10:17:32.856 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off
2024-04-17T10:17:36.846 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T10:17:36.853 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T10:17:36.859 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T10:17:36.955 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-17T10:17:36.961 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2024-04-17T10:17:36.967 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off
2024-04-17T10:17:40.960 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T10:17:40.967 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T10:17:40.973 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T10:17:41.069 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-04-17T10:17:41.074 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2024-04-17T10:17:41.170 INFO:teuthology.orchestra.console.smithi027:Power on completed
2024-04-17T10:17:41.176 INFO:teuthology.orchestra.console.smithi081:Power on completed
2024-04-17T10:17:41.186 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-04-17T10:17:41.271 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2024-04-17T10:17:41.277 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2024-04-17T10:17:41.287 INFO:teuthology.orchestra.console.smithi145:Power on completed
2024-04-17T10:17:41.387 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish
2024-04-17T10:20:12.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:20:15.838 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-04-17T10:20:21.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:20:24.894 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-04-17T10:20:30.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:20:33.950 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-04-17T10:20:39.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:20:43.041 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-04-17T10:20:49.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:20:52.126 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-04-17T10:20:58.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:21:01.186 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-04-17T10:21:07.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:21:43.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:21:46.462 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T10:21:52.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:21:55.550 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T10:21:58.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:22:01.502 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-04-17T10:22:01.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:22:04.606 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T10:22:07.196 WARNING:teuthology.provision.fog.smithi081:timed out
2024-04-17T10:22:07.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:22:10.558 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-04-17T10:22:10.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:22:13.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:22:13.474 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T10:22:13.474 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T10:22:13.662 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T10:22:13.793 INFO:teuthology.provision.fog.smithi081:Node is ready
2024-04-17T10:22:13.793 DEBUG:teuthology.orchestra.run.smithi081:> hostname
2024-04-17T10:22:13.808 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com
2024-04-17T10:22:13.808 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts
2024-04-17T10:22:13.864 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081
2024-04-17T10:22:13.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2024-04-17T10:22:13.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts
2024-04-17T10:22:14.019 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts
2024-04-17T10:22:14.087 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname
2024-04-17T10:22:14.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2024-04-17T10:22:14.221 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2024-04-17T10:22:14.275 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream"
2024-04-17T10:22:14.275 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9"
2024-04-17T10:22:14.275 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos"
2024-04-17T10:22:14.275 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora"
2024-04-17T10:22:14.275 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9"
2024-04-17T10:22:14.275 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9"
2024-04-17T10:22:14.276 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T10:22:14.276 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2024-04-17T10:22:14.276 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon"
2024-04-17T10:22:14.276 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T10:22:14.276 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/"
2024-04-17T10:22:14.276 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T10:22:14.276 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T10:22:14.276 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T10:22:14.277 INFO:teuthology.provision.fog.smithi081:Deploy complete!
2024-04-17T10:22:14.278 DEBUG:teuthology.parallel:result is None
2024-04-17T10:22:16.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:22:19.614 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-04-17T10:22:19.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:22:22.718 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T10:22:25.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:22:28.670 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-04-17T10:22:28.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:22:31.774 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T10:22:34.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:22:37.726 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-04-17T10:22:37.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:22:40.830 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T10:22:43.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:22:46.782 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-04-17T10:22:46.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:22:49.886 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T10:22:52.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:22:55.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:22:58.942 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T10:23:04.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:23:08.030 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-17T10:23:14.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:23:52.828 WARNING:teuthology.provision.fog.smithi145:timed out
2024-04-17T10:23:58.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:23:59.074 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T10:23:59.075 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T10:23:59.418 INFO:teuthology.provision.fog.smithi145:Node is ready
2024-04-17T10:23:59.418 DEBUG:teuthology.orchestra.run.smithi145:> hostname
2024-04-17T10:23:59.433 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com
2024-04-17T10:23:59.433 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts
2024-04-17T10:23:59.488 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145
2024-04-17T10:23:59.489 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145
2024-04-17T10:23:59.602 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts
2024-04-17T10:23:59.631 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts
2024-04-17T10:23:59.699 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname
2024-04-17T10:23:59.766 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145
2024-04-17T10:23:59.833 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release
2024-04-17T10:23:59.887 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream"
2024-04-17T10:23:59.887 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9"
2024-04-17T10:23:59.887 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos"
2024-04-17T10:23:59.888 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora"
2024-04-17T10:23:59.888 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9"
2024-04-17T10:23:59.888 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9"
2024-04-17T10:23:59.888 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T10:23:59.888 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31"
2024-04-17T10:23:59.888 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon"
2024-04-17T10:23:59.888 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T10:23:59.888 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/"
2024-04-17T10:23:59.888 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T10:23:59.888 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T10:23:59.888 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T10:23:59.888 INFO:teuthology.provision.fog.smithi145:Deploy complete!
2024-04-17T10:23:59.889 DEBUG:teuthology.parallel:result is None
2024-04-17T10:24:14.050 WARNING:teuthology.provision.fog.smithi027:timed out
2024-04-17T10:24:20.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:24:20.269 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T10:24:20.270 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T10:24:20.614 INFO:teuthology.provision.fog.smithi027:Node is ready
2024-04-17T10:24:20.614 DEBUG:teuthology.orchestra.run.smithi027:> hostname
2024-04-17T10:24:20.630 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com
2024-04-17T10:24:20.630 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts
2024-04-17T10:24:20.687 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027
2024-04-17T10:24:20.687 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2024-04-17T10:24:20.803 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts
2024-04-17T10:24:20.836 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts
2024-04-17T10:24:20.907 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname
2024-04-17T10:24:20.979 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2024-04-17T10:24:21.049 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2024-04-17T10:24:21.104 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2024-04-17T10:24:21.104 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9"
2024-04-17T10:24:21.104 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2024-04-17T10:24:21.104 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2024-04-17T10:24:21.105 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9"
2024-04-17T10:24:21.105 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9"
2024-04-17T10:24:21.105 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T10:24:21.105 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2024-04-17T10:24:21.105 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon"
2024-04-17T10:24:21.105 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T10:24:21.105 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2024-04-17T10:24:21.105 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T10:24:21.105 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T10:24:21.105 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T10:24:21.105 INFO:teuthology.provision.fog.smithi027:Deploy complete!
2024-04-17T10:24:21.106 DEBUG:teuthology.parallel:result is None
2024-04-17T10:24:21.320 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com
2024-04-17T10:24:21.321 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T10:24:21.347 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com
2024-04-17T10:24:21.347 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T10:24:21.362 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com
2024-04-17T10:24:21.362 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T10:24:21.380 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server
2024-04-17T10:24:21.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2024-04-17T10:24:21.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:24:21.482 DEBUG:teuthology.orchestra.run.smithi027:> true
2024-04-17T10:24:21.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com'
2024-04-17T10:24:21.548 DEBUG:teuthology.orchestra.run.smithi027:> uname -m
2024-04-17T10:24:21.603 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64
2024-04-17T10:24:21.603 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2024-04-17T10:24:21.657 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2024-04-17T10:24:21.657 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9"
2024-04-17T10:24:21.658 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2024-04-17T10:24:21.658 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2024-04-17T10:24:21.658 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9"
2024-04-17T10:24:21.658 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9"
2024-04-17T10:24:21.658 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T10:24:21.658 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2024-04-17T10:24:21.658 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon"
2024-04-17T10:24:21.658 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T10:24:21.658 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2024-04-17T10:24:21.659 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T10:24:21.659 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T10:24:21.659 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T10:24:21.659 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2024-04-17T10:24:21.680 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server
2024-04-17T10:24:21.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2024-04-17T10:24:21.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:24:21.770 DEBUG:teuthology.orchestra.run.smithi081:> true
2024-04-17T10:24:21.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com'
2024-04-17T10:24:21.941 DEBUG:teuthology.orchestra.run.smithi081:> uname -m
2024-04-17T10:24:21.996 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64
2024-04-17T10:24:21.996 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2024-04-17T10:24:22.051 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream"
2024-04-17T10:24:22.051 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9"
2024-04-17T10:24:22.051 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos"
2024-04-17T10:24:22.051 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora"
2024-04-17T10:24:22.051 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9"
2024-04-17T10:24:22.051 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9"
2024-04-17T10:24:22.051 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T10:24:22.051 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2024-04-17T10:24:22.052 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon"
2024-04-17T10:24:22.052 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T10:24:22.052 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/"
2024-04-17T10:24:22.052 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T10:24:22.052 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T10:24:22.052 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T10:24:22.052 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2024-04-17T10:24:22.071 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server
2024-04-17T10:24:22.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com'
2024-04-17T10:24:22.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T10:24:22.157 DEBUG:teuthology.orchestra.run.smithi145:> true
2024-04-17T10:24:22.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com'
2024-04-17T10:24:22.325 DEBUG:teuthology.orchestra.run.smithi145:> uname -m
2024-04-17T10:24:22.379 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64
2024-04-17T10:24:22.380 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release
2024-04-17T10:24:22.434 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream"
2024-04-17T10:24:22.435 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9"
2024-04-17T10:24:22.435 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos"
2024-04-17T10:24:22.435 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora"
2024-04-17T10:24:22.435 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9"
2024-04-17T10:24:22.435 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9"
2024-04-17T10:24:22.435 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T10:24:22.435 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31"
2024-04-17T10:24:22.435 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon"
2024-04-17T10:24:22.435 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T10:24:22.435 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/"
2024-04-17T10:24:22.435 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T10:24:22.435 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T10:24:22.436 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T10:24:22.436 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2024-04-17T10:24:22.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T10:24:22.552 INFO:teuthology.dispatcher.supervisor:Running job 7660057
2024-04-17T10:24:22.552 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660057 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660057/orig.config.yaml
2024-04-17T10:24:22.555 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660057
2024-04-17T10:24:22.555 INFO:teuthology.dispatcher.supervisor:Job PID: 845232
2024-04-17T10:24:22.555 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-17T10:26:22.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T10:28:22.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T10:30:22.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T10:32:23.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T10:34:23.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T10:36:23.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T10:36:23.556 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1