2024-03-17T23:51:28.546 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-17T23:51:28.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T23:51:28.728 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5df1177f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5df2118c10>, signals=[15])
2024-03-17T23:51:28.728 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging
2024-03-17T23:51:28.729 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server
2024-03-17T23:51:28.729 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2024-03-17T23:51:28.743 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging
2024-03-17T23:51:28.744 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server
2024-03-17T23:51:28.744 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server
2024-03-17T23:51:28.768 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging
2024-03-17T23:51:28.769 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server
2024-03-17T23:51:28.769 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2024-03-17T23:51:28.859 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_centos_9.stream (ID 10)
2024-03-17T23:51:28.884 DEBUG:teuthology.provision.fog.smithi146:Requesting image smithi_centos_9.stream (ID 10)
2024-03-17T23:51:28.895 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 9.stream
2024-03-17T23:51:28.901 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_centos_9.stream (ID 10)
2024-03-17T23:51:28.924 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 9.stream
2024-03-17T23:51:28.948 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of centos 9.stream
2024-03-17T23:51:29.144 INFO:teuthology.orchestra.console.smithi059:Power off
2024-03-17T23:51:29.144 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-17T23:51:29.161 INFO:teuthology.orchestra.console.smithi146:Power off
2024-03-17T23:51:29.162 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-17T23:51:29.174 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off
2024-03-17T23:51:29.174 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:51:29.185 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off
2024-03-17T23:51:29.185 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:51:29.201 INFO:teuthology.orchestra.console.smithi177:Power off
2024-03-17T23:51:29.201 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-17T23:51:29.211 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off
2024-03-17T23:51:29.212 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off
2024-03-17T23:51:29.222 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off
2024-03-17T23:51:29.222 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:51:29.242 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2024-03-17T23:51:29.313 INFO:teuthology.orchestra.console.smithi146:Power off completed
2024-03-17T23:51:29.313 INFO:teuthology.orchestra.console.smithi059:Power off completed
2024-03-17T23:51:29.344 INFO:teuthology.orchestra.console.smithi177:Power off completed
2024-03-17T23:51:29.414 INFO:teuthology.orchestra.console.smithi146:Power on
2024-03-17T23:51:29.414 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-17T23:51:29.423 INFO:teuthology.orchestra.console.smithi059:Power on
2024-03-17T23:51:29.424 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-17T23:51:29.437 DEBUG:teuthology.orchestra.console.smithi146:power on output: Chassis Power Control: Up/On
2024-03-17T23:51:29.438 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:51:29.446 INFO:teuthology.orchestra.console.smithi177:Power on
2024-03-17T23:51:29.446 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-17T23:51:29.453 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On
2024-03-17T23:51:29.453 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:51:29.462 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off
2024-03-17T23:51:29.469 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On
2024-03-17T23:51:29.469 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:51:29.477 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off
2024-03-17T23:51:29.491 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2024-03-17T23:51:33.467 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:51:33.478 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:51:33.492 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:51:33.575 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on
2024-03-17T23:51:33.585 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off
2024-03-17T23:51:33.601 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2024-03-17T23:51:33.676 INFO:teuthology.orchestra.console.smithi146:Power on completed
2024-03-17T23:51:33.777 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish
2024-03-17T23:51:37.590 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:51:37.601 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-17T23:51:37.698 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on
2024-03-17T23:51:37.709 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2024-03-17T23:51:37.799 INFO:teuthology.orchestra.console.smithi059:Power on completed
2024-03-17T23:51:37.810 INFO:teuthology.orchestra.console.smithi177:Power on completed
2024-03-17T23:51:37.901 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish
2024-03-17T23:51:37.911 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish
2024-03-17T23:54:08.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:08.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:11.838 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-17T23:54:11.839 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-03-17T23:54:17.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:17.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:19.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:20.894 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-17T23:54:20.894 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-03-17T23:54:22.782 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-17T23:54:26.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:26.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:28.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:29.950 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-17T23:54:29.951 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-03-17T23:54:31.838 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-17T23:54:35.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:35.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:37.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:39.006 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-17T23:54:39.007 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-03-17T23:54:40.894 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-17T23:54:45.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:45.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:46.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:48.063 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-17T23:54:48.094 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2024-03-17T23:54:49.950 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-17T23:54:54.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:54.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:55.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:54:57.118 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-17T23:54:59.010 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-17T23:55:03.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:55:05.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:55:08.094 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-03-17T23:55:14.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:55:54.137 WARNING:teuthology.provision.fog.smithi059:timed out
2024-03-17T23:56:00.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:56:00.406 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-17T23:56:00.406 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-17T23:56:00.747 INFO:teuthology.provision.fog.smithi059:Node is ready
2024-03-17T23:56:00.747 DEBUG:teuthology.orchestra.run.smithi059:> hostname
2024-03-17T23:56:00.762 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com
2024-03-17T23:56:00.762 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts
2024-03-17T23:56:00.818 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059
2024-03-17T23:56:00.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059
2024-03-17T23:56:00.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts
2024-03-17T23:56:00.949 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts
2024-03-17T23:56:01.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname
2024-03-17T23:56:01.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059
2024-03-17T23:56:01.160 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release
2024-03-17T23:56:01.216 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream"
2024-03-17T23:56:01.216 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9"
2024-03-17T23:56:01.216 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos"
2024-03-17T23:56:01.216 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora"
2024-03-17T23:56:01.216 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9"
2024-03-17T23:56:01.216 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9"
2024-03-17T23:56:01.216 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T23:56:01.216 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31"
2024-03-17T23:56:01.216 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon"
2024-03-17T23:56:01.216 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T23:56:01.216 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/"
2024-03-17T23:56:01.216 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T23:56:01.216 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T23:56:01.217 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T23:56:01.217 INFO:teuthology.provision.fog.smithi059:Deploy complete!
2024-03-17T23:56:01.240 DEBUG:teuthology.parallel:result is None
2024-03-17T23:56:03.125 WARNING:teuthology.provision.fog.smithi177:timed out
2024-03-17T23:56:09.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:56:09.382 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-17T23:56:09.382 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-17T23:56:09.712 INFO:teuthology.provision.fog.smithi177:Node is ready
2024-03-17T23:56:09.712 DEBUG:teuthology.orchestra.run.smithi177:> hostname
2024-03-17T23:56:09.727 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com
2024-03-17T23:56:09.727 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts
2024-03-17T23:56:09.782 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177
2024-03-17T23:56:09.782 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2024-03-17T23:56:09.889 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts
2024-03-17T23:56:09.917 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts
2024-03-17T23:56:09.985 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname
2024-03-17T23:56:10.051 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2024-03-17T23:56:10.117 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2024-03-17T23:56:10.171 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream"
2024-03-17T23:56:10.172 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9"
2024-03-17T23:56:10.172 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos"
2024-03-17T23:56:10.172 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora"
2024-03-17T23:56:10.172 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9"
2024-03-17T23:56:10.172 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9"
2024-03-17T23:56:10.172 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T23:56:10.172 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2024-03-17T23:56:10.172 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon"
2024-03-17T23:56:10.172 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T23:56:10.173 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/"
2024-03-17T23:56:10.173 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T23:56:10.173 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T23:56:10.173 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T23:56:10.173 INFO:teuthology.provision.fog.smithi177:Deploy complete!
2024-03-17T23:56:10.174 DEBUG:teuthology.parallel:result is None
2024-03-17T23:56:14.105 WARNING:teuthology.provision.fog.smithi146:timed out
2024-03-17T23:56:20.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:56:20.335 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-17T23:56:20.335 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-17T23:56:20.659 INFO:teuthology.provision.fog.smithi146:Node is ready
2024-03-17T23:56:20.660 DEBUG:teuthology.orchestra.run.smithi146:> hostname
2024-03-17T23:56:20.674 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com
2024-03-17T23:56:20.675 DEBUG:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts
2024-03-17T23:56:20.730 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146
2024-03-17T23:56:20.730 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146
2024-03-17T23:56:20.837 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts
2024-03-17T23:56:20.864 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts
2024-03-17T23:56:20.931 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname
2024-03-17T23:56:20.999 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146
2024-03-17T23:56:21.065 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release
2024-03-17T23:56:21.119 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream"
2024-03-17T23:56:21.119 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9"
2024-03-17T23:56:21.119 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos"
2024-03-17T23:56:21.119 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora"
2024-03-17T23:56:21.119 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9"
2024-03-17T23:56:21.119 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9"
2024-03-17T23:56:21.119 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T23:56:21.119 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31"
2024-03-17T23:56:21.119 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon"
2024-03-17T23:56:21.120 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T23:56:21.120 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/"
2024-03-17T23:56:21.120 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T23:56:21.120 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T23:56:21.120 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T23:56:21.120 INFO:teuthology.provision.fog.smithi146:Deploy complete!
2024-03-17T23:56:21.120 DEBUG:teuthology.parallel:result is None
2024-03-17T23:56:21.365 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com
2024-03-17T23:56:21.365 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-17T23:56:21.390 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com
2024-03-17T23:56:21.391 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-17T23:56:21.415 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com
2024-03-17T23:56:21.415 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-17T23:56:21.433 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server
2024-03-17T23:56:21.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com'
2024-03-17T23:56:21.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:56:21.540 DEBUG:teuthology.orchestra.run.smithi059:> true
2024-03-17T23:56:21.724 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com'
2024-03-17T23:56:21.724 DEBUG:teuthology.orchestra.run.smithi059:> uname -m
2024-03-17T23:56:21.780 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64
2024-03-17T23:56:21.780 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release
2024-03-17T23:56:21.834 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream"
2024-03-17T23:56:21.834 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9"
2024-03-17T23:56:21.834 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos"
2024-03-17T23:56:21.835 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora"
2024-03-17T23:56:21.835 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9"
2024-03-17T23:56:21.835 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9"
2024-03-17T23:56:21.835 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T23:56:21.835 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31"
2024-03-17T23:56:21.835 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon"
2024-03-17T23:56:21.835 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T23:56:21.835 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/"
2024-03-17T23:56:21.835 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T23:56:21.835 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T23:56:21.835 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T23:56:21.836 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2024-03-17T23:56:21.857 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server
2024-03-17T23:56:21.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com'
2024-03-17T23:56:21.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:56:21.942 DEBUG:teuthology.orchestra.run.smithi146:> true
2024-03-17T23:56:22.008 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com'
2024-03-17T23:56:22.008 DEBUG:teuthology.orchestra.run.smithi146:> uname -m
2024-03-17T23:56:22.062 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64
2024-03-17T23:56:22.062 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release
2024-03-17T23:56:22.116 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream"
2024-03-17T23:56:22.116 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9"
2024-03-17T23:56:22.116 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos"
2024-03-17T23:56:22.116 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora"
2024-03-17T23:56:22.116 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9"
2024-03-17T23:56:22.116 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9"
2024-03-17T23:56:22.116 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T23:56:22.116 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31"
2024-03-17T23:56:22.116 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon"
2024-03-17T23:56:22.117 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T23:56:22.117 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/"
2024-03-17T23:56:22.117 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T23:56:22.117 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T23:56:22.117 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T23:56:22.117 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server
2024-03-17T23:56:22.193 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server
2024-03-17T23:56:22.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com'
2024-03-17T23:56:22.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-17T23:56:22.283 DEBUG:teuthology.orchestra.run.smithi177:> true
2024-03-17T23:56:22.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com'
2024-03-17T23:56:22.452 DEBUG:teuthology.orchestra.run.smithi177:> uname -m
2024-03-17T23:56:22.506 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64
2024-03-17T23:56:22.507 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2024-03-17T23:56:22.561 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream"
2024-03-17T23:56:22.561 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9"
2024-03-17T23:56:22.561 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos"
2024-03-17T23:56:22.561 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora"
2024-03-17T23:56:22.561 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9"
2024-03-17T23:56:22.561 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9"
2024-03-17T23:56:22.561 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-17T23:56:22.561 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2024-03-17T23:56:22.561 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon"
2024-03-17T23:56:22.561 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-17T23:56:22.561 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/"
2024-03-17T23:56:22.561 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-17T23:56:22.562 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-17T23:56:22.562 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-17T23:56:22.562 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2024-03-17T23:56:22.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-17T23:56:22.696 INFO:teuthology.dispatcher.supervisor:Running job 7608513
2024-03-17T23:56:22.696 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608513 --name pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608513/orig.config.yaml
2024-03-17T23:56:22.699 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608513
2024-03-17T23:56:22.699 INFO:teuthology.dispatcher.supervisor:Job PID: 1039231
2024-03-17T23:56:22.700 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-17T23:58:22.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:00:22.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:02:23.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:04:23.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:06:23.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:08:23.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:10:23.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:12:24.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:14:24.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:16:24.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:18:24.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:20:24.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:22:24.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:24:25.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:26:25.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:28:25.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:30:25.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:32:25.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:34:25.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:36:26.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:38:26.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:40:26.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:42:26.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:44:26.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:46:26.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:48:27.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:50:27.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:52:27.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:54:27.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:56:27.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T00:58:27.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:00:28.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:02:28.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:04:28.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:06:28.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:08:28.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:10:28.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:12:28.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:14:29.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:16:29.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-18T01:16:29.379 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1