2024-04-18T09:46:34.897 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-18T09:46:34.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T09:46:35.060 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9594827f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9595888c10>, signals=[15])
2024-04-18T09:46:35.061 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging
2024-04-18T09:46:35.061 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T09:46:35.061 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2024-04-18T09:46:35.085 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging
2024-04-18T09:46:35.085 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T09:46:35.085 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2024-04-18T09:46:35.110 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging
2024-04-18T09:46:35.110 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T09:46:35.110 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server
2024-04-18T09:46:35.210 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_centos_9.stream (ID 10)
2024-04-18T09:46:35.235 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_9.stream (ID 10)
2024-04-18T09:46:35.250 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_centos_9.stream (ID 10)
2024-04-18T09:46:35.260 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of centos 9.stream
2024-04-18T09:46:35.292 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 9.stream
2024-04-18T09:46:35.300 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of centos 9.stream
2024-04-18T09:46:35.729 INFO:teuthology.orchestra.console.smithi164:Power off
2024-04-18T09:46:35.729 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T09:46:35.755 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off
2024-04-18T09:46:35.755 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T09:46:35.777 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off
2024-04-18T09:46:35.853 INFO:teuthology.orchestra.console.smithi193:Power off
2024-04-18T09:46:35.853 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T09:46:35.866 INFO:teuthology.orchestra.console.smithi169:Power off
2024-04-18T09:46:35.866 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T09:46:35.875 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off
2024-04-18T09:46:35.876 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T09:46:35.886 INFO:teuthology.orchestra.console.smithi164:Power off completed
2024-04-18T09:46:35.889 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off
2024-04-18T09:46:35.889 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T09:46:35.900 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off
2024-04-18T09:46:35.911 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2024-04-18T09:46:35.987 INFO:teuthology.orchestra.console.smithi164:Power on
2024-04-18T09:46:35.987 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T09:46:36.001 INFO:teuthology.orchestra.console.smithi193:Power off completed
2024-04-18T09:46:36.009 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On
2024-04-18T09:46:36.009 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T09:46:36.015 INFO:teuthology.orchestra.console.smithi169:Power off completed
2024-04-18T09:46:36.029 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off
2024-04-18T09:46:36.102 INFO:teuthology.orchestra.console.smithi193:Power on
2024-04-18T09:46:36.103 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T09:46:36.116 INFO:teuthology.orchestra.console.smithi169:Power on
2024-04-18T09:46:36.117 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T09:46:36.125 DEBUG:teuthology.orchestra.console.smithi193:power on output: Chassis Power Control: Up/On
2024-04-18T09:46:36.125 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T09:46:36.138 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On
2024-04-18T09:46:36.139 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T09:46:36.148 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off
2024-04-18T09:46:36.161 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2024-04-18T09:46:40.034 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T09:46:40.142 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on
2024-04-18T09:46:40.149 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T09:46:40.162 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T09:46:40.243 INFO:teuthology.orchestra.console.smithi164:Power on completed
2024-04-18T09:46:40.259 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off
2024-04-18T09:46:40.271 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2024-04-18T09:46:40.345 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish
2024-04-18T09:46:44.263 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T09:46:44.273 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T09:46:44.374 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on
2024-04-18T09:46:44.386 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2024-04-18T09:46:44.475 INFO:teuthology.orchestra.console.smithi193:Power on completed
2024-04-18T09:46:44.487 INFO:teuthology.orchestra.console.smithi169:Power on completed
2024-04-18T09:46:44.576 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish
2024-04-18T09:46:44.588 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish
2024-04-18T09:50:47.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:50:47.785 ERROR:teuthology.orchestra.connection:Error authenticating with smithi169.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-18T09:50:58.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:51:01.694 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-18T09:51:07.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:51:10.750 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-18T09:51:16.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:51:17.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:51:19.807 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-18T09:51:20.766 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-04-18T09:51:25.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:51:26.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:51:28.862 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-18T09:51:29.822 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-04-18T09:51:34.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:51:35.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:51:37.918 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-18T09:51:38.878 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-04-18T09:51:43.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:51:44.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:51:46.974 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-18T09:51:47.938 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-04-18T09:51:51.788 WARNING:teuthology.provision.fog.smithi169:timed out
2024-04-18T09:51:52.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:51:53.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:51:56.994 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2024-04-18T09:51:57.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:52:02.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:52:16.162 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-04-18T09:52:22.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:52:25.214 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-04-18T09:52:31.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:52:34.274 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2024-04-18T09:52:40.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:52:40.546 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T09:52:40.547 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T09:52:52.978 WARNING:teuthology.provision.fog.smithi164:timed out
2024-04-18T09:52:56.303 INFO:teuthology.provision.fog.smithi169:Node is ready
2024-04-18T09:52:56.304 DEBUG:teuthology.orchestra.run.smithi169:> hostname
2024-04-18T09:52:56.321 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com
2024-04-18T09:52:56.322 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts
2024-04-18T09:52:56.379 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169
2024-04-18T09:52:56.379 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2024-04-18T09:52:56.488 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts
2024-04-18T09:52:56.519 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts
2024-04-18T09:52:56.590 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname
2024-04-18T09:52:56.661 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2024-04-18T09:52:56.728 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2024-04-18T09:52:56.784 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream"
2024-04-18T09:52:56.784 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9"
2024-04-18T09:52:56.784 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos"
2024-04-18T09:52:56.784 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora"
2024-04-18T09:52:56.784 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9"
2024-04-18T09:52:56.785 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9"
2024-04-18T09:52:56.785 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-18T09:52:56.785 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2024-04-18T09:52:56.785 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon"
2024-04-18T09:52:56.785 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-18T09:52:56.785 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/"
2024-04-18T09:52:56.785 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T09:52:56.785 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-18T09:52:56.785 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-18T09:52:56.786 INFO:teuthology.provision.fog.smithi169:Deploy complete!
2024-04-18T09:52:56.787 DEBUG:teuthology.parallel:result is None
2024-04-18T09:52:58.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:52:59.191 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T09:52:59.191 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T09:52:59.535 INFO:teuthology.provision.fog.smithi164:Node is ready
2024-04-18T09:52:59.535 DEBUG:teuthology.orchestra.run.smithi164:> hostname
2024-04-18T09:52:59.550 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com
2024-04-18T09:52:59.550 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts
2024-04-18T09:52:59.605 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164
2024-04-18T09:52:59.605 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164
2024-04-18T09:52:59.700 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts
2024-04-18T09:52:59.728 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts
2024-04-18T09:52:59.795 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname
2024-04-18T09:52:59.863 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164
2024-04-18T09:52:59.928 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release
2024-04-18T09:52:59.983 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream"
2024-04-18T09:52:59.983 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9"
2024-04-18T09:52:59.983 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos"
2024-04-18T09:52:59.984 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora"
2024-04-18T09:52:59.984 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9"
2024-04-18T09:52:59.984 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9"
2024-04-18T09:52:59.984 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-18T09:52:59.984 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31"
2024-04-18T09:52:59.984 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon"
2024-04-18T09:52:59.984 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-18T09:52:59.984 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/"
2024-04-18T09:52:59.984 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T09:52:59.984 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-18T09:52:59.984 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-18T09:52:59.985 INFO:teuthology.provision.fog.smithi164:Deploy complete!
2024-04-18T09:52:59.985 DEBUG:teuthology.parallel:result is None
2024-04-18T09:53:02.998 WARNING:teuthology.provision.fog.smithi193:timed out
2024-04-18T09:53:08.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:53:09.225 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T09:53:09.225 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T09:53:09.559 INFO:teuthology.provision.fog.smithi193:Node is ready
2024-04-18T09:53:09.559 DEBUG:teuthology.orchestra.run.smithi193:> hostname
2024-04-18T09:53:09.573 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com
2024-04-18T09:53:09.573 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts
2024-04-18T09:53:09.629 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193
2024-04-18T09:53:09.629 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193
2024-04-18T09:53:09.731 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts
2024-04-18T09:53:09.759 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts
2024-04-18T09:53:09.827 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname
2024-04-18T09:53:09.894 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193
2024-04-18T09:53:09.960 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release
2024-04-18T09:53:10.015 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream"
2024-04-18T09:53:10.015 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9"
2024-04-18T09:53:10.015 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos"
2024-04-18T09:53:10.015 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora"
2024-04-18T09:53:10.015 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9"
2024-04-18T09:53:10.016 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9"
2024-04-18T09:53:10.016 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-18T09:53:10.016 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31"
2024-04-18T09:53:10.016 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon"
2024-04-18T09:53:10.016 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-18T09:53:10.016 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/"
2024-04-18T09:53:10.016 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T09:53:10.016 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-18T09:53:10.016 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-18T09:53:10.016 INFO:teuthology.provision.fog.smithi193:Deploy complete!
2024-04-18T09:53:10.017 DEBUG:teuthology.parallel:result is None
2024-04-18T09:53:10.228 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com
2024-04-18T09:53:10.229 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T09:53:10.250 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com
2024-04-18T09:53:10.250 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T09:53:10.282 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com
2024-04-18T09:53:10.283 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T09:53:10.300 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server
2024-04-18T09:53:10.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com'
2024-04-18T09:53:10.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:53:10.389 DEBUG:teuthology.orchestra.run.smithi164:> true
2024-04-18T09:53:10.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com'
2024-04-18T09:53:10.557 DEBUG:teuthology.orchestra.run.smithi164:> uname -m
2024-04-18T09:53:10.611 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64
2024-04-18T09:53:10.611 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release
2024-04-18T09:53:10.665 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream"
2024-04-18T09:53:10.666 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9"
2024-04-18T09:53:10.666 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos"
2024-04-18T09:53:10.666 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora"
2024-04-18T09:53:10.666 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9"
2024-04-18T09:53:10.666 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9"
2024-04-18T09:53:10.666 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-18T09:53:10.666 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31"
2024-04-18T09:53:10.666 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon"
2024-04-18T09:53:10.666 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-18T09:53:10.666 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/"
2024-04-18T09:53:10.666 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T09:53:10.667 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-18T09:53:10.667 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-18T09:53:10.667 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2024-04-18T09:53:10.691 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server
2024-04-18T09:53:10.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2024-04-18T09:53:10.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:53:10.781 DEBUG:teuthology.orchestra.run.smithi169:> true
2024-04-18T09:53:10.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com'
2024-04-18T09:53:10.952 DEBUG:teuthology.orchestra.run.smithi169:> uname -m
2024-04-18T09:53:11.007 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64
2024-04-18T09:53:11.007 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2024-04-18T09:53:11.062 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream"
2024-04-18T09:53:11.062 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9"
2024-04-18T09:53:11.062 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos"
2024-04-18T09:53:11.062 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora"
2024-04-18T09:53:11.062 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9"
2024-04-18T09:53:11.062 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9"
2024-04-18T09:53:11.063 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-18T09:53:11.063 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2024-04-18T09:53:11.063 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon"
2024-04-18T09:53:11.063 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-18T09:53:11.063 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/"
2024-04-18T09:53:11.063 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T09:53:11.063 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-18T09:53:11.063 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-18T09:53:11.063 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2024-04-18T09:53:11.082 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server
2024-04-18T09:53:11.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com'
2024-04-18T09:53:11.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T09:53:11.176 DEBUG:teuthology.orchestra.run.smithi193:> true
2024-04-18T09:53:11.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com'
2024-04-18T09:53:11.246 DEBUG:teuthology.orchestra.run.smithi193:> uname -m
2024-04-18T09:53:11.302 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64
2024-04-18T09:53:11.303 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release
2024-04-18T09:53:11.358 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream"
2024-04-18T09:53:11.358 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9"
2024-04-18T09:53:11.358 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos"
2024-04-18T09:53:11.358 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora"
2024-04-18T09:53:11.359 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9"
2024-04-18T09:53:11.359 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9"
2024-04-18T09:53:11.359 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-18T09:53:11.359 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31"
2024-04-18T09:53:11.359 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon"
2024-04-18T09:53:11.359 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-18T09:53:11.359 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/"
2024-04-18T09:53:11.359 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T09:53:11.359 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-18T09:53:11.359 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-18T09:53:11.360 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server
2024-04-18T09:53:11.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T09:53:11.493 INFO:teuthology.dispatcher.supervisor:Running job 7660949
2024-04-18T09:53:11.493 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660949 --name teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660949/orig.config.yaml
2024-04-18T09:53:11.496 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660949
2024-04-18T09:53:11.497 INFO:teuthology.dispatcher.supervisor:Job PID: 3194265
2024-04-18T09:53:11.497 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-18T09:55:11.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T09:57:11.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T09:59:11.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T10:01:11.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T10:03:11.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T10:03:11.873 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-04-18T10:03:12.083 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi164 but it was locked by another job: /home/teuthworker/archive/matan-2024-04-18_09:57:42-crimson-rados-wip-matanb-crimson-testing-april-17-distro-crimson-smithi/7661959
2024-04-18T10:03:12.083 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi169 but it was locked by another job: /home/teuthworker/archive/matan-2024-04-18_09:57:42-crimson-rados-wip-matanb-crimson-testing-april-17-distro-crimson-smithi/7661958
2024-04-18T10:03:12.083 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi193 but it was locked by another job: /home/teuthworker/archive/matan-2024-04-18_09:57:42-crimson-rados-wip-matanb-crimson-testing-april-17-distro-crimson-smithi/7661957