2024-04-12T03:50:39.558 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-12T03:50:39.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:50:39.783 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fdfc9896f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fdfca8f7c10>, signals=[15])
2024-04-12T03:50:39.783 INFO:teuthology.lock.ops:Start node 'smithi047.front.sepia.ceph.com' reimaging
2024-04-12T03:50:39.784 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: reset os type and version on server
2024-04-12T03:50:39.784 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server
2024-04-12T03:50:39.819 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging
2024-04-12T03:50:39.819 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server
2024-04-12T03:50:39.820 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2024-04-12T03:50:39.869 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging
2024-04-12T03:50:39.869 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server
2024-04-12T03:50:39.869 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2024-04-12T03:50:40.001 DEBUG:teuthology.provision.fog.smithi047:Requesting image smithi_centos_9.stream (ID 10)
2024-04-12T03:50:40.062 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of centos 9.stream
2024-04-12T03:50:40.161 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_centos_9.stream (ID 10)
2024-04-12T03:50:40.183 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_centos_9.stream (ID 10)
2024-04-12T03:50:40.251 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 9.stream
2024-04-12T03:50:40.276 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 9.stream
2024-04-12T03:50:40.526 INFO:teuthology.orchestra.console.smithi047:Power off
2024-04-12T03:50:40.526 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-12T03:50:40.588 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off
2024-04-12T03:50:40.589 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T03:50:40.620 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off
2024-04-12T03:50:40.709 INFO:teuthology.orchestra.console.smithi152:Power off
2024-04-12T03:50:40.709 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-12T03:50:40.726 INFO:teuthology.orchestra.console.smithi150:Power off
2024-04-12T03:50:40.726 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-12T03:50:40.733 INFO:teuthology.orchestra.console.smithi047:Power off completed
2024-04-12T03:50:40.742 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off
2024-04-12T03:50:40.742 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T03:50:40.773 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2024-04-12T03:50:40.774 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T03:50:40.787 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2024-04-12T03:50:40.806 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-04-12T03:50:40.834 INFO:teuthology.orchestra.console.smithi047:Power on
2024-04-12T03:50:40.834 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-12T03:50:40.884 DEBUG:teuthology.orchestra.console.smithi047:power on output: Chassis Power Control: Up/On
2024-04-12T03:50:40.885 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T03:50:40.892 INFO:teuthology.orchestra.console.smithi152:Power off completed
2024-04-12T03:50:40.907 INFO:teuthology.orchestra.console.smithi150:Power off completed
2024-04-12T03:50:40.917 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off
2024-04-12T03:50:40.993 INFO:teuthology.orchestra.console.smithi152:Power on
2024-04-12T03:50:40.993 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-12T03:50:41.008 INFO:teuthology.orchestra.console.smithi150:Power on
2024-04-12T03:50:41.008 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-12T03:50:41.022 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On
2024-04-12T03:50:41.023 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T03:50:41.054 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On
2024-04-12T03:50:41.054 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T03:50:41.063 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2024-04-12T03:50:41.087 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-04-12T03:50:44.922 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T03:50:45.031 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off
2024-04-12T03:50:45.064 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T03:50:45.089 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T03:50:45.173 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2024-04-12T03:50:45.197 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2024-04-12T03:50:45.275 INFO:teuthology.orchestra.console.smithi152:Power on completed
2024-04-12T03:50:45.298 INFO:teuthology.orchestra.console.smithi150:Power on completed
2024-04-12T03:50:45.376 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish
2024-04-12T03:50:45.399 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish
2024-04-12T03:50:49.034 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T03:50:49.143 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on
2024-04-12T03:50:49.244 INFO:teuthology.orchestra.console.smithi047:Power on completed
2024-04-12T03:50:49.344 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish
2024-04-12T03:53:20.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:53:23.358 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47
2024-04-12T03:53:29.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:53:31.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:53:31.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:53:32.446 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47
2024-04-12T03:53:34.654 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-12T03:53:34.686 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-04-12T03:53:38.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:53:40.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:53:40.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:53:41.534 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47
2024-04-12T03:53:43.742 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-12T03:53:43.774 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-04-12T03:53:47.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:53:49.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:53:49.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:53:50.622 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47
2024-04-12T03:53:52.830 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-12T03:53:52.866 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-04-12T03:53:56.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:53:58.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:53:58.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:53:59.710 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47
2024-04-12T03:54:01.918 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-12T03:54:01.950 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-04-12T03:54:05.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:54:07.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:54:07.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:54:11.006 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-12T03:54:11.038 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-04-12T03:54:17.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:54:17.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:54:20.094 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-12T03:54:20.126 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-04-12T03:54:26.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:54:26.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:55:05.750 WARNING:teuthology.provision.fog.smithi047:timed out
2024-04-12T03:55:11.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:55:12.072 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-12T03:55:12.073 DEBUG:teuthology.orchestra.run.smithi047:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-12T03:55:12.435 INFO:teuthology.provision.fog.smithi047:Node is ready
2024-04-12T03:55:12.435 DEBUG:teuthology.orchestra.run.smithi047:> hostname
2024-04-12T03:55:12.450 INFO:teuthology.orchestra.run.smithi047.stdout:smithi047.front.sepia.ceph.com
2024-04-12T03:55:12.451 DEBUG:teuthology.orchestra.run.smithi047:> grep smithi047.front.sepia.ceph.com /etc/hosts
2024-04-12T03:55:12.506 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.15.47 smithi047.front.sepia.ceph.com smithi047
2024-04-12T03:55:12.506 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047
2024-04-12T03:55:12.609 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hosts
2024-04-12T03:55:12.641 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/172.21.15.47/172.21.15.47/g' /etc/hosts
2024-04-12T03:55:12.711 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi047.front.sepia.ceph.com/smithi047/g' /etc/hostname
2024-04-12T03:55:12.783 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047
2024-04-12T03:55:12.853 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release
2024-04-12T03:55:12.908 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream"
2024-04-12T03:55:12.908 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9"
2024-04-12T03:55:12.908 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos"
2024-04-12T03:55:12.908 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora"
2024-04-12T03:55:12.908 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9"
2024-04-12T03:55:12.908 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9"
2024-04-12T03:55:12.908 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T03:55:12.908 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31"
2024-04-12T03:55:12.908 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon"
2024-04-12T03:55:12.909 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T03:55:12.909 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/"
2024-04-12T03:55:12.909 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T03:55:12.909 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T03:55:12.909 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T03:55:12.910 INFO:teuthology.provision.fog.smithi047:Deploy complete!
2024-04-12T03:55:12.911 DEBUG:teuthology.parallel:result is None
2024-04-12T03:55:26.119 WARNING:teuthology.provision.fog.smithi152:timed out
2024-04-12T03:55:26.137 WARNING:teuthology.provision.fog.smithi150:timed out
2024-04-12T03:55:32.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:55:32.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:55:32.435 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-12T03:55:32.435 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-12T03:55:32.610 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-12T03:55:32.611 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-12T03:55:32.738 INFO:teuthology.provision.fog.smithi152:Node is ready
2024-04-12T03:55:32.738 DEBUG:teuthology.orchestra.run.smithi152:> hostname
2024-04-12T03:55:32.753 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com
2024-04-12T03:55:32.753 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts
2024-04-12T03:55:32.810 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152
2024-04-12T03:55:32.810 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152
2024-04-12T03:55:32.934 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts
2024-04-12T03:55:32.937 INFO:teuthology.provision.fog.smithi150:Node is ready
2024-04-12T03:55:32.938 DEBUG:teuthology.orchestra.run.smithi150:> hostname
2024-04-12T03:55:32.952 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com
2024-04-12T03:55:32.952 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts
2024-04-12T03:55:32.963 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts
2024-04-12T03:55:33.007 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150
2024-04-12T03:55:33.007 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2024-04-12T03:55:33.031 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname
2024-04-12T03:55:33.099 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152
2024-04-12T03:55:33.106 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts
2024-04-12T03:55:33.134 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts
2024-04-12T03:55:33.166 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release
2024-04-12T03:55:33.201 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname
2024-04-12T03:55:33.221 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream"
2024-04-12T03:55:33.221 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9"
2024-04-12T03:55:33.221 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos"
2024-04-12T03:55:33.221 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora"
2024-04-12T03:55:33.221 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9"
2024-04-12T03:55:33.221 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9"
2024-04-12T03:55:33.221 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T03:55:33.221 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2024-04-12T03:55:33.221 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon"
2024-04-12T03:55:33.222 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T03:55:33.222 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/"
2024-04-12T03:55:33.222 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T03:55:33.222 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T03:55:33.222 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T03:55:33.222 INFO:teuthology.provision.fog.smithi152:Deploy complete!
2024-04-12T03:55:33.223 DEBUG:teuthology.parallel:result is None
2024-04-12T03:55:33.268 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2024-04-12T03:55:33.334 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2024-04-12T03:55:33.388 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2024-04-12T03:55:33.388 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9"
2024-04-12T03:55:33.388 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2024-04-12T03:55:33.388 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2024-04-12T03:55:33.388 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9"
2024-04-12T03:55:33.388 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9"
2024-04-12T03:55:33.388 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T03:55:33.388 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2024-04-12T03:55:33.388 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon"
2024-04-12T03:55:33.389 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T03:55:33.389 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2024-04-12T03:55:33.389 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T03:55:33.389 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T03:55:33.389 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T03:55:33.389 INFO:teuthology.provision.fog.smithi150:Deploy complete!
2024-04-12T03:55:33.389 DEBUG:teuthology.parallel:result is None
2024-04-12T03:55:33.816 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com
2024-04-12T03:55:33.816 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-12T03:55:33.847 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com
2024-04-12T03:55:33.848 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-12T03:55:33.872 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com
2024-04-12T03:55:33.872 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-12T03:55:33.899 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server
2024-04-12T03:55:33.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com'
2024-04-12T03:55:33.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:55:34.029 DEBUG:teuthology.orchestra.run.smithi047:> true
2024-04-12T03:55:34.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com'
2024-04-12T03:55:34.213 DEBUG:teuthology.orchestra.run.smithi047:> uname -m
2024-04-12T03:55:34.267 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64
2024-04-12T03:55:34.267 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release
2024-04-12T03:55:34.322 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream"
2024-04-12T03:55:34.322 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9"
2024-04-12T03:55:34.322 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos"
2024-04-12T03:55:34.322 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora"
2024-04-12T03:55:34.322 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9"
2024-04-12T03:55:34.322 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9"
2024-04-12T03:55:34.322 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T03:55:34.323 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31"
2024-04-12T03:55:34.323 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon"
2024-04-12T03:55:34.323 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T03:55:34.323 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/"
2024-04-12T03:55:34.323 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T03:55:34.323 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T03:55:34.323 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T03:55:34.323 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server
2024-04-12T03:55:34.356 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server
2024-04-12T03:55:34.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com'
2024-04-12T03:55:34.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:55:34.452 DEBUG:teuthology.orchestra.run.smithi150:> true
2024-04-12T03:55:34.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com'
2024-04-12T03:55:34.521 DEBUG:teuthology.orchestra.run.smithi150:> uname -m
2024-04-12T03:55:34.575 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64
2024-04-12T03:55:34.575 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2024-04-12T03:55:34.631 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2024-04-12T03:55:34.631 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9"
2024-04-12T03:55:34.632 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2024-04-12T03:55:34.632 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2024-04-12T03:55:34.632 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9"
2024-04-12T03:55:34.632 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9"
2024-04-12T03:55:34.632 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T03:55:34.632 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2024-04-12T03:55:34.632 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon"
2024-04-12T03:55:34.632 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T03:55:34.632 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2024-04-12T03:55:34.632 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T03:55:34.632 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T03:55:34.632 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T03:55:34.633 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2024-04-12T03:55:34.664 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server
2024-04-12T03:55:34.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2024-04-12T03:55:34.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T03:55:34.760 DEBUG:teuthology.orchestra.run.smithi152:> true
2024-04-12T03:55:34.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com'
2024-04-12T03:55:34.829 DEBUG:teuthology.orchestra.run.smithi152:> uname -m
2024-04-12T03:55:34.883 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64
2024-04-12T03:55:34.884 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release
2024-04-12T03:55:34.938 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream"
2024-04-12T03:55:34.938 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9"
2024-04-12T03:55:34.938 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos"
2024-04-12T03:55:34.938 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora"
2024-04-12T03:55:34.938 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9"
2024-04-12T03:55:34.938 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9"
2024-04-12T03:55:34.938 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T03:55:34.939 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2024-04-12T03:55:34.939 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon"
2024-04-12T03:55:34.939 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T03:55:34.939 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/"
2024-04-12T03:55:34.939 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T03:55:34.939 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T03:55:34.939 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T03:55:34.939 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2024-04-12T03:55:34.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:55:35.094 INFO:teuthology.dispatcher.supervisor:Running job 7653454
2024-04-12T03:55:35.094 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-04-12_03:10:33-fs:workload-wip-64730-2-testing-default-smithi/7653454 --name vshankar-2024-04-12_03:10:33-fs:workload-wip-64730-2-testing-default-smithi --description fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/vshankar-2024-04-12_03:10:33-fs:workload-wip-64730-2-testing-default-smithi/7653454/orig.config.yaml
2024-04-12T03:55:35.097 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-04-12_03:10:33-fs:workload-wip-64730-2-testing-default-smithi/7653454
2024-04-12T03:55:35.097 INFO:teuthology.dispatcher.supervisor:Job PID: 768665
2024-04-12T03:55:35.097 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-12T03:57:35.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T03:59:35.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:01:35.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:03:35.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:05:35.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:07:36.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:09:36.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:11:36.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:13:36.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:15:36.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:17:37.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:19:37.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:21:37.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:23:37.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:25:37.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:27:37.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:29:38.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:31:38.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:33:38.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T04:33:38.519 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1