2024-04-06T17:02:08.080 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-06T17:02:08.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:02:08.254 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fedaf7a1f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fedb0802c10>, signals=[15])
2024-04-06T17:02:08.254 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging
2024-04-06T17:02:08.255 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server
2024-04-06T17:02:08.255 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2024-04-06T17:02:08.278 INFO:teuthology.lock.ops:Start node 'smithi106.front.sepia.ceph.com' reimaging
2024-04-06T17:02:08.278 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: reset os type and version on server
2024-04-06T17:02:08.278 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2024-04-06T17:02:08.303 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging
2024-04-06T17:02:08.303 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server
2024-04-06T17:02:08.303 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2024-04-06T17:02:08.391 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_centos_8.stream (ID 3)
2024-04-06T17:02:08.412 DEBUG:teuthology.provision.fog.smithi106:Requesting image smithi_centos_8.stream (ID 3)
2024-04-06T17:02:08.437 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_centos_8.stream (ID 3)
2024-04-06T17:02:08.453 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of centos 8.stream
2024-04-06T17:02:08.462 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of centos 8.stream
2024-04-06T17:02:08.485 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 8.stream
2024-04-06T17:02:08.702 INFO:teuthology.orchestra.console.smithi104:Power off
2024-04-06T17:02:08.702 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-06T17:02:08.717 INFO:teuthology.orchestra.console.smithi152:Power off
2024-04-06T17:02:08.718 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-06T17:02:08.728 INFO:teuthology.orchestra.console.smithi106:Power off
2024-04-06T17:02:08.728 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-06T17:02:08.736 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off
2024-04-06T17:02:08.736 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:08.745 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off
2024-04-06T17:02:08.745 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:08.754 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off
2024-04-06T17:02:08.754 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:08.762 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-04-06T17:02:08.767 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2024-04-06T17:02:08.775 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on
2024-04-06T17:02:12.764 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:12.771 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:12.778 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:12.874 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-04-06T17:02:12.879 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2024-04-06T17:02:12.890 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on
2024-04-06T17:02:16.878 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:16.886 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:16.892 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:16.988 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-04-06T17:02:16.994 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2024-04-06T17:02:17.006 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on
2024-04-06T17:02:17.095 INFO:teuthology.orchestra.console.smithi152:Power off completed
2024-04-06T17:02:17.196 INFO:teuthology.orchestra.console.smithi152:Power on
2024-04-06T17:02:17.196 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-06T17:02:17.221 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On
2024-04-06T17:02:17.222 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:17.247 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2024-04-06T17:02:20.993 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:21.006 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:21.104 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-04-06T17:02:21.116 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off
2024-04-06T17:02:21.205 INFO:teuthology.orchestra.console.smithi104:Power off completed
2024-04-06T17:02:21.217 INFO:teuthology.orchestra.console.smithi106:Power off completed
2024-04-06T17:02:21.247 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:21.306 INFO:teuthology.orchestra.console.smithi104:Power on
2024-04-06T17:02:21.306 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-06T17:02:21.318 INFO:teuthology.orchestra.console.smithi106:Power on
2024-04-06T17:02:21.318 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-06T17:02:21.330 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On
2024-04-06T17:02:21.330 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:21.337 DEBUG:teuthology.orchestra.console.smithi106:power on output: Chassis Power Control: Up/On
2024-04-06T17:02:21.338 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:21.350 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-04-06T17:02:21.356 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2024-04-06T17:02:21.359 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off
2024-04-06T17:02:25.355 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:25.362 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:25.369 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:25.464 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-04-06T17:02:25.471 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2024-04-06T17:02:25.478 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off
2024-04-06T17:02:25.566 INFO:teuthology.orchestra.console.smithi104:Power on completed
2024-04-06T17:02:25.572 INFO:teuthology.orchestra.console.smithi152:Power on completed
2024-04-06T17:02:25.667 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish
2024-04-06T17:02:25.673 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish
2024-04-06T17:02:29.482 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-06T17:02:29.592 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on
2024-04-06T17:02:29.693 INFO:teuthology.orchestra.console.smithi106:Power on completed
2024-04-06T17:02:29.793 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish
2024-04-06T17:05:00.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:03.678 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-06T17:05:09.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:11.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:11.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:12.830 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-06T17:05:14.722 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-06T17:05:14.723 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-04-06T17:05:18.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:20.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:20.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:21.891 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-06T17:05:23.806 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-06T17:05:23.807 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-04-06T17:05:27.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:29.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:29.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:30.974 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-06T17:05:32.862 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-06T17:05:32.863 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-04-06T17:05:36.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:38.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:38.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:40.030 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-06T17:05:41.922 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-06T17:05:41.923 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-04-06T17:05:46.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:47.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:47.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:49.086 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-06T17:05:51.010 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-06T17:05:51.011 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-04-06T17:05:55.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:57.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:57.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:05:58.146 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-06T17:06:00.094 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-04-06T17:06:00.095 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-06T17:06:04.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:06:06.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:06:06.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:06:09.150 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-06T17:06:15.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:06:18.210 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-06T17:06:24.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:07:04.190 WARNING:teuthology.provision.fog.smithi106:timed out
2024-04-06T17:07:06.102 WARNING:teuthology.provision.fog.smithi104:timed out
2024-04-06T17:07:10.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:07:10.429 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-06T17:07:10.429 DEBUG:teuthology.orchestra.run.smithi106:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-06T17:07:10.697 INFO:teuthology.provision.fog.smithi106:Node is ready
2024-04-06T17:07:10.698 DEBUG:teuthology.orchestra.run.smithi106:> hostname
2024-04-06T17:07:10.718 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com
2024-04-06T17:07:10.718 DEBUG:teuthology.orchestra.run.smithi106:> grep smithi106.front.sepia.ceph.com /etc/hosts
2024-04-06T17:07:10.778 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106
2024-04-06T17:07:10.779 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106
2024-04-06T17:07:10.884 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hosts
2024-04-06T17:07:10.915 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/172.21.15.106/172.21.15.106/g' /etc/hosts
2024-04-06T17:07:10.983 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hostname
2024-04-06T17:07:11.052 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106
2024-04-06T17:07:11.119 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release
2024-04-06T17:07:11.177 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream"
2024-04-06T17:07:11.177 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="8"
2024-04-06T17:07:11.177 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos"
2024-04-06T17:07:11.178 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora"
2024-04-06T17:07:11.178 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="8"
2024-04-06T17:07:11.178 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el8"
2024-04-06T17:07:11.178 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-06T17:07:11.178 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31"
2024-04-06T17:07:11.179 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-06T17:07:11.179 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/"
2024-04-06T17:07:11.179 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-06T17:07:11.179 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-06T17:07:11.179 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-06T17:07:11.180 INFO:teuthology.provision.fog.smithi106:Deploy complete!
2024-04-06T17:07:11.183 DEBUG:teuthology.parallel:result is None
2024-04-06T17:07:12.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:07:12.363 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-06T17:07:12.363 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-06T17:07:12.625 INFO:teuthology.provision.fog.smithi104:Node is ready
2024-04-06T17:07:12.625 DEBUG:teuthology.orchestra.run.smithi104:> hostname
2024-04-06T17:07:12.644 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com
2024-04-06T17:07:12.644 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts
2024-04-06T17:07:12.704 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104
2024-04-06T17:07:12.704 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2024-04-06T17:07:12.818 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts
2024-04-06T17:07:12.847 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts
2024-04-06T17:07:12.916 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname
2024-04-06T17:07:12.984 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2024-04-06T17:07:13.051 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2024-04-06T17:07:13.109 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream"
2024-04-06T17:07:13.109 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8"
2024-04-06T17:07:13.109 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos"
2024-04-06T17:07:13.109 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora"
2024-04-06T17:07:13.109 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8"
2024-04-06T17:07:13.109 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8"
2024-04-06T17:07:13.110 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-06T17:07:13.110 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2024-04-06T17:07:13.110 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-06T17:07:13.110 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/"
2024-04-06T17:07:13.110 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-06T17:07:13.110 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-06T17:07:13.110 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-06T17:07:13.110 INFO:teuthology.provision.fog.smithi104:Deploy complete!
2024-04-06T17:07:13.111 DEBUG:teuthology.parallel:result is None
2024-04-06T17:07:24.230 WARNING:teuthology.provision.fog.smithi152:timed out
2024-04-06T17:07:30.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:07:30.514 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-06T17:07:30.514 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-06T17:07:30.763 INFO:teuthology.provision.fog.smithi152:Node is ready
2024-04-06T17:07:30.763 DEBUG:teuthology.orchestra.run.smithi152:> hostname
2024-04-06T17:07:30.782 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com
2024-04-06T17:07:30.782 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts
2024-04-06T17:07:30.841 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152
2024-04-06T17:07:30.842 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152
2024-04-06T17:07:30.951 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts
2024-04-06T17:07:30.980 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts
2024-04-06T17:07:31.048 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname
2024-04-06T17:07:31.115 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152
2024-04-06T17:07:31.182 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release
2024-04-06T17:07:31.240 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream"
2024-04-06T17:07:31.240 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8"
2024-04-06T17:07:31.240 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos"
2024-04-06T17:07:31.241 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora"
2024-04-06T17:07:31.241 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8"
2024-04-06T17:07:31.241 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8"
2024-04-06T17:07:31.241 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-06T17:07:31.241 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2024-04-06T17:07:31.241 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-06T17:07:31.241 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/"
2024-04-06T17:07:31.241 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-06T17:07:31.241 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-06T17:07:31.241 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-06T17:07:31.241 INFO:teuthology.provision.fog.smithi152:Deploy complete!
2024-04-06T17:07:31.242 DEBUG:teuthology.parallel:result is None
2024-04-06T17:07:31.431 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com
2024-04-06T17:07:31.432 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-06T17:07:31.457 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com
2024-04-06T17:07:31.457 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-06T17:07:31.481 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com
2024-04-06T17:07:31.481 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-06T17:07:31.508 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server
2024-04-06T17:07:31.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com'
2024-04-06T17:07:31.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:07:31.588 DEBUG:teuthology.orchestra.run.smithi104:> true
2024-04-06T17:07:31.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com'
2024-04-06T17:07:31.726 DEBUG:teuthology.orchestra.run.smithi104:> uname -m
2024-04-06T17:07:31.785 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64
2024-04-06T17:07:31.785 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2024-04-06T17:07:31.843 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream"
2024-04-06T17:07:31.843 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8"
2024-04-06T17:07:31.843 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos"
2024-04-06T17:07:31.843 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora"
2024-04-06T17:07:31.843 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8"
2024-04-06T17:07:31.843 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8"
2024-04-06T17:07:31.844 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-06T17:07:31.844 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2024-04-06T17:07:31.844 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-06T17:07:31.844 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/"
2024-04-06T17:07:31.844 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-06T17:07:31.844 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-06T17:07:31.844 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-06T17:07:31.844 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2024-04-06T17:07:31.865 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server
2024-04-06T17:07:31.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com'
2024-04-06T17:07:31.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:07:31.941 DEBUG:teuthology.orchestra.run.smithi106:> true
2024-04-06T17:07:32.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com'
2024-04-06T17:07:32.077 DEBUG:teuthology.orchestra.run.smithi106:> uname -m
2024-04-06T17:07:32.139 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64
2024-04-06T17:07:32.139 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release
2024-04-06T17:07:32.198 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream"
2024-04-06T17:07:32.199 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="8"
2024-04-06T17:07:32.199 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos"
2024-04-06T17:07:32.199 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora"
2024-04-06T17:07:32.199 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="8"
2024-04-06T17:07:32.199 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el8"
2024-04-06T17:07:32.199 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-06T17:07:32.199 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31"
2024-04-06T17:07:32.199 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-06T17:07:32.199 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/"
2024-04-06T17:07:32.199 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-06T17:07:32.199 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-06T17:07:32.200 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-06T17:07:32.200 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2024-04-06T17:07:32.223 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server
2024-04-06T17:07:32.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2024-04-06T17:07:32.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-06T17:07:32.297 DEBUG:teuthology.orchestra.run.smithi152:> true
2024-04-06T17:07:32.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com'
2024-04-06T17:07:32.366 DEBUG:teuthology.orchestra.run.smithi152:> uname -m
2024-04-06T17:07:32.424 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64
2024-04-06T17:07:32.425 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release
2024-04-06T17:07:32.483 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream"
2024-04-06T17:07:32.483 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8"
2024-04-06T17:07:32.484 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos"
2024-04-06T17:07:32.484 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora"
2024-04-06T17:07:32.484 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8"
2024-04-06T17:07:32.484 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8"
2024-04-06T17:07:32.484 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-06T17:07:32.484 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2024-04-06T17:07:32.484 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-06T17:07:32.484 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/"
2024-04-06T17:07:32.484 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-06T17:07:32.484 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-06T17:07:32.484 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-06T17:07:32.485 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2024-04-06T17:07:32.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:07:32.606 INFO:teuthology.dispatcher.supervisor:Running job 7642574
2024-04-06T17:07:32.606 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-06_14:49:40-rados-wip-yuri3-testing-2024-04-05-0825-distro-default-smithi/7642574 --name yuriw-2024-04-06_14:49:40-rados-wip-yuri3-testing-2024-04-05-0825-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} -- /home/teuthworker/archive/yuriw-2024-04-06_14:49:40-rados-wip-yuri3-testing-2024-04-05-0825-distro-default-smithi/7642574/orig.config.yaml
2024-04-06T17:07:32.610 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-06_14:49:40-rados-wip-yuri3-testing-2024-04-05-0825-distro-default-smithi/7642574
2024-04-06T17:07:32.610 INFO:teuthology.dispatcher.supervisor:Job PID: 4092643
2024-04-06T17:07:32.610 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-06T17:09:32.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:11:32.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:13:33.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:15:33.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:17:33.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:19:33.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:21:33.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:23:33.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:25:34.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:27:34.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:29:34.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:31:34.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:33:34.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:35:34.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:37:35.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-06T17:37:35.199 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1