2024-03-24T22:28:33.586 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-24T22:28:33.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:28:33.748 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ffb3bc7af40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ffb3ccdbc10>, signals=[15])
2024-03-24T22:28:33.749 INFO:teuthology.lock.ops:Start node 'smithi042.front.sepia.ceph.com' reimaging
2024-03-24T22:28:33.749 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T22:28:33.749 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server
2024-03-24T22:28:33.770 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging
2024-03-24T22:28:33.770 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T22:28:33.770 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2024-03-24T22:28:33.786 INFO:teuthology.lock.ops:Start node 'smithi165.front.sepia.ceph.com' reimaging
2024-03-24T22:28:33.786 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T22:28:33.786 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2024-03-24T22:28:33.894 DEBUG:teuthology.provision.fog.smithi042:Requesting image smithi_centos_8.stream (ID 3)
2024-03-24T22:28:33.904 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_8.stream (ID 3)
2024-03-24T22:28:33.914 DEBUG:teuthology.provision.fog.smithi165:Requesting image smithi_centos_8.stream (ID 3)
2024-03-24T22:28:33.950 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 8.stream
2024-03-24T22:28:33.955 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of centos 8.stream
2024-03-24T22:28:33.969 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 8.stream
2024-03-24T22:28:34.162 INFO:teuthology.orchestra.console.smithi062:Power off
2024-03-24T22:28:34.162 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T22:28:34.173 INFO:teuthology.orchestra.console.smithi042:Power off
2024-03-24T22:28:34.173 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T22:28:34.185 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off
2024-03-24T22:28:34.185 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:34.196 DEBUG:teuthology.orchestra.console.smithi042:power off output: Chassis Power Control: Down/Off
2024-03-24T22:28:34.196 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:34.212 INFO:teuthology.orchestra.console.smithi165:Power off
2024-03-24T22:28:34.212 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T22:28:34.221 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on
2024-03-24T22:28:34.222 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2024-03-24T22:28:34.234 DEBUG:teuthology.orchestra.console.smithi165:power off output: Chassis Power Control: Down/Off
2024-03-24T22:28:34.235 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:34.258 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-03-24T22:28:38.226 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:38.233 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:38.259 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:38.335 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on
2024-03-24T22:28:38.342 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2024-03-24T22:28:38.367 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-03-24T22:28:42.339 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:42.346 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:42.367 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:42.449 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off
2024-03-24T22:28:42.456 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2024-03-24T22:28:42.477 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-03-24T22:28:42.549 INFO:teuthology.orchestra.console.smithi042:Power off completed
2024-03-24T22:28:42.650 INFO:teuthology.orchestra.console.smithi042:Power on
2024-03-24T22:28:42.650 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T22:28:42.673 DEBUG:teuthology.orchestra.console.smithi042:power on output: Chassis Power Control: Up/On
2024-03-24T22:28:42.674 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:42.695 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off
2024-03-24T22:28:46.460 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:46.478 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:46.569 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2024-03-24T22:28:46.587 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off
2024-03-24T22:28:46.671 INFO:teuthology.orchestra.console.smithi062:Power off completed
2024-03-24T22:28:46.688 INFO:teuthology.orchestra.console.smithi165:Power off completed
2024-03-24T22:28:46.696 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:46.772 INFO:teuthology.orchestra.console.smithi062:Power on
2024-03-24T22:28:46.772 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T22:28:46.788 INFO:teuthology.orchestra.console.smithi165:Power on
2024-03-24T22:28:46.788 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T22:28:46.796 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On
2024-03-24T22:28:46.796 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:46.805 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off
2024-03-24T22:28:46.808 DEBUG:teuthology.orchestra.console.smithi165:power on output: Chassis Power Control: Up/On
2024-03-24T22:28:46.809 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:46.817 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2024-03-24T22:28:46.829 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off
2024-03-24T22:28:50.811 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:50.819 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:50.830 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:50.920 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on
2024-03-24T22:28:50.928 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2024-03-24T22:28:50.939 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is off
2024-03-24T22:28:51.021 INFO:teuthology.orchestra.console.smithi042:Power on completed
2024-03-24T22:28:51.121 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish
2024-03-24T22:28:54.933 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:54.940 DEBUG:teuthology.orchestra.console.smithi165:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T22:28:55.042 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2024-03-24T22:28:55.048 DEBUG:teuthology.orchestra.console.smithi165:check power output: Chassis Power is on
2024-03-24T22:28:55.143 INFO:teuthology.orchestra.console.smithi062:Power on completed
2024-03-24T22:28:55.149 INFO:teuthology.orchestra.console.smithi165:Power on completed
2024-03-24T22:28:55.244 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish
2024-03-24T22:28:55.250 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish
2024-03-24T22:31:21.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:31:24.962 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-03-24T22:31:30.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:31:34.047 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-03-24T22:31:41.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:31:41.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:31:41.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:31:44.062 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2024-03-24T22:31:44.063 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-03-24T22:31:44.063 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-24T22:31:50.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:31:50.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:31:50.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:31:53.150 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2024-03-24T22:31:53.151 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-03-24T22:31:53.151 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-24T22:31:59.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:31:59.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:31:59.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:32:02.206 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2024-03-24T22:32:02.207 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-03-24T22:32:02.238 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-24T22:32:08.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:32:08.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:32:08.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:32:11.266 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2024-03-24T22:32:11.267 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42
2024-03-24T22:32:11.298 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-24T22:32:17.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:32:17.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:32:17.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:32:20.351 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2024-03-24T22:32:20.351 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-24T22:32:26.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:32:26.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:32:29.442 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-24T22:32:35.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:32:38.526 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-24T22:32:44.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:32:47.582 WARNING:teuthology.provision.fog.smithi165:[Errno None] Unable to connect to port 22 on 172.21.15.165
2024-03-24T22:32:53.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:33:17.299 WARNING:teuthology.provision.fog.smithi042:timed out
2024-03-24T22:33:23.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:33:23.574 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T22:33:23.574 DEBUG:teuthology.orchestra.run.smithi042:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T22:33:23.817 INFO:teuthology.provision.fog.smithi042:Node is ready
2024-03-24T22:33:23.817 DEBUG:teuthology.orchestra.run.smithi042:> hostname
2024-03-24T22:33:23.837 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com
2024-03-24T22:33:23.838 DEBUG:teuthology.orchestra.run.smithi042:> grep smithi042.front.sepia.ceph.com /etc/hosts
2024-03-24T22:33:23.898 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042
2024-03-24T22:33:23.898 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042
2024-03-24T22:33:23.994 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hosts
2024-03-24T22:33:24.025 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/172.21.15.42/172.21.15.42/g' /etc/hosts
2024-03-24T22:33:24.095 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hostname
2024-03-24T22:33:24.164 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042
2024-03-24T22:33:24.233 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release
2024-03-24T22:33:24.291 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream"
2024-03-24T22:33:24.292 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="8"
2024-03-24T22:33:24.292 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos"
2024-03-24T22:33:24.292 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora"
2024-03-24T22:33:24.292 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="8"
2024-03-24T22:33:24.292 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el8"
2024-03-24T22:33:24.292 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-24T22:33:24.292 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31"
2024-03-24T22:33:24.292 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-24T22:33:24.292 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/"
2024-03-24T22:33:24.292 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T22:33:24.292 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-24T22:33:24.293 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T22:33:24.293 INFO:teuthology.provision.fog.smithi042:Deploy complete!
2024-03-24T22:33:24.295 DEBUG:teuthology.parallel:result is None
2024-03-24T22:33:26.358 WARNING:teuthology.provision.fog.smithi062:timed out
2024-03-24T22:33:32.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:33:32.635 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T22:33:32.635 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T22:33:32.881 INFO:teuthology.provision.fog.smithi062:Node is ready
2024-03-24T22:33:32.882 DEBUG:teuthology.orchestra.run.smithi062:> hostname
2024-03-24T22:33:32.901 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com
2024-03-24T22:33:32.902 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts
2024-03-24T22:33:32.961 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062
2024-03-24T22:33:32.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2024-03-24T22:33:33.081 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts
2024-03-24T22:33:33.111 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts
2024-03-24T22:33:33.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname
2024-03-24T22:33:33.250 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2024-03-24T22:33:33.318 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2024-03-24T22:33:33.377 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2024-03-24T22:33:33.377 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8"
2024-03-24T22:33:33.377 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2024-03-24T22:33:33.377 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2024-03-24T22:33:33.377 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8"
2024-03-24T22:33:33.377 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2024-03-24T22:33:33.377 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-24T22:33:33.377 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2024-03-24T22:33:33.377 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-24T22:33:33.377 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2024-03-24T22:33:33.377 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T22:33:33.378 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-24T22:33:33.378 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T22:33:33.378 INFO:teuthology.provision.fog.smithi062:Deploy complete!
2024-03-24T22:33:33.378 DEBUG:teuthology.parallel:result is None
2024-03-24T22:33:53.608 WARNING:teuthology.provision.fog.smithi165:timed out
2024-03-24T22:33:59.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:33:59.881 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T22:33:59.881 DEBUG:teuthology.orchestra.run.smithi165:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T22:34:00.117 INFO:teuthology.provision.fog.smithi165:Node is ready
2024-03-24T22:34:00.117 DEBUG:teuthology.orchestra.run.smithi165:> hostname
2024-03-24T22:34:00.181 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com
2024-03-24T22:34:00.181 DEBUG:teuthology.orchestra.run.smithi165:> grep smithi165.front.sepia.ceph.com /etc/hosts
2024-03-24T22:34:00.241 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165
2024-03-24T22:34:00.241 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165
2024-03-24T22:34:00.343 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hosts
2024-03-24T22:34:00.373 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/172.21.15.165/172.21.15.165/g' /etc/hosts
2024-03-24T22:34:00.444 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i -e 's/smithi165.front.sepia.ceph.com/smithi165/g' /etc/hostname
2024-03-24T22:34:00.513 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname smithi165
2024-03-24T22:34:00.579 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release
2024-03-24T22:34:00.637 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream"
2024-03-24T22:34:00.638 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8"
2024-03-24T22:34:00.638 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos"
2024-03-24T22:34:00.638 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora"
2024-03-24T22:34:00.638 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8"
2024-03-24T22:34:00.638 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8"
2024-03-24T22:34:00.638 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-24T22:34:00.638 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2024-03-24T22:34:00.638 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-24T22:34:00.638 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/"
2024-03-24T22:34:00.638 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T22:34:00.638 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-24T22:34:00.638 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T22:34:00.639 INFO:teuthology.provision.fog.smithi165:Deploy complete!
2024-03-24T22:34:00.639 DEBUG:teuthology.parallel:result is None
2024-03-24T22:34:00.871 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com
2024-03-24T22:34:00.871 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T22:34:00.890 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com
2024-03-24T22:34:00.890 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T22:34:00.906 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com
2024-03-24T22:34:00.906 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T22:34:00.924 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server
2024-03-24T22:34:00.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com'
2024-03-24T22:34:00.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:34:01.005 DEBUG:teuthology.orchestra.run.smithi042:> true
2024-03-24T22:34:01.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com'
2024-03-24T22:34:01.146 DEBUG:teuthology.orchestra.run.smithi042:> uname -m
2024-03-24T22:34:01.206 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64
2024-03-24T22:34:01.207 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release
2024-03-24T22:34:01.266 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream"
2024-03-24T22:34:01.267 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="8"
2024-03-24T22:34:01.267 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos"
2024-03-24T22:34:01.267 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora"
2024-03-24T22:34:01.267 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="8"
2024-03-24T22:34:01.267 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el8"
2024-03-24T22:34:01.267 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-24T22:34:01.267 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31"
2024-03-24T22:34:01.267 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-24T22:34:01.267 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/"
2024-03-24T22:34:01.267 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T22:34:01.267 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-24T22:34:01.267 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T22:34:01.268 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server
2024-03-24T22:34:01.290 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server
2024-03-24T22:34:01.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2024-03-24T22:34:01.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:34:01.372 DEBUG:teuthology.orchestra.run.smithi062:> true
2024-03-24T22:34:01.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com'
2024-03-24T22:34:01.510 DEBUG:teuthology.orchestra.run.smithi062:> uname -m
2024-03-24T22:34:01.571 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64
2024-03-24T22:34:01.571 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2024-03-24T22:34:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2024-03-24T22:34:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8"
2024-03-24T22:34:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2024-03-24T22:34:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2024-03-24T22:34:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8"
2024-03-24T22:34:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2024-03-24T22:34:01.632 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-24T22:34:01.633 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2024-03-24T22:34:01.633 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-24T22:34:01.633 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2024-03-24T22:34:01.633 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T22:34:01.633 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-24T22:34:01.633 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T22:34:01.634 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2024-03-24T22:34:01.658 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server
2024-03-24T22:34:01.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com'
2024-03-24T22:34:01.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T22:34:01.739 DEBUG:teuthology.orchestra.run.smithi165:> true
2024-03-24T22:34:01.812 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com'
2024-03-24T22:34:01.812 DEBUG:teuthology.orchestra.run.smithi165:> uname -m
2024-03-24T22:34:01.874 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64
2024-03-24T22:34:01.875 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release
2024-03-24T22:34:01.935 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream"
2024-03-24T22:34:01.935 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8"
2024-03-24T22:34:01.935 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos"
2024-03-24T22:34:01.935 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora"
2024-03-24T22:34:01.935 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8"
2024-03-24T22:34:01.935 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8"
2024-03-24T22:34:01.935 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-24T22:34:01.935 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2024-03-24T22:34:01.935 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-24T22:34:01.935 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/"
2024-03-24T22:34:01.935 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T22:34:01.935 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-24T22:34:01.936 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T22:34:01.936 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2024-03-24T22:34:01.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:34:02.061 INFO:teuthology.dispatcher.supervisor:Running job 7620488
2024-03-24T22:34:02.061 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-24_22:19:24-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7620488 --name yuriw-2024-03-24_22:19:24-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api} -- /home/teuthworker/archive/yuriw-2024-03-24_22:19:24-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7620488/orig.config.yaml
2024-03-24T22:34:02.066 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-24_22:19:24-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7620488
2024-03-24T22:34:02.066 INFO:teuthology.dispatcher.supervisor:Job PID: 3561534
2024-03-24T22:34:02.066 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-24T22:36:02.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:38:02.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:40:02.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:42:02.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:44:02.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:46:03.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:48:03.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:50:04.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:52:04.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:54:04.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:56:04.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T22:58:04.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T23:00:05.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T23:02:05.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T23:02:05.487 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1