2024-03-14T04:19:42.472 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-14T04:19:42.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:19:42.653 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fcc1d755f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fcc1e7b6c10>, signals=[15])
2024-03-14T04:19:42.653 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging
2024-03-14T04:19:42.654 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T04:19:42.654 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2024-03-14T04:19:42.678 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging
2024-03-14T04:19:42.678 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T04:19:42.678 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2024-03-14T04:19:42.702 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging
2024-03-14T04:19:42.703 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server
2024-03-14T04:19:42.703 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2024-03-14T04:19:42.800 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_centos_8.stream (ID 3)
2024-03-14T04:19:42.827 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_centos_8.stream (ID 3)
2024-03-14T04:19:42.836 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_8.stream (ID 3)
2024-03-14T04:19:42.851 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of centos 8.stream
2024-03-14T04:19:42.884 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 8.stream
2024-03-14T04:19:42.892 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 8.stream
2024-03-14T04:19:43.131 INFO:teuthology.orchestra.console.smithi032:Power off
2024-03-14T04:19:43.131 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T04:19:43.148 INFO:teuthology.orchestra.console.smithi157:Power off
2024-03-14T04:19:43.148 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T04:19:43.160 INFO:teuthology.orchestra.console.smithi090:Power off
2024-03-14T04:19:43.160 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-14T04:19:43.168 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off
2024-03-14T04:19:43.169 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:43.177 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off
2024-03-14T04:19:43.178 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:43.186 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off
2024-03-14T04:19:43.187 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:43.196 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-03-14T04:19:43.199 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-03-14T04:19:43.209 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-03-14T04:19:47.198 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:47.205 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:47.211 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:47.307 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-03-14T04:19:47.313 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-03-14T04:19:47.320 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-03-14T04:19:51.310 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:51.319 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:51.327 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:51.422 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-03-14T04:19:51.429 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-03-14T04:19:51.437 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off
2024-03-14T04:19:51.531 INFO:teuthology.orchestra.console.smithi157:Power off completed
2024-03-14T04:19:51.538 INFO:teuthology.orchestra.console.smithi090:Power off completed
2024-03-14T04:19:51.632 INFO:teuthology.orchestra.console.smithi157:Power on
2024-03-14T04:19:51.632 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T04:19:51.641 INFO:teuthology.orchestra.console.smithi090:Power on
2024-03-14T04:19:51.642 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T04:19:51.656 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On
2024-03-14T04:19:51.657 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:51.667 DEBUG:teuthology.orchestra.console.smithi090:power on output: Chassis Power Control: Up/On
2024-03-14T04:19:51.667 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:51.684 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-03-14T04:19:51.690 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off
2024-03-14T04:19:55.429 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:55.538 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-03-14T04:19:55.639 INFO:teuthology.orchestra.console.smithi032:Power off completed
2024-03-14T04:19:55.685 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:55.696 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:55.740 INFO:teuthology.orchestra.console.smithi032:Power on
2024-03-14T04:19:55.741 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-14T04:19:55.763 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On
2024-03-14T04:19:55.764 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:55.787 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-03-14T04:19:55.798 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-03-14T04:19:55.805 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off
2024-03-14T04:19:59.789 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:59.799 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:59.807 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-14T04:19:59.899 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-03-14T04:19:59.916 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-03-14T04:19:59.924 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-03-14T04:19:59.999 INFO:teuthology.orchestra.console.smithi032:Power on completed
2024-03-14T04:20:00.017 INFO:teuthology.orchestra.console.smithi090:Power on completed
2024-03-14T04:20:00.025 INFO:teuthology.orchestra.console.smithi157:Power on completed
2024-03-14T04:20:00.101 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish
2024-03-14T04:20:00.118 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish
2024-03-14T04:20:00.126 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish
2024-03-14T04:22:31.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:22:34.110 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-14T04:22:40.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:22:43.170 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-14T04:22:49.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:22:52.258 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-14T04:22:58.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:23:01.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:23:01.342 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-14T04:23:04.258 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-14T04:23:07.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:23:10.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:23:13.342 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-14T04:23:16.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:23:19.298 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-14T04:23:19.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:23:22.398 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-14T04:23:25.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:23:28.382 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-14T04:23:28.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:23:31.458 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-14T04:23:34.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:23:37.438 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-14T04:23:37.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:23:40.510 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-14T04:23:43.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:23:46.494 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-14T04:23:46.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:23:49.566 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-14T04:23:52.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:23:55.550 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-14T04:23:55.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:23:58.622 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-14T04:24:01.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:24:04.610 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-14T04:24:04.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:24:07.350 WARNING:teuthology.provision.fog.smithi032:timed out
2024-03-14T04:24:07.682 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-14T04:24:10.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:24:13.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:24:13.569 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T04:24:13.570 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T04:24:13.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:24:13.694 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-14T04:24:13.928 INFO:teuthology.provision.fog.smithi032:Node is ready
2024-03-14T04:24:13.929 DEBUG:teuthology.orchestra.run.smithi032:> hostname
2024-03-14T04:24:13.950 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com
2024-03-14T04:24:13.951 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts
2024-03-14T04:24:14.012 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032
2024-03-14T04:24:14.013 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2024-03-14T04:24:14.124 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts
2024-03-14T04:24:14.155 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts
2024-03-14T04:24:14.227 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname
2024-03-14T04:24:14.296 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2024-03-14T04:24:14.365 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2024-03-14T04:24:14.424 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream"
2024-03-14T04:24:14.425 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8"
2024-03-14T04:24:14.425 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos"
2024-03-14T04:24:14.425 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora"
2024-03-14T04:24:14.425 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8"
2024-03-14T04:24:14.425 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8"
2024-03-14T04:24:14.425 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-14T04:24:14.425 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2024-03-14T04:24:14.425 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-14T04:24:14.425 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/"
2024-03-14T04:24:14.425 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T04:24:14.425 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-14T04:24:14.425 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T04:24:14.426 INFO:teuthology.provision.fog.smithi032:Deploy complete!
2024-03-14T04:24:14.428 DEBUG:teuthology.parallel:result is None
2024-03-14T04:24:16.766 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-03-14T04:24:19.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:24:22.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:25:19.755 WARNING:teuthology.provision.fog.smithi090:timed out
2024-03-14T04:25:22.775 WARNING:teuthology.provision.fog.smithi157:timed out
2024-03-14T04:25:25.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:25:26.062 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T04:25:26.062 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T04:25:26.414 INFO:teuthology.provision.fog.smithi090:Node is ready
2024-03-14T04:25:26.414 DEBUG:teuthology.orchestra.run.smithi090:> hostname
2024-03-14T04:25:26.434 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com
2024-03-14T04:25:26.434 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts
2024-03-14T04:25:26.494 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090
2024-03-14T04:25:26.494 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090
2024-03-14T04:25:26.615 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts
2024-03-14T04:25:26.645 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts
2024-03-14T04:25:26.715 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname
2024-03-14T04:25:26.784 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090
2024-03-14T04:25:26.851 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release
2024-03-14T04:25:26.910 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream"
2024-03-14T04:25:26.910 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8"
2024-03-14T04:25:26.910 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos"
2024-03-14T04:25:26.910 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora"
2024-03-14T04:25:26.910 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8"
2024-03-14T04:25:26.910 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8"
2024-03-14T04:25:26.911 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-14T04:25:26.911 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31"
2024-03-14T04:25:26.911 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-14T04:25:26.911 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/"
2024-03-14T04:25:26.911 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T04:25:26.911 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-14T04:25:26.911 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T04:25:26.911 INFO:teuthology.provision.fog.smithi090:Deploy complete!
2024-03-14T04:25:26.912 DEBUG:teuthology.parallel:result is None
2024-03-14T04:25:28.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:25:29.008 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-14T04:25:29.009 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-14T04:25:29.259 INFO:teuthology.provision.fog.smithi157:Node is ready
2024-03-14T04:25:29.259 DEBUG:teuthology.orchestra.run.smithi157:> hostname
2024-03-14T04:25:29.277 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com
2024-03-14T04:25:29.277 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157.front.sepia.ceph.com /etc/hosts
2024-03-14T04:25:29.336 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157
2024-03-14T04:25:29.336 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2024-03-14T04:25:29.445 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hosts
2024-03-14T04:25:29.474 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts
2024-03-14T04:25:29.541 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157.front.sepia.ceph.com/smithi157/g' /etc/hostname
2024-03-14T04:25:29.609 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2024-03-14T04:25:29.675 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2024-03-14T04:25:29.733 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream"
2024-03-14T04:25:29.733 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8"
2024-03-14T04:25:29.733 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos"
2024-03-14T04:25:29.733 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora"
2024-03-14T04:25:29.733 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8"
2024-03-14T04:25:29.733 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8"
2024-03-14T04:25:29.734 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-14T04:25:29.734 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2024-03-14T04:25:29.734 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-14T04:25:29.734 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/"
2024-03-14T04:25:29.734 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T04:25:29.734 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-14T04:25:29.734 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T04:25:29.734 INFO:teuthology.provision.fog.smithi157:Deploy complete!
2024-03-14T04:25:29.735 DEBUG:teuthology.parallel:result is None
2024-03-14T04:25:29.922 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com
2024-03-14T04:25:29.923 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T04:25:29.954 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com
2024-03-14T04:25:29.954 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T04:25:29.978 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com
2024-03-14T04:25:29.978 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-14T04:25:29.996 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server
2024-03-14T04:25:29.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2024-03-14T04:25:29.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:25:30.069 DEBUG:teuthology.orchestra.run.smithi032:> true
2024-03-14T04:25:30.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com'
2024-03-14T04:25:30.213 DEBUG:teuthology.orchestra.run.smithi032:> uname -m
2024-03-14T04:25:30.273 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64
2024-03-14T04:25:30.273 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2024-03-14T04:25:30.333 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream"
2024-03-14T04:25:30.333 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8"
2024-03-14T04:25:30.333 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos"
2024-03-14T04:25:30.333 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora"
2024-03-14T04:25:30.333 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8"
2024-03-14T04:25:30.333 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8"
2024-03-14T04:25:30.333 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-14T04:25:30.333 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2024-03-14T04:25:30.333 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-14T04:25:30.333 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/"
2024-03-14T04:25:30.334 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T04:25:30.334 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-14T04:25:30.334 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T04:25:30.334 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2024-03-14T04:25:30.354 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server
2024-03-14T04:25:30.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com'
2024-03-14T04:25:30.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:25:30.424 DEBUG:teuthology.orchestra.run.smithi090:> true
2024-03-14T04:25:30.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com'
2024-03-14T04:25:30.495 DEBUG:teuthology.orchestra.run.smithi090:> uname -m
2024-03-14T04:25:30.556 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64
2024-03-14T04:25:30.556 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release
2024-03-14T04:25:30.616 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream"
2024-03-14T04:25:30.616 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8"
2024-03-14T04:25:30.616 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos"
2024-03-14T04:25:30.616 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora"
2024-03-14T04:25:30.616 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8"
2024-03-14T04:25:30.616 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8"
2024-03-14T04:25:30.616 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-14T04:25:30.616 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31"
2024-03-14T04:25:30.616 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-14T04:25:30.616 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/"
2024-03-14T04:25:30.616 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T04:25:30.617 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-14T04:25:30.617 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T04:25:30.617 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2024-03-14T04:25:30.637 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server
2024-03-14T04:25:30.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2024-03-14T04:25:30.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-14T04:25:30.706 DEBUG:teuthology.orchestra.run.smithi157:> true
2024-03-14T04:25:30.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com'
2024-03-14T04:25:30.774 DEBUG:teuthology.orchestra.run.smithi157:> uname -m
2024-03-14T04:25:30.832 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64
2024-03-14T04:25:30.832 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2024-03-14T04:25:30.891 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream"
2024-03-14T04:25:30.891 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8"
2024-03-14T04:25:30.891 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos"
2024-03-14T04:25:30.891 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora"
2024-03-14T04:25:30.892 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8"
2024-03-14T04:25:30.892 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8"
2024-03-14T04:25:30.892 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-14T04:25:30.892 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2024-03-14T04:25:30.892 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-14T04:25:30.892 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/"
2024-03-14T04:25:30.892 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-14T04:25:30.892 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-14T04:25:30.892 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-14T04:25:30.892 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2024-03-14T04:25:30.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:25:31.004 INFO:teuthology.dispatcher.supervisor:Running job 7598393
2024-03-14T04:25:31.004 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-13_19:25:03-rados-wip-yuri6-testing-2024-03-12-0858-distro-default-smithi/7598393 --name yuriw-2024-03-13_19:25:03-rados-wip-yuri6-testing-2024-03-12-0858-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} -- /home/teuthworker/archive/yuriw-2024-03-13_19:25:03-rados-wip-yuri6-testing-2024-03-12-0858-distro-default-smithi/7598393/orig.config.yaml
2024-03-14T04:25:31.007 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-13_19:25:03-rados-wip-yuri6-testing-2024-03-12-0858-distro-default-smithi/7598393
2024-03-14T04:25:31.007 INFO:teuthology.dispatcher.supervisor:Job PID: 2613159
2024-03-14T04:25:31.007 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-14T04:27:31.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:29:31.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:31:31.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:33:31.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:35:31.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:37:31.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:39:32.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:41:32.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:43:32.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:45:32.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:47:32.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:49:32.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:51:33.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:53:33.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:55:33.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:57:33.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T04:59:33.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T05:01:33.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T05:03:34.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T05:05:34.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T05:07:34.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T05:09:34.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-14T05:09:34.687 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1