2024-02-08T14:14:31.969 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22
2024-02-08T14:14:31.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:14:32.143 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4efb7dcf70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4efc83dc10>, signals=[15])
2024-02-08T14:14:32.143 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging
2024-02-08T14:14:32.143 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server
2024-02-08T14:14:32.144 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2024-02-08T14:14:32.160 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2024-02-08T14:14:32.160 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2024-02-08T14:14:32.160 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2024-02-08T14:14:32.185 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2024-02-08T14:14:32.185 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2024-02-08T14:14:32.186 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-02-08T14:14:32.275 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_centos_8.stream (ID 3)
2024-02-08T14:14:32.289 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_8.stream (ID 3)
2024-02-08T14:14:32.321 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 8.stream
2024-02-08T14:14:32.329 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream
2024-02-08T14:14:32.332 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_8.stream (ID 3)
2024-02-08T14:14:32.374 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream
2024-02-08T14:14:32.555 INFO:teuthology.orchestra.console.smithi073:Power off
2024-02-08T14:14:32.555 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-08T14:14:32.571 INFO:teuthology.orchestra.console.smithi099:Power off
2024-02-08T14:14:32.571 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-08T14:14:32.584 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off
2024-02-08T14:14:32.584 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:32.594 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2024-02-08T14:14:32.595 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:32.612 INFO:teuthology.orchestra.console.smithi161:Power off
2024-02-08T14:14:32.612 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-08T14:14:32.621 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2024-02-08T14:14:32.621 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2024-02-08T14:14:32.635 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2024-02-08T14:14:32.635 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:32.660 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-02-08T14:14:36.623 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:36.631 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:36.662 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:36.733 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2024-02-08T14:14:36.741 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2024-02-08T14:14:36.772 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-02-08T14:14:40.737 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:40.746 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:40.773 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:40.848 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2024-02-08T14:14:40.855 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2024-02-08T14:14:40.881 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-02-08T14:14:40.982 INFO:teuthology.orchestra.console.smithi161:Power off completed
2024-02-08T14:14:41.083 INFO:teuthology.orchestra.console.smithi161:Power on
2024-02-08T14:14:41.083 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-08T14:14:41.105 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On
2024-02-08T14:14:41.106 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:41.127 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-02-08T14:14:44.851 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:44.858 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:44.961 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2024-02-08T14:14:44.966 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2024-02-08T14:14:45.062 INFO:teuthology.orchestra.console.smithi073:Power off completed
2024-02-08T14:14:45.067 INFO:teuthology.orchestra.console.smithi099:Power off completed
2024-02-08T14:14:45.129 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:45.163 INFO:teuthology.orchestra.console.smithi073:Power on
2024-02-08T14:14:45.164 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-08T14:14:45.171 INFO:teuthology.orchestra.console.smithi099:Power on
2024-02-08T14:14:45.171 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-08T14:14:45.186 DEBUG:teuthology.orchestra.console.smithi073:power on output: Chassis Power Control: Up/On
2024-02-08T14:14:45.186 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:45.194 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On
2024-02-08T14:14:45.195 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:45.207 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2024-02-08T14:14:45.216 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2024-02-08T14:14:45.238 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-02-08T14:14:49.212 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:49.221 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:49.239 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-08T14:14:49.322 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2024-02-08T14:14:49.329 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2024-02-08T14:14:49.347 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-02-08T14:14:49.424 INFO:teuthology.orchestra.console.smithi073:Power on completed
2024-02-08T14:14:49.430 INFO:teuthology.orchestra.console.smithi099:Power on completed
2024-02-08T14:14:49.447 INFO:teuthology.orchestra.console.smithi161:Power on completed
2024-02-08T14:14:49.525 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish
2024-02-08T14:14:49.531 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2024-02-08T14:14:49.549 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2024-02-08T14:17:35.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:17:35.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:17:35.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:17:38.588 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-02-08T14:17:38.589 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-02-08T14:17:38.589 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-02-08T14:17:44.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:17:44.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:17:44.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:17:47.644 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-02-08T14:17:47.676 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-02-08T14:17:47.676 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-02-08T14:17:53.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:17:53.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:17:53.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:17:56.732 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-02-08T14:17:56.733 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-02-08T14:17:56.733 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-02-08T14:18:02.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:18:02.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:18:02.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:18:05.788 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-02-08T14:18:05.820 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-02-08T14:18:05.820 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-02-08T14:18:11.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:18:11.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:18:11.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:18:14.876 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2024-02-08T14:18:14.877 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-02-08T14:18:14.877 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-02-08T14:18:20.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:18:20.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:18:20.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:18:23.964 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-02-08T14:18:23.965 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2024-02-08T14:18:29.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:18:29.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:18:33.052 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-02-08T14:18:39.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:18:42.140 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-02-08T14:18:48.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:19:20.918 WARNING:teuthology.provision.fog.smithi099:timed out
2024-02-08T14:19:26.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:19:27.195 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-08T14:19:27.196 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-08T14:19:27.434 INFO:teuthology.provision.fog.smithi099:Node is ready
2024-02-08T14:19:27.434 DEBUG:teuthology.orchestra.run.smithi099:> hostname
2024-02-08T14:19:27.453 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2024-02-08T14:19:27.454 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts
2024-02-08T14:19:27.513 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2024-02-08T14:19:27.514 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2024-02-08T14:19:27.623 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts
2024-02-08T14:19:27.652 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts
2024-02-08T14:19:27.720 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname
2024-02-08T14:19:27.787 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2024-02-08T14:19:27.854 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2024-02-08T14:19:27.913 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2024-02-08T14:19:27.913 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8"
2024-02-08T14:19:27.913 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2024-02-08T14:19:27.913 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2024-02-08T14:19:27.913 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8"
2024-02-08T14:19:27.913 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2024-02-08T14:19:27.913 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-08T14:19:27.913 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2024-02-08T14:19:27.913 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-08T14:19:27.913 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2024-02-08T14:19:27.913 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-08T14:19:27.914 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-08T14:19:27.914 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-08T14:19:27.915 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2024-02-08T14:19:27.916 DEBUG:teuthology.parallel:result is None
2024-02-08T14:19:29.977 WARNING:teuthology.provision.fog.smithi073:timed out
2024-02-08T14:19:35.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:19:36.273 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-08T14:19:36.274 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-08T14:19:36.517 INFO:teuthology.provision.fog.smithi073:Node is ready
2024-02-08T14:19:36.518 DEBUG:teuthology.orchestra.run.smithi073:> hostname
2024-02-08T14:19:36.537 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com
2024-02-08T14:19:36.537 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073.front.sepia.ceph.com /etc/hosts
2024-02-08T14:19:36.596 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073
2024-02-08T14:19:36.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073
2024-02-08T14:19:36.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hosts
2024-02-08T14:19:36.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts
2024-02-08T14:19:36.806 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hostname
2024-02-08T14:19:36.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073
2024-02-08T14:19:36.941 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release
2024-02-08T14:19:36.999 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream"
2024-02-08T14:19:37.000 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8"
2024-02-08T14:19:37.000 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos"
2024-02-08T14:19:37.000 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora"
2024-02-08T14:19:37.000 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8"
2024-02-08T14:19:37.000 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8"
2024-02-08T14:19:37.000 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-08T14:19:37.000 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2024-02-08T14:19:37.000 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-08T14:19:37.000 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/"
2024-02-08T14:19:37.000 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-08T14:19:37.000 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-08T14:19:37.000 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-08T14:19:37.001 INFO:teuthology.provision.fog.smithi073:Deploy complete!
2024-02-08T14:19:37.001 DEBUG:teuthology.parallel:result is None
2024-02-08T14:19:48.160 WARNING:teuthology.provision.fog.smithi161:timed out
2024-02-08T14:19:54.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:19:54.429 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-08T14:19:54.429 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-08T14:19:54.665 INFO:teuthology.provision.fog.smithi161:Node is ready
2024-02-08T14:19:54.665 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2024-02-08T14:19:54.685 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2024-02-08T14:19:54.685 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts
2024-02-08T14:19:54.744 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2024-02-08T14:19:54.745 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-02-08T14:19:54.843 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts
2024-02-08T14:19:54.872 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts
2024-02-08T14:19:54.941 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname
2024-02-08T14:19:55.011 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-02-08T14:19:55.078 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-02-08T14:19:55.136 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2024-02-08T14:19:55.137 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8"
2024-02-08T14:19:55.137 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2024-02-08T14:19:55.137 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2024-02-08T14:19:55.137 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8"
2024-02-08T14:19:55.137 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2024-02-08T14:19:55.137 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-08T14:19:55.137 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-02-08T14:19:55.137 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-08T14:19:55.137 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2024-02-08T14:19:55.137 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-08T14:19:55.137 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-08T14:19:55.137 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-08T14:19:55.138 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2024-02-08T14:19:55.139 DEBUG:teuthology.parallel:result is None
2024-02-08T14:19:55.337 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com
2024-02-08T14:19:55.338 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-08T14:19:55.360 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2024-02-08T14:19:55.360 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-08T14:19:55.376 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2024-02-08T14:19:55.376 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-08T14:19:55.394 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server
2024-02-08T14:19:55.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2024-02-08T14:19:55.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:19:55.472 DEBUG:teuthology.orchestra.run.smithi073:> true
2024-02-08T14:19:55.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com'
2024-02-08T14:19:55.608 DEBUG:teuthology.orchestra.run.smithi073:> uname -m
2024-02-08T14:19:55.668 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64
2024-02-08T14:19:55.668 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release
2024-02-08T14:19:55.728 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream"
2024-02-08T14:19:55.728 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8"
2024-02-08T14:19:55.728 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos"
2024-02-08T14:19:55.728 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora"
2024-02-08T14:19:55.728 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8"
2024-02-08T14:19:55.728 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8"
2024-02-08T14:19:55.728 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-08T14:19:55.728 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2024-02-08T14:19:55.729 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-08T14:19:55.729 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/"
2024-02-08T14:19:55.729 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-08T14:19:55.729 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-08T14:19:55.729 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-08T14:19:55.729 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2024-02-08T14:19:55.752 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2024-02-08T14:19:55.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2024-02-08T14:19:55.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:19:55.830 DEBUG:teuthology.orchestra.run.smithi099:> true
2024-02-08T14:19:55.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com'
2024-02-08T14:19:55.968 DEBUG:teuthology.orchestra.run.smithi099:> uname -m
2024-02-08T14:19:56.028 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2024-02-08T14:19:56.029 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2024-02-08T14:19:56.088 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2024-02-08T14:19:56.088 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8"
2024-02-08T14:19:56.088 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2024-02-08T14:19:56.088 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2024-02-08T14:19:56.088 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8"
2024-02-08T14:19:56.088 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2024-02-08T14:19:56.088 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-08T14:19:56.088 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2024-02-08T14:19:56.088 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-08T14:19:56.088 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2024-02-08T14:19:56.088 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-08T14:19:56.089 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-08T14:19:56.089 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-08T14:19:56.089 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2024-02-08T14:19:56.110 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2024-02-08T14:19:56.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-02-08T14:19:56.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-08T14:19:56.187 DEBUG:teuthology.orchestra.run.smithi161:> true
2024-02-08T14:19:56.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-02-08T14:19:56.257 DEBUG:teuthology.orchestra.run.smithi161:> uname -m
2024-02-08T14:19:56.315 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2024-02-08T14:19:56.316 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-02-08T14:19:56.377 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2024-02-08T14:19:56.377 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8"
2024-02-08T14:19:56.377 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2024-02-08T14:19:56.377 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2024-02-08T14:19:56.378 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8"
2024-02-08T14:19:56.378 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2024-02-08T14:19:56.378 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-08T14:19:56.378 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-02-08T14:19:56.378 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-08T14:19:56.378 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2024-02-08T14:19:56.378 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-08T14:19:56.378 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-08T14:19:56.378 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-08T14:19:56.379 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-02-08T14:19:56.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:19:56.500 INFO:teuthology.dispatcher.supervisor:Running job 7551242
2024-02-08T14:19:56.500 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-08_00:19:25-rados-wip-yuri3-testing-2024-02-07-1233-distro-default-smithi/7551242 --name yuriw-2024-02-08_00:19:25-rados-wip-yuri3-testing-2024-02-07-1233-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} -- /home/teuthworker/archive/yuriw-2024-02-08_00:19:25-rados-wip-yuri3-testing-2024-02-07-1233-distro-default-smithi/7551242/orig.config.yaml
2024-02-08T14:19:56.503 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-08_00:19:25-rados-wip-yuri3-testing-2024-02-07-1233-distro-default-smithi/7551242
2024-02-08T14:19:56.504 INFO:teuthology.dispatcher.supervisor:Job PID: 862499
2024-02-08T14:19:56.504 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-08T14:21:56.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:23:56.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:25:56.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:27:57.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:29:57.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:31:57.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:33:57.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:35:57.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:37:57.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:39:58.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:41:58.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:43:58.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:45:58.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:47:58.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:49:58.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:51:59.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-08T14:51:59.254 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1