2024-02-19T16:13:44.854 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-19T16:13:44.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-19T16:13:45.013 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1558024f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1559085c10>, signals=[15])
2024-02-19T16:13:45.013 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging
2024-02-19T16:13:45.014 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server
2024-02-19T16:13:45.014 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server
2024-02-19T16:13:45.033 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging
2024-02-19T16:13:45.033 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server
2024-02-19T16:13:45.033 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server
2024-02-19T16:13:45.049 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging
2024-02-19T16:13:45.049 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server
2024-02-19T16:13:45.049 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2024-02-19T16:13:45.141 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_centos_9.stream (ID 10)
2024-02-19T16:13:45.164 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_centos_9.stream (ID 10)
2024-02-19T16:13:45.183 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_centos_9.stream (ID 10)
2024-02-19T16:13:45.192 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of centos 9.stream
2024-02-19T16:13:45.210 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of centos 9.stream
2024-02-19T16:13:45.228 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of centos 9.stream
2024-02-19T16:13:45.541 INFO:teuthology.orchestra.console.smithi118:Power off
2024-02-19T16:13:45.541 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-19T16:13:45.554 INFO:teuthology.orchestra.console.smithi177:Power off
2024-02-19T16:13:45.554 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-19T16:13:45.565 INFO:teuthology.orchestra.console.smithi135:Power off
2024-02-19T16:13:45.566 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-19T16:13:45.572 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off
2024-02-19T16:13:45.573 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:13:45.580 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off
2024-02-19T16:13:45.580 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:13:45.589 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off
2024-02-19T16:13:45.589 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:13:45.598 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on
2024-02-19T16:13:45.602 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2024-02-19T16:13:45.613 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on
2024-02-19T16:13:49.601 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:13:49.611 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:13:49.618 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:13:49.713 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on
2024-02-19T16:13:49.719 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2024-02-19T16:13:49.725 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on
2024-02-19T16:13:53.717 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:13:53.725 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:13:53.733 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:13:53.827 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on
2024-02-19T16:13:53.834 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2024-02-19T16:13:53.842 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on
2024-02-19T16:13:57.832 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:13:57.839 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:13:57.845 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:13:57.941 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off
2024-02-19T16:13:57.946 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2024-02-19T16:13:57.953 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off
2024-02-19T16:13:58.042 INFO:teuthology.orchestra.console.smithi118:Power off completed
2024-02-19T16:13:58.047 INFO:teuthology.orchestra.console.smithi177:Power off completed
2024-02-19T16:13:58.053 INFO:teuthology.orchestra.console.smithi135:Power off completed
2024-02-19T16:13:58.144 INFO:teuthology.orchestra.console.smithi118:Power on
2024-02-19T16:13:58.144 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-19T16:13:58.151 INFO:teuthology.orchestra.console.smithi177:Power on
2024-02-19T16:13:58.152 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-19T16:13:58.158 INFO:teuthology.orchestra.console.smithi135:Power on
2024-02-19T16:13:58.158 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-19T16:13:58.166 DEBUG:teuthology.orchestra.console.smithi118:power on output: Chassis Power Control: Up/On
2024-02-19T16:13:58.167 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:13:58.175 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On
2024-02-19T16:13:58.175 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:13:58.184 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On
2024-02-19T16:13:58.185 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:13:58.192 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off
2024-02-19T16:13:58.197 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2024-02-19T16:13:58.205 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off
2024-02-19T16:14:02.197 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:14:02.205 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:14:02.212 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:14:02.307 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on
2024-02-19T16:14:02.314 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2024-02-19T16:14:02.321 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on
2024-02-19T16:14:02.409 INFO:teuthology.orchestra.console.smithi118:Power on completed
2024-02-19T16:14:02.422 INFO:teuthology.orchestra.console.smithi135:Power on completed
2024-02-19T16:14:02.510 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish
2024-02-19T16:14:02.523 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish
2024-02-19T16:14:06.318 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-19T16:14:06.428 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2024-02-19T16:14:06.529 INFO:teuthology.orchestra.console.smithi177:Power on completed
2024-02-19T16:14:06.630 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish
2024-02-19T16:16:37.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:16:40.860 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-02-19T16:16:46.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:16:48.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:16:49.916 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-02-19T16:16:51.964 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-02-19T16:16:55.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:16:57.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:16:58.972 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-02-19T16:17:01.021 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-02-19T16:17:03.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:17:04.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:17:07.008 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-02-19T16:17:07.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:17:08.028 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-02-19T16:17:10.076 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-02-19T16:17:13.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:17:14.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:17:16.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:17:16.092 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-02-19T16:17:17.088 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-02-19T16:17:19.132 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-02-19T16:17:22.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:17:23.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:17:25.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:17:25.148 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-02-19T16:17:26.140 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-02-19T16:17:28.188 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-02-19T16:17:31.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:17:32.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:17:34.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:17:34.204 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-02-19T16:17:37.244 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-02-19T16:17:40.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:17:43.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:17:43.260 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-02-19T16:17:49.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:17:52.348 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-02-19T16:17:58.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:18:01.404 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-02-19T16:18:07.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:18:10.464 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118
2024-02-19T16:18:16.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:18:32.160 WARNING:teuthology.provision.fog.smithi177:timed out
2024-02-19T16:18:38.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:18:38.452 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-19T16:18:38.453 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-19T16:18:38.775 INFO:teuthology.provision.fog.smithi177:Node is ready
2024-02-19T16:18:38.775 DEBUG:teuthology.orchestra.run.smithi177:> hostname
2024-02-19T16:18:38.790 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com
2024-02-19T16:18:38.791 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts
2024-02-19T16:18:38.847 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177
2024-02-19T16:18:38.847 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2024-02-19T16:18:38.952 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts
2024-02-19T16:18:38.980 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts
2024-02-19T16:18:39.049 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname
2024-02-19T16:18:39.117 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2024-02-19T16:18:39.185 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2024-02-19T16:18:39.240 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream"
2024-02-19T16:18:39.240 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9"
2024-02-19T16:18:39.240 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos"
2024-02-19T16:18:39.240 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora"
2024-02-19T16:18:39.240 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9"
2024-02-19T16:18:39.240 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9"
2024-02-19T16:18:39.240 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-19T16:18:39.240 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2024-02-19T16:18:39.240 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon"
2024-02-19T16:18:39.241 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-19T16:18:39.241 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/"
2024-02-19T16:18:39.241 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-19T16:18:39.241 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-19T16:18:39.241 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-19T16:18:39.241 INFO:teuthology.provision.fog.smithi177:Deploy complete!
2024-02-19T16:18:39.243 DEBUG:teuthology.parallel:result is None
2024-02-19T16:18:43.252 WARNING:teuthology.provision.fog.smithi135:timed out
2024-02-19T16:18:49.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:18:49.760 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-19T16:18:49.760 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-19T16:18:50.106 INFO:teuthology.provision.fog.smithi135:Node is ready
2024-02-19T16:18:50.106 DEBUG:teuthology.orchestra.run.smithi135:> hostname
2024-02-19T16:18:50.121 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com
2024-02-19T16:18:50.121 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135.front.sepia.ceph.com /etc/hosts
2024-02-19T16:18:50.180 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135
2024-02-19T16:18:50.181 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135
2024-02-19T16:18:50.286 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hosts
2024-02-19T16:18:50.313 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts
2024-02-19T16:18:50.383 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hostname
2024-02-19T16:18:50.454 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135
2024-02-19T16:18:50.524 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release
2024-02-19T16:18:50.582 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream"
2024-02-19T16:18:50.583 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9"
2024-02-19T16:18:50.583 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos"
2024-02-19T16:18:50.583 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora"
2024-02-19T16:18:50.583 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9"
2024-02-19T16:18:50.583 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9"
2024-02-19T16:18:50.583 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-19T16:18:50.583 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31"
2024-02-19T16:18:50.583 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon"
2024-02-19T16:18:50.583 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-19T16:18:50.583 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/"
2024-02-19T16:18:50.583 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-19T16:18:50.583 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-19T16:18:50.583 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-19T16:18:50.584 INFO:teuthology.provision.fog.smithi135:Deploy complete!
2024-02-19T16:18:50.584 DEBUG:teuthology.parallel:result is None
2024-02-19T16:19:16.496 WARNING:teuthology.provision.fog.smithi118:timed out
2024-02-19T16:19:22.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:19:22.736 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-19T16:19:22.737 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-19T16:19:23.084 INFO:teuthology.provision.fog.smithi118:Node is ready
2024-02-19T16:19:23.084 DEBUG:teuthology.orchestra.run.smithi118:> hostname
2024-02-19T16:19:23.099 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com
2024-02-19T16:19:23.099 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi118.front.sepia.ceph.com /etc/hosts
2024-02-19T16:19:23.155 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118
2024-02-19T16:19:23.155 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118
2024-02-19T16:19:23.255 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hosts
2024-02-19T16:19:23.283 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts
2024-02-19T16:19:23.350 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hostname
2024-02-19T16:19:23.417 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118
2024-02-19T16:19:23.483 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release
2024-02-19T16:19:23.538 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream"
2024-02-19T16:19:23.538 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9"
2024-02-19T16:19:23.538 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos"
2024-02-19T16:19:23.538 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora"
2024-02-19T16:19:23.538 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9"
2024-02-19T16:19:23.538 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9"
2024-02-19T16:19:23.538 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-19T16:19:23.538 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31"
2024-02-19T16:19:23.538 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon"
2024-02-19T16:19:23.538 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-19T16:19:23.538 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/"
2024-02-19T16:19:23.539 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-19T16:19:23.539 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-19T16:19:23.539 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-19T16:19:23.539 INFO:teuthology.provision.fog.smithi118:Deploy complete!
2024-02-19T16:19:23.539 DEBUG:teuthology.parallel:result is None
2024-02-19T16:19:23.752 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com
2024-02-19T16:19:23.752 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-19T16:19:23.781 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com
2024-02-19T16:19:23.782 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-19T16:19:23.797 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com
2024-02-19T16:19:23.797 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-19T16:19:23.815 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server
2024-02-19T16:19:23.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com'
2024-02-19T16:19:23.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:19:23.902 DEBUG:teuthology.orchestra.run.smithi118:> true
2024-02-19T16:19:23.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com'
2024-02-19T16:19:23.966 DEBUG:teuthology.orchestra.run.smithi118:> uname -m
2024-02-19T16:19:24.020 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64
2024-02-19T16:19:24.021 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release
2024-02-19T16:19:24.075 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream"
2024-02-19T16:19:24.075 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9"
2024-02-19T16:19:24.075 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos"
2024-02-19T16:19:24.075 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora"
2024-02-19T16:19:24.076 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9"
2024-02-19T16:19:24.076 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9"
2024-02-19T16:19:24.076 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-19T16:19:24.076 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31"
2024-02-19T16:19:24.076 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon"
2024-02-19T16:19:24.076 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-19T16:19:24.076 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/"
2024-02-19T16:19:24.076 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-19T16:19:24.076 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-19T16:19:24.076 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-19T16:19:24.077 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server
2024-02-19T16:19:24.106 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server
2024-02-19T16:19:24.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com'
2024-02-19T16:19:24.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:19:24.194 DEBUG:teuthology.orchestra.run.smithi135:> true
2024-02-19T16:19:24.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com'
2024-02-19T16:19:24.362 DEBUG:teuthology.orchestra.run.smithi135:> uname -m
2024-02-19T16:19:24.417 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64
2024-02-19T16:19:24.417 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release
2024-02-19T16:19:24.472 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream"
2024-02-19T16:19:24.472 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9"
2024-02-19T16:19:24.472 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos"
2024-02-19T16:19:24.472 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora"
2024-02-19T16:19:24.472 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9"
2024-02-19T16:19:24.472 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9"
2024-02-19T16:19:24.472 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-19T16:19:24.472 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31"
2024-02-19T16:19:24.472 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon"
2024-02-19T16:19:24.473 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-19T16:19:24.473 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/"
2024-02-19T16:19:24.473 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-19T16:19:24.473 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-19T16:19:24.473 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-19T16:19:24.473 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server
2024-02-19T16:19:24.499 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server
2024-02-19T16:19:24.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com'
2024-02-19T16:19:24.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-19T16:19:24.589 DEBUG:teuthology.orchestra.run.smithi177:> true
2024-02-19T16:19:24.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com'
2024-02-19T16:19:24.755 DEBUG:teuthology.orchestra.run.smithi177:> uname -m
2024-02-19T16:19:24.810 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64
2024-02-19T16:19:24.810 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2024-02-19T16:19:24.865 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream"
2024-02-19T16:19:24.865 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9"
2024-02-19T16:19:24.865 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos"
2024-02-19T16:19:24.865 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora"
2024-02-19T16:19:24.865 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9"
2024-02-19T16:19:24.865 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9"
2024-02-19T16:19:24.865 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-19T16:19:24.865 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2024-02-19T16:19:24.865 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon"
2024-02-19T16:19:24.865 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-19T16:19:24.865 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/"
2024-02-19T16:19:24.866 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-19T16:19:24.866 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-19T16:19:24.866 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-19T16:19:24.866 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2024-02-19T16:19:24.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-19T16:19:24.984 INFO:teuthology.dispatcher.supervisor:Running job 7566522
2024-02-19T16:19:24.985 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi/7566522 --name leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} -- /home/teuthworker/archive/leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi/7566522/orig.config.yaml
2024-02-19T16:19:24.988 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi/7566522
2024-02-19T16:19:24.988 INFO:teuthology.dispatcher.supervisor:Job PID: 3055302
2024-02-19T16:19:24.988 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-19T16:21:25.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-19T16:23:25.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-19T16:25:25.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-19T16:27:25.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-19T16:29:25.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-19T16:31:25.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-19T16:33:26.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-19T16:35:26.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-19T16:35:26.344 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1