2024-03-11T15:30:07.325 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-11T15:30:07.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T15:30:07.507 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3e9ce58f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3e9deb9c10>, signals=[15])
2024-03-11T15:30:07.507 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging
2024-03-11T15:30:07.508 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server
2024-03-11T15:30:07.508 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2024-03-11T15:30:07.540 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging
2024-03-11T15:30:07.540 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server
2024-03-11T15:30:07.540 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2024-03-11T15:30:07.564 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2024-03-11T15:30:07.565 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2024-03-11T15:30:07.565 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2024-03-11T15:30:07.656 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_9.stream (ID 10)
2024-03-11T15:30:07.681 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_centos_9.stream (ID 10)
2024-03-11T15:30:07.710 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_centos_9.stream (ID 10)
2024-03-11T15:30:07.716 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 9.stream
2024-03-11T15:30:07.719 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 9.stream
2024-03-11T15:30:07.762 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 9.stream
2024-03-11T15:30:08.202 INFO:teuthology.orchestra.console.smithi052:Power off
2024-03-11T15:30:08.206 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-11T15:30:08.229 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off
2024-03-11T15:30:08.229 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:08.250 INFO:teuthology.orchestra.console.smithi111:Power off
2024-03-11T15:30:08.251 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-11T15:30:08.265 INFO:teuthology.orchestra.console.smithi012:Power off
2024-03-11T15:30:08.265 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-11T15:30:08.272 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2024-03-11T15:30:08.272 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2024-03-11T15:30:08.272 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:08.286 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off
2024-03-11T15:30:08.287 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:08.296 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-03-11T15:30:08.309 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on
2024-03-11T15:30:12.274 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:12.297 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:12.310 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:12.384 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2024-03-11T15:30:12.406 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-03-11T15:30:12.419 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on
2024-03-11T15:30:16.388 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:16.406 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:16.420 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:16.497 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2024-03-11T15:30:16.515 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-03-11T15:30:16.529 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off
2024-03-11T15:30:16.598 INFO:teuthology.orchestra.console.smithi052:Power off completed
2024-03-11T15:30:16.630 INFO:teuthology.orchestra.console.smithi012:Power off completed
2024-03-11T15:30:16.699 INFO:teuthology.orchestra.console.smithi052:Power on
2024-03-11T15:30:16.700 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-11T15:30:16.721 DEBUG:teuthology.orchestra.console.smithi052:power on output: Chassis Power Control: Up/On
2024-03-11T15:30:16.722 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:16.731 INFO:teuthology.orchestra.console.smithi012:Power on
2024-03-11T15:30:16.731 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-11T15:30:16.748 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2024-03-11T15:30:16.751 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On
2024-03-11T15:30:16.751 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:16.772 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off
2024-03-11T15:30:20.520 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:20.629 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-03-11T15:30:20.730 INFO:teuthology.orchestra.console.smithi111:Power off completed
2024-03-11T15:30:20.749 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:20.773 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:20.831 INFO:teuthology.orchestra.console.smithi111:Power on
2024-03-11T15:30:20.834 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-11T15:30:20.854 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2024-03-11T15:30:20.855 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:20.864 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2024-03-11T15:30:20.876 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-03-11T15:30:20.883 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off
2024-03-11T15:30:24.869 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:24.877 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:24.885 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:24.979 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2024-03-11T15:30:24.985 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-03-11T15:30:24.993 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on
2024-03-11T15:30:25.080 INFO:teuthology.orchestra.console.smithi052:Power on completed
2024-03-11T15:30:25.094 INFO:teuthology.orchestra.console.smithi012:Power on completed
2024-03-11T15:30:25.182 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish
2024-03-11T15:30:25.195 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish
2024-03-11T15:30:28.990 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T15:30:29.099 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-03-11T15:30:29.200 INFO:teuthology.orchestra.console.smithi111:Power on completed
2024-03-11T15:30:29.301 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2024-03-11T15:32:40.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:32:44.030 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2024-03-11T15:32:50.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:32:53.090 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2024-03-11T15:32:56.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:32:59.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:32:59.102 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-03-11T15:33:02.174 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2024-03-11T15:33:05.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:33:08.166 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-03-11T15:33:08.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:33:11.230 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2024-03-11T15:33:14.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:33:15.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:33:17.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:33:17.246 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-03-11T15:33:18.206 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T15:33:20.286 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12
2024-03-11T15:33:23.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:33:24.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:33:26.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:33:26.302 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-03-11T15:33:27.266 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T15:33:32.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:33:33.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:33:35.358 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-03-11T15:33:36.350 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T15:33:41.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:33:42.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:33:44.446 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2024-03-11T15:33:45.406 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T15:33:50.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:33:51.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:33:54.466 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T15:34:00.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:34:03.550 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T15:34:09.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:34:12.638 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T15:34:18.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:34:21.730 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T15:34:26.294 WARNING:teuthology.provision.fog.smithi012:timed out
2024-03-11T15:34:27.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:34:30.782 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-03-11T15:34:32.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:34:32.532 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-11T15:34:32.532 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-11T15:34:32.895 INFO:teuthology.provision.fog.smithi012:Node is ready
2024-03-11T15:34:32.895 DEBUG:teuthology.orchestra.run.smithi012:> hostname
2024-03-11T15:34:32.911 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com
2024-03-11T15:34:32.911 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts
2024-03-11T15:34:32.970 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012
2024-03-11T15:34:32.970 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012
2024-03-11T15:34:33.079 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts
2024-03-11T15:34:33.111 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts
2024-03-11T15:34:33.183 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname
2024-03-11T15:34:33.253 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012
2024-03-11T15:34:33.323 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release
2024-03-11T15:34:33.378 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream"
2024-03-11T15:34:33.378 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9"
2024-03-11T15:34:33.378 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos"
2024-03-11T15:34:33.379 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora"
2024-03-11T15:34:33.379 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9"
2024-03-11T15:34:33.379 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9"
2024-03-11T15:34:33.379 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T15:34:33.379 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31"
2024-03-11T15:34:33.379 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon"
2024-03-11T15:34:33.379 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T15:34:33.379 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/"
2024-03-11T15:34:33.379 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T15:34:33.379 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T15:34:33.379 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T15:34:33.380 INFO:teuthology.provision.fog.smithi012:Deploy complete!
2024-03-11T15:34:33.381 DEBUG:teuthology.parallel:result is None
2024-03-11T15:34:36.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:34:50.469 WARNING:teuthology.provision.fog.smithi052:timed out
2024-03-11T15:34:56.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:34:56.740 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-11T15:34:56.740 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-11T15:34:57.071 INFO:teuthology.provision.fog.smithi052:Node is ready
2024-03-11T15:34:57.071 DEBUG:teuthology.orchestra.run.smithi052:> hostname
2024-03-11T15:34:57.086 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com
2024-03-11T15:34:57.087 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts
2024-03-11T15:34:57.143 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052
2024-03-11T15:34:57.143 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2024-03-11T15:34:57.236 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts
2024-03-11T15:34:57.268 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts
2024-03-11T15:34:57.340 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname
2024-03-11T15:34:57.412 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2024-03-11T15:34:57.481 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2024-03-11T15:34:57.536 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream"
2024-03-11T15:34:57.536 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9"
2024-03-11T15:34:57.537 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos"
2024-03-11T15:34:57.537 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora"
2024-03-11T15:34:57.537 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9"
2024-03-11T15:34:57.537 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9"
2024-03-11T15:34:57.537 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T15:34:57.537 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2024-03-11T15:34:57.537 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon"
2024-03-11T15:34:57.537 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T15:34:57.537 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/"
2024-03-11T15:34:57.537 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T15:34:57.537 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T15:34:57.537 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T15:34:57.538 INFO:teuthology.provision.fog.smithi052:Deploy complete!
2024-03-11T15:34:57.538 DEBUG:teuthology.parallel:result is None
2024-03-11T15:35:36.827 WARNING:teuthology.provision.fog.smithi111:timed out
2024-03-11T15:35:42.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:35:43.258 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-11T15:35:43.258 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-11T15:35:43.576 INFO:teuthology.provision.fog.smithi111:Node is ready
2024-03-11T15:35:43.576 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2024-03-11T15:35:43.591 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2024-03-11T15:35:43.591 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts
2024-03-11T15:35:43.645 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2024-03-11T15:35:43.645 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2024-03-11T15:35:43.765 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts
2024-03-11T15:35:43.794 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2024-03-11T15:35:43.860 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname
2024-03-11T15:35:43.929 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2024-03-11T15:35:43.996 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2024-03-11T15:35:44.049 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2024-03-11T15:35:44.049 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9"
2024-03-11T15:35:44.050 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2024-03-11T15:35:44.050 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2024-03-11T15:35:44.050 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9"
2024-03-11T15:35:44.050 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9"
2024-03-11T15:35:44.050 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T15:35:44.050 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2024-03-11T15:35:44.050 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon"
2024-03-11T15:35:44.050 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T15:35:44.050 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2024-03-11T15:35:44.050 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T15:35:44.050 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T15:35:44.050 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T15:35:44.051 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2024-03-11T15:35:44.051 DEBUG:teuthology.parallel:result is None
2024-03-11T15:35:44.309 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com
2024-03-11T15:35:44.309 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-11T15:35:44.336 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com
2024-03-11T15:35:44.337 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-11T15:35:44.361 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2024-03-11T15:35:44.361 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-11T15:35:44.379 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server
2024-03-11T15:35:44.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com'
2024-03-11T15:35:44.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:35:44.487 DEBUG:teuthology.orchestra.run.smithi012:> true
2024-03-11T15:35:44.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com'
2024-03-11T15:35:44.669 DEBUG:teuthology.orchestra.run.smithi012:> uname -m
2024-03-11T15:35:44.724 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64
2024-03-11T15:35:44.724 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release
2024-03-11T15:35:44.778 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream"
2024-03-11T15:35:44.778 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9"
2024-03-11T15:35:44.779 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos"
2024-03-11T15:35:44.779 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora"
2024-03-11T15:35:44.779 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9"
2024-03-11T15:35:44.779 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9"
2024-03-11T15:35:44.779 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T15:35:44.779 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31"
2024-03-11T15:35:44.779 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon"
2024-03-11T15:35:44.779 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T15:35:44.779 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/"
2024-03-11T15:35:44.779 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T15:35:44.779 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T15:35:44.779 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T15:35:44.780 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server
2024-03-11T15:35:44.804 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server
2024-03-11T15:35:44.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2024-03-11T15:35:44.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:35:44.909 DEBUG:teuthology.orchestra.run.smithi052:> true
2024-03-11T15:35:45.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com'
2024-03-11T15:35:45.093 DEBUG:teuthology.orchestra.run.smithi052:> uname -m
2024-03-11T15:35:45.148 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64
2024-03-11T15:35:45.148 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2024-03-11T15:35:45.203 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream"
2024-03-11T15:35:45.203 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9"
2024-03-11T15:35:45.203 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos"
2024-03-11T15:35:45.203 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora"
2024-03-11T15:35:45.204 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9"
2024-03-11T15:35:45.204 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9"
2024-03-11T15:35:45.204 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T15:35:45.204 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2024-03-11T15:35:45.204 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon"
2024-03-11T15:35:45.204 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T15:35:45.204 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/"
2024-03-11T15:35:45.204 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T15:35:45.204 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T15:35:45.204 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T15:35:45.205 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2024-03-11T15:35:45.228 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2024-03-11T15:35:45.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2024-03-11T15:35:45.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T15:35:45.317 DEBUG:teuthology.orchestra.run.smithi111:> true
2024-03-11T15:35:45.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2024-03-11T15:35:45.387 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2024-03-11T15:35:45.444 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2024-03-11T15:35:45.444 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2024-03-11T15:35:45.500 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream"
2024-03-11T15:35:45.500 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9"
2024-03-11T15:35:45.500 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos"
2024-03-11T15:35:45.500 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora"
2024-03-11T15:35:45.500 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9"
2024-03-11T15:35:45.500 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9"
2024-03-11T15:35:45.501 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T15:35:45.501 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2024-03-11T15:35:45.501 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon"
2024-03-11T15:35:45.501 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T15:35:45.501 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/"
2024-03-11T15:35:45.501 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T15:35:45.501 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T15:35:45.501 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T15:35:45.501 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2024-03-11T15:35:45.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T15:35:45.623 INFO:teuthology.dispatcher.supervisor:Running job 7591103
2024-03-11T15:35:45.624 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-11_12:33:20-fs-main-distro-default-smithi/7591103 --name teuthology-2024-03-11_12:33:20-fs-main-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/pjd}} -- /home/teuthworker/archive/teuthology-2024-03-11_12:33:20-fs-main-distro-default-smithi/7591103/orig.config.yaml
2024-03-11T15:35:45.627 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-11_12:33:20-fs-main-distro-default-smithi/7591103
2024-03-11T15:35:45.627 INFO:teuthology.dispatcher.supervisor:Job PID: 2062402
2024-03-11T15:35:45.627 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-11T15:37:45.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T15:39:45.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T15:41:46.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T15:43:46.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T15:45:46.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T15:47:46.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T15:49:46.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T15:51:46.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T15:53:47.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T15:55:47.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T15:57:47.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T15:59:47.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T16:01:47.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T16:03:48.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T16:05:48.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T16:07:48.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T16:09:48.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T16:09:48.589 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1