2024-04-08T05:36:12.042 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-08T05:36:12.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:36:12.217 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f6c3e223f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f6c3f284c10>, signals=[15])
2024-04-08T05:36:12.218 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging
2024-04-08T05:36:12.218 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server
2024-04-08T05:36:12.218 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2024-04-08T05:36:12.239 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging
2024-04-08T05:36:12.239 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server
2024-04-08T05:36:12.239 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2024-04-08T05:36:12.264 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging
2024-04-08T05:36:12.264 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server
2024-04-08T05:36:12.264 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2024-04-08T05:36:12.369 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_centos_9.stream (ID 10)
2024-04-08T05:36:12.376 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_centos_9.stream (ID 10)
2024-04-08T05:36:12.399 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_centos_9.stream (ID 10)
2024-04-08T05:36:12.429 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of centos 9.stream
2024-04-08T05:36:12.432 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 9.stream
2024-04-08T05:36:12.454 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 9.stream
2024-04-08T05:36:12.640 INFO:teuthology.orchestra.console.smithi102:Power off
2024-04-08T05:36:12.640 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-08T05:36:12.654 INFO:teuthology.orchestra.console.smithi145:Power off
2024-04-08T05:36:12.654 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-08T05:36:12.665 INFO:teuthology.orchestra.console.smithi097:Power off
2024-04-08T05:36:12.666 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-08T05:36:12.674 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off
2024-04-08T05:36:12.674 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:12.683 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off
2024-04-08T05:36:12.683 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:12.692 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off
2024-04-08T05:36:12.692 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:12.701 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-04-08T05:36:12.707 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-04-08T05:36:12.713 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2024-04-08T05:36:16.706 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:16.714 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:16.724 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:16.816 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-04-08T05:36:16.825 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-04-08T05:36:16.833 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2024-04-08T05:36:20.818 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:20.826 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:20.833 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:20.929 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-04-08T05:36:20.936 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-04-08T05:36:20.941 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2024-04-08T05:36:24.930 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:24.937 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:24.943 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:25.039 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-04-08T05:36:25.045 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off
2024-04-08T05:36:25.052 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2024-04-08T05:36:25.140 INFO:teuthology.orchestra.console.smithi102:Power off completed
2024-04-08T05:36:25.145 INFO:teuthology.orchestra.console.smithi145:Power off completed
2024-04-08T05:36:25.153 INFO:teuthology.orchestra.console.smithi097:Power off completed
2024-04-08T05:36:25.240 INFO:teuthology.orchestra.console.smithi102:Power on
2024-04-08T05:36:25.241 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-08T05:36:25.248 INFO:teuthology.orchestra.console.smithi145:Power on
2024-04-08T05:36:25.248 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-08T05:36:25.255 INFO:teuthology.orchestra.console.smithi097:Power on
2024-04-08T05:36:25.255 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-08T05:36:25.263 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On
2024-04-08T05:36:25.263 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:25.271 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On
2024-04-08T05:36:25.271 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:25.279 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On
2024-04-08T05:36:25.279 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:25.289 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-04-08T05:36:25.295 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off
2024-04-08T05:36:25.301 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2024-04-08T05:36:29.295 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:29.302 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:29.309 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:29.404 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-04-08T05:36:29.411 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-04-08T05:36:29.418 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2024-04-08T05:36:29.512 INFO:teuthology.orchestra.console.smithi145:Power on completed
2024-04-08T05:36:29.518 INFO:teuthology.orchestra.console.smithi097:Power on completed
2024-04-08T05:36:29.613 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish
2024-04-08T05:36:29.620 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish
2024-04-08T05:36:33.406 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T05:36:33.515 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-04-08T05:36:33.615 INFO:teuthology.orchestra.console.smithi102:Power on completed
2024-04-08T05:36:33.716 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish
2024-04-08T05:39:00.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:39:00.451 ERROR:teuthology.orchestra.connection:Error authenticating with smithi145.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-08T05:39:04.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:39:07.486 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-08T05:39:13.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:39:15.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:39:16.542 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-08T05:39:18.494 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2024-04-08T05:39:22.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:39:24.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:39:25.598 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-08T05:39:27.550 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2024-04-08T05:39:31.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:39:33.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:39:34.654 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-08T05:39:36.606 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2024-04-08T05:39:40.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:39:42.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:39:43.714 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-08T05:39:45.662 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2024-04-08T05:39:49.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:39:51.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:39:52.770 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-08T05:39:54.718 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2024-04-08T05:39:58.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:40:00.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:40:01.826 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-08T05:40:03.774 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2024-04-08T05:40:04.454 WARNING:teuthology.provision.fog.smithi145:timed out
2024-04-08T05:40:07.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:40:09.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:40:10.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:40:26.274 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-08T05:40:28.830 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-04-08T05:40:32.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:40:34.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:40:35.326 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-08T05:40:37.886 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-04-08T05:40:41.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:40:43.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:40:44.125 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-08T05:40:44.125 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-08T05:40:44.382 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-08T05:40:50.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:40:50.629 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-08T05:40:50.630 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-08T05:41:04.482 INFO:teuthology.provision.fog.smithi145:Node is ready
2024-04-08T05:41:04.482 DEBUG:teuthology.orchestra.run.smithi145:> hostname
2024-04-08T05:41:04.501 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com
2024-04-08T05:41:04.501 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts
2024-04-08T05:41:04.558 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145
2024-04-08T05:41:04.559 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145
2024-04-08T05:41:04.691 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts
2024-04-08T05:41:04.721 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts
2024-04-08T05:41:04.790 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname
2024-04-08T05:41:04.859 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145
2024-04-08T05:41:04.926 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release
2024-04-08T05:41:04.982 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream"
2024-04-08T05:41:04.982 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9"
2024-04-08T05:41:04.982 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos"
2024-04-08T05:41:04.982 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora"
2024-04-08T05:41:04.982 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9"
2024-04-08T05:41:04.982 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9"
2024-04-08T05:41:04.982 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-08T05:41:04.982 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31"
2024-04-08T05:41:04.983 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon"
2024-04-08T05:41:04.983 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-08T05:41:04.983 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/"
2024-04-08T05:41:04.983 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-08T05:41:04.983 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-08T05:41:04.983 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-08T05:41:04.984 INFO:teuthology.provision.fog.smithi145:Deploy complete!
2024-04-08T05:41:04.985 DEBUG:teuthology.parallel:result is None
2024-04-08T05:41:06.099 INFO:teuthology.provision.fog.smithi102:Node is ready
2024-04-08T05:41:06.099 DEBUG:teuthology.orchestra.run.smithi102:> hostname
2024-04-08T05:41:06.116 INFO:teuthology.orchestra.run.smithi102.stdout:smithi046
2024-04-08T05:41:06.116 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi046 /etc/hosts
2024-04-08T05:41:06.174 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-04-08T05:41:06.174 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2024-04-08T05:41:06.337 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi046/smithi102/g' /etc/hosts
2024-04-08T05:41:06.366 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.46/172.21.15.102/g' /etc/hosts
2024-04-08T05:41:06.435 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi046/smithi102/g' /etc/hostname
2024-04-08T05:41:06.504 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2024-04-08T05:41:06.572 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2024-04-08T05:41:06.628 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream"
2024-04-08T05:41:06.628 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9"
2024-04-08T05:41:06.628 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2024-04-08T05:41:06.628 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2024-04-08T05:41:06.628 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9"
2024-04-08T05:41:06.628 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9"
2024-04-08T05:41:06.628 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-08T05:41:06.628 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2024-04-08T05:41:06.628 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon"
2024-04-08T05:41:06.629 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-08T05:41:06.629 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2024-04-08T05:41:06.629 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-08T05:41:06.629 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-08T05:41:06.629 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-08T05:41:06.629 INFO:teuthology.provision.fog.smithi102:Deploy complete!
2024-04-08T05:41:06.630 DEBUG:teuthology.parallel:result is None
2024-04-08T05:41:09.778 WARNING:teuthology.provision.fog.smithi097:timed out
2024-04-08T05:41:15.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:41:16.169 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-08T05:41:16.170 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-08T05:41:16.485 INFO:teuthology.provision.fog.smithi097:Node is ready
2024-04-08T05:41:16.485 DEBUG:teuthology.orchestra.run.smithi097:> hostname
2024-04-08T05:41:16.499 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com
2024-04-08T05:41:16.499 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts
2024-04-08T05:41:16.554 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097
2024-04-08T05:41:16.554 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2024-04-08T05:41:16.681 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts
2024-04-08T05:41:16.709 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts
2024-04-08T05:41:16.776 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname
2024-04-08T05:41:16.843 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2024-04-08T05:41:16.909 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2024-04-08T05:41:16.963 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream"
2024-04-08T05:41:16.963 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9"
2024-04-08T05:41:16.963 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos"
2024-04-08T05:41:16.963 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora"
2024-04-08T05:41:16.963 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9"
2024-04-08T05:41:16.963 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9"
2024-04-08T05:41:16.963 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-08T05:41:16.963 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2024-04-08T05:41:16.963 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon"
2024-04-08T05:41:16.963 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-08T05:41:16.964 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/"
2024-04-08T05:41:16.964 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-08T05:41:16.964 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-08T05:41:16.964 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-08T05:41:16.964 INFO:teuthology.provision.fog.smithi097:Deploy complete!
2024-04-08T05:41:16.964 DEBUG:teuthology.parallel:result is None
2024-04-08T05:41:17.212 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com
2024-04-08T05:41:17.212 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-08T05:41:17.240 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com
2024-04-08T05:41:17.240 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-08T05:41:17.256 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com
2024-04-08T05:41:17.256 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-08T05:41:17.274 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server
2024-04-08T05:41:17.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com'
2024-04-08T05:41:17.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:41:17.361 DEBUG:teuthology.orchestra.run.smithi097:> true
2024-04-08T05:41:17.424 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com'
2024-04-08T05:41:17.425 DEBUG:teuthology.orchestra.run.smithi097:> uname -m
2024-04-08T05:41:17.477 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64
2024-04-08T05:41:17.478 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2024-04-08T05:41:17.530 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream"
2024-04-08T05:41:17.530 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9"
2024-04-08T05:41:17.530 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos"
2024-04-08T05:41:17.530 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora"
2024-04-08T05:41:17.531 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9"
2024-04-08T05:41:17.531 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9"
2024-04-08T05:41:17.531 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-08T05:41:17.531 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2024-04-08T05:41:17.531 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon"
2024-04-08T05:41:17.531 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-08T05:41:17.531 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/"
2024-04-08T05:41:17.531 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-08T05:41:17.531 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-08T05:41:17.531 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-08T05:41:17.532 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2024-04-08T05:41:17.557 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server
2024-04-08T05:41:17.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2024-04-08T05:41:17.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:41:17.642 DEBUG:teuthology.orchestra.run.smithi102:> true
2024-04-08T05:41:17.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com'
2024-04-08T05:41:17.710 DEBUG:teuthology.orchestra.run.smithi102:> uname -m
2024-04-08T05:41:17.763 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64
2024-04-08T05:41:17.764 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2024-04-08T05:41:17.819 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream"
2024-04-08T05:41:17.819 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9"
2024-04-08T05:41:17.819 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2024-04-08T05:41:17.819 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2024-04-08T05:41:17.819 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9"
2024-04-08T05:41:17.819 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9"
2024-04-08T05:41:17.819 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-08T05:41:17.819 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2024-04-08T05:41:17.819 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon"
2024-04-08T05:41:17.819 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-08T05:41:17.820 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2024-04-08T05:41:17.820 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-08T05:41:17.820 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-08T05:41:17.820 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-08T05:41:17.820 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2024-04-08T05:41:17.848 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server
2024-04-08T05:41:17.849 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com'
2024-04-08T05:41:17.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T05:41:17.935 DEBUG:teuthology.orchestra.run.smithi145:> true
2024-04-08T05:41:18.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com'
2024-04-08T05:41:18.105 DEBUG:teuthology.orchestra.run.smithi145:> uname -m
2024-04-08T05:41:18.156 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64
2024-04-08T05:41:18.156 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release
2024-04-08T05:41:18.208 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream"
2024-04-08T05:41:18.209 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9"
2024-04-08T05:41:18.209 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos"
2024-04-08T05:41:18.209 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora"
2024-04-08T05:41:18.209 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9"
2024-04-08T05:41:18.209 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9"
2024-04-08T05:41:18.209 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-08T05:41:18.209 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31"
2024-04-08T05:41:18.209 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon"
2024-04-08T05:41:18.209 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-08T05:41:18.209 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/"
2024-04-08T05:41:18.210 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-08T05:41:18.210 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-08T05:41:18.210 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-08T05:41:18.210 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2024-04-08T05:41:18.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:41:18.327 INFO:teuthology.dispatcher.supervisor:Running job 7645362
2024-04-08T05:41:18.327 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-04-08_04:51:09-fs:workload-wip-64730-testing-default-smithi/7645362 --name vshankar-2024-04-08_04:51:09-fs:workload-wip-64730-testing-default-smithi --description fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/vshankar-2024-04-08_04:51:09-fs:workload-wip-64730-testing-default-smithi/7645362/orig.config.yaml
2024-04-08T05:41:18.330 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-04-08_04:51:09-fs:workload-wip-64730-testing-default-smithi/7645362
2024-04-08T05:41:18.331 INFO:teuthology.dispatcher.supervisor:Job PID: 2420342
2024-04-08T05:41:18.331 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-08T05:43:18.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:45:18.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:47:18.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:49:18.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:51:18.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:53:18.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:55:18.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:57:18.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T05:59:18.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T06:01:18.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T06:03:19.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T06:05:19.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T06:07:19.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T06:09:19.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T06:09:19.325 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1