2024-04-17T14:39:54.073 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-17T14:39:54.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:39:54.210 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f86c346af10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f86c449fc10>, signals=[15])
2024-04-17T14:39:54.211 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging
2024-04-17T14:39:54.211 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T14:39:54.211 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2024-04-17T14:39:54.237 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging
2024-04-17T14:39:54.237 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T14:39:54.237 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2024-04-17T14:39:54.360 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T14:39:54.378 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T14:39:54.398 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 9.stream
2024-04-17T14:39:54.418 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of centos 9.stream
2024-04-17T14:39:54.890 INFO:teuthology.orchestra.console.smithi102:Power off
2024-04-17T14:39:54.891 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T14:39:54.912 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off
2024-04-17T14:39:54.912 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:54.931 INFO:teuthology.orchestra.console.smithi190:Power off
2024-04-17T14:39:54.931 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T14:39:54.939 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-04-17T14:39:54.953 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off
2024-04-17T14:39:54.953 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:54.971 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off
2024-04-17T14:39:55.040 INFO:teuthology.orchestra.console.smithi102:Power off completed
2024-04-17T14:39:55.073 INFO:teuthology.orchestra.console.smithi190:Power off completed
2024-04-17T14:39:55.141 INFO:teuthology.orchestra.console.smithi102:Power on
2024-04-17T14:39:55.141 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T14:39:55.164 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On
2024-04-17T14:39:55.164 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:55.174 INFO:teuthology.orchestra.console.smithi190:Power on
2024-04-17T14:39:55.174 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T14:39:55.185 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-04-17T14:39:55.193 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On
2024-04-17T14:39:55.193 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:55.213 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off
2024-04-17T14:39:59.190 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:59.213 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:39:59.301 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-04-17T14:39:59.322 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off
2024-04-17T14:40:03.306 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:03.323 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T14:40:03.416 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-04-17T14:40:03.430 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2024-04-17T14:40:03.517 INFO:teuthology.orchestra.console.smithi102:Power on completed
2024-04-17T14:40:03.531 INFO:teuthology.orchestra.console.smithi190:Power on completed
2024-04-17T14:40:03.618 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish
2024-04-17T14:40:03.632 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish
2024-04-17T14:40:03.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:40:22.302 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-17T14:40:28.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:40:31.390 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-17T14:40:37.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:40:40.446 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-17T14:40:46.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:40:49.534 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-17T14:40:55.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:40:58.590 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-17T14:41:04.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:41:07.650 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-17T14:41:13.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:41:32.190 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-17T14:41:38.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:41:41.246 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-17T14:41:47.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:41:47.379 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:41:51.500 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:41:58.623 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:42:08.747 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:42:21.871 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:42:37.993 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:42:57.116 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:43:19.240 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:43:44.364 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:44:07.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:10.718 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T14:44:12.489 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:44:12.489 WARNING:teuthology.provision.fog.smithi102:'connect to smithi102.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2024-04-17T14:44:16.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:18.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:18.612 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:44:19.774 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T14:44:22.734 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:44:25.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:28.830 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T14:44:29.860 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:44:34.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:37.886 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T14:44:39.984 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:44:43.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:46.942 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T14:44:52.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:44:53.107 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:44:55.998 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T14:45:02.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:05.054 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T14:45:09.230 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:45:11.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:21.310 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T14:45:27.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:28.354 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:45:30.366 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T14:45:36.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:39.422 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2024-04-17T14:45:45.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:45:48.021 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T14:45:48.022 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T14:45:50.478 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:46:08.350 INFO:teuthology.provision.fog.smithi190:Node is ready
2024-04-17T14:46:08.351 DEBUG:teuthology.orchestra.run.smithi190:> hostname
2024-04-17T14:46:08.368 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com
2024-04-17T14:46:08.368 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts
2024-04-17T14:46:08.424 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190
2024-04-17T14:46:08.424 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190
2024-04-17T14:46:08.560 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts
2024-04-17T14:46:08.589 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts
2024-04-17T14:46:08.657 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname
2024-04-17T14:46:08.725 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190
2024-04-17T14:46:08.792 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release
2024-04-17T14:46:08.846 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream"
2024-04-17T14:46:08.846 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9"
2024-04-17T14:46:08.846 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos"
2024-04-17T14:46:08.846 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:46:08.846 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9"
2024-04-17T14:46:08.846 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:46:08.846 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:46:08.846 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31"
2024-04-17T14:46:08.846 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:46:08.846 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:46:08.846 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:46:08.847 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:46:08.847 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:46:08.847 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:46:08.847 INFO:teuthology.provision.fog.smithi190:Deploy complete!
2024-04-17T14:46:08.849 DEBUG:teuthology.parallel:result is None
2024-04-17T14:46:15.560 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:46:43.644 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:46:43.645 WARNING:teuthology.provision.fog.smithi102:'connect to smithi102.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2024-04-17T14:46:49.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:46:49.770 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:46:53.894 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T14:47:35.454 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-17T14:47:41.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:47:44.515 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-17T14:47:50.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:47:53.598 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-17T14:47:59.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:48:02.654 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-17T14:48:08.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:49:08.658 WARNING:teuthology.provision.fog.smithi102:timed out
2024-04-17T14:49:14.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:49:15.043 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T14:49:15.043 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T14:49:15.389 INFO:teuthology.provision.fog.smithi102:Node is ready
2024-04-17T14:49:15.390 DEBUG:teuthology.orchestra.run.smithi102:> hostname
2024-04-17T14:49:15.404 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com
2024-04-17T14:49:15.404 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts
2024-04-17T14:49:15.459 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102
2024-04-17T14:49:15.459 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2024-04-17T14:49:15.585 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts
2024-04-17T14:49:15.614 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts
2024-04-17T14:49:15.681 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname
2024-04-17T14:49:15.747 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2024-04-17T14:49:15.813 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2024-04-17T14:49:15.867 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream"
2024-04-17T14:49:15.868 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9"
2024-04-17T14:49:15.868 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2024-04-17T14:49:15.868 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:49:15.868 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9"
2024-04-17T14:49:15.868 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:49:15.868 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:49:15.868 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2024-04-17T14:49:15.868 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:49:15.868 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:49:15.868 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:49:15.868 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:49:15.868 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:49:15.868 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:49:15.869 INFO:teuthology.provision.fog.smithi102:Deploy complete!
2024-04-17T14:49:15.869 DEBUG:teuthology.parallel:result is None
2024-04-17T14:49:16.047 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com
2024-04-17T14:49:16.048 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T14:49:16.069 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com
2024-04-17T14:49:16.069 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T14:49:16.087 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server
2024-04-17T14:49:16.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com'
2024-04-17T14:49:16.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:49:16.173 DEBUG:teuthology.orchestra.run.smithi102:> true
2024-04-17T14:49:16.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com'
2024-04-17T14:49:16.240 DEBUG:teuthology.orchestra.run.smithi102:> uname -m
2024-04-17T14:49:16.295 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64
2024-04-17T14:49:16.296 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2024-04-17T14:49:16.349 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream"
2024-04-17T14:49:16.350 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9"
2024-04-17T14:49:16.350 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos"
2024-04-17T14:49:16.350 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:49:16.350 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9"
2024-04-17T14:49:16.350 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:49:16.350 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:49:16.350 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31"
2024-04-17T14:49:16.350 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:49:16.350 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:49:16.350 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:49:16.350 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:49:16.350 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:49:16.351 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:49:16.351 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2024-04-17T14:49:16.369 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server
2024-04-17T14:49:16.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com'
2024-04-17T14:49:16.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T14:49:16.458 DEBUG:teuthology.orchestra.run.smithi190:> true
2024-04-17T14:49:16.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com'
2024-04-17T14:49:16.691 DEBUG:teuthology.orchestra.run.smithi190:> uname -m
2024-04-17T14:49:16.706 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64
2024-04-17T14:49:16.706 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release
2024-04-17T14:49:16.761 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream"
2024-04-17T14:49:16.761 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9"
2024-04-17T14:49:16.761 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos"
2024-04-17T14:49:16.761 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora"
2024-04-17T14:49:16.761 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9"
2024-04-17T14:49:16.762 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9"
2024-04-17T14:49:16.762 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T14:49:16.762 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31"
2024-04-17T14:49:16.762 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon"
2024-04-17T14:49:16.762 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T14:49:16.762 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/"
2024-04-17T14:49:16.762 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T14:49:16.762 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T14:49:16.762 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T14:49:16.762 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2024-04-17T14:49:16.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:49:16.897 INFO:teuthology.dispatcher.supervisor:Running job 7660373
2024-04-17T14:49:16.897 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660373 --name rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660373/orig.config.yaml
2024-04-17T14:49:16.899 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660373
2024-04-17T14:49:16.900 INFO:teuthology.dispatcher.supervisor:Job PID: 1518664
2024-04-17T14:49:16.900 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-17T14:51:16.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:53:16.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T14:53:17.064 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-04-17T14:53:17.199 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi102 but it was locked by another job: /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660375