2024-04-17T08:29:19.393 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-17T08:29:19.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T08:29:19.568 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f488f0e5f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4890146c10>, signals=[15])
2024-04-17T08:29:19.568 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging
2024-04-17T08:29:19.568 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T08:29:19.568 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2024-04-17T08:29:19.591 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging
2024-04-17T08:29:19.592 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T08:29:19.592 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-04-17T08:29:19.615 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging
2024-04-17T08:29:19.615 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server
2024-04-17T08:29:19.616 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2024-04-17T08:29:19.696 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T08:29:19.715 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T08:29:19.741 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_9.stream (ID 10)
2024-04-17T08:29:19.742 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 9.stream
2024-04-17T08:29:19.754 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of centos 9.stream
2024-04-17T08:29:19.784 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 9.stream
2024-04-17T08:29:20.023 INFO:teuthology.orchestra.console.smithi113:Power off
2024-04-17T08:29:20.023 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T08:29:20.040 INFO:teuthology.orchestra.console.smithi192:Power off
2024-04-17T08:29:20.040 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T08:29:20.052 INFO:teuthology.orchestra.console.smithi079:Power off
2024-04-17T08:29:20.052 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-17T08:29:20.061 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off
2024-04-17T08:29:20.061 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T08:29:20.070 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off
2024-04-17T08:29:20.070 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T08:29:20.078 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off
2024-04-17T08:29:20.078 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T08:29:20.087 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-04-17T08:29:20.091 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-04-17T08:29:20.099 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2024-04-17T08:29:20.188 INFO:teuthology.orchestra.console.smithi113:Power off completed
2024-04-17T08:29:20.191 INFO:teuthology.orchestra.console.smithi192:Power off completed
2024-04-17T08:29:20.200 INFO:teuthology.orchestra.console.smithi079:Power off completed
2024-04-17T08:29:20.289 INFO:teuthology.orchestra.console.smithi113:Power on
2024-04-17T08:29:20.289 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T08:29:20.295 INFO:teuthology.orchestra.console.smithi192:Power on
2024-04-17T08:29:20.296 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T08:29:20.302 INFO:teuthology.orchestra.console.smithi079:Power on
2024-04-17T08:29:20.303 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-17T08:29:20.311 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On
2024-04-17T08:29:20.311 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T08:29:20.319 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On
2024-04-17T08:29:20.319 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T08:29:20.327 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On
2024-04-17T08:29:20.328 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T08:29:20.336 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-04-17T08:29:20.340 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-04-17T08:29:20.348 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2024-04-17T08:29:24.338 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T08:29:24.345 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T08:29:24.352 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T08:29:24.448 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-04-17T08:29:24.454 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-04-17T08:29:24.460 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2024-04-17T08:29:28.453 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T08:29:28.460 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T08:29:28.467 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-17T08:29:28.562 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on
2024-04-17T08:29:28.569 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2024-04-17T08:29:28.663 INFO:teuthology.orchestra.console.smithi113:Power on completed
2024-04-17T08:29:28.670 INFO:teuthology.orchestra.console.smithi192:Power on completed
2024-04-17T08:29:28.680 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2024-04-17T08:29:28.764 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish
2024-04-17T08:29:28.771 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish
2024-04-17T08:29:28.780 INFO:teuthology.orchestra.console.smithi079:Power on completed
2024-04-17T08:29:28.881 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish
2024-04-17T08:31:59.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:31:59.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:32:02.818 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-04-17T08:32:02.819 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-17T08:32:08.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:32:08.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:32:11.902 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-17T08:32:11.906 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-04-17T08:32:14.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:32:15.093 ERROR:teuthology.orchestra.connection:Error authenticating with smithi113.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-17T08:32:17.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:32:17.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:32:20.962 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-17T08:32:20.963 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-04-17T08:32:26.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:32:26.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:32:30.018 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-17T08:32:30.046 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-04-17T08:32:36.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:32:36.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:32:39.074 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-17T08:32:39.102 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-04-17T08:32:45.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:32:45.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:32:48.130 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-17T08:32:48.158 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-04-17T08:32:53.790 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T08:32:54.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:32:54.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:32:57.186 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-17T08:32:57.214 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-04-17T08:32:59.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:33:02.846 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T08:33:03.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:33:03.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:33:08.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:33:11.902 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T08:33:17.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:33:20.958 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T08:33:21.694 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-17T08:33:21.694 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-04-17T08:33:26.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:33:27.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:33:27.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:33:30.014 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-04-17T08:33:30.750 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-17T08:33:30.751 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-04-17T08:33:36.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:33:36.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:33:36.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:33:39.806 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2024-04-17T08:33:39.807 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2024-04-17T08:33:45.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:33:45.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:33:46.113 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T08:33:46.113 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T08:33:46.294 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T08:33:46.295 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T08:34:01.707 INFO:teuthology.provision.fog.smithi079:Node is ready
2024-04-17T08:34:01.708 DEBUG:teuthology.orchestra.run.smithi079:> hostname
2024-04-17T08:34:01.724 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com
2024-04-17T08:34:01.724 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts
2024-04-17T08:34:01.781 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079
2024-04-17T08:34:01.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2024-04-17T08:34:01.895 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts
2024-04-17T08:34:01.923 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts
2024-04-17T08:34:01.991 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname
2024-04-17T08:34:02.058 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2024-04-17T08:34:02.124 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2024-04-17T08:34:02.179 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream"
2024-04-17T08:34:02.179 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9"
2024-04-17T08:34:02.180 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos"
2024-04-17T08:34:02.180 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora"
2024-04-17T08:34:02.180 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9"
2024-04-17T08:34:02.180 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9"
2024-04-17T08:34:02.180 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T08:34:02.180 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2024-04-17T08:34:02.180 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon"
2024-04-17T08:34:02.180 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T08:34:02.180 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/"
2024-04-17T08:34:02.180 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T08:34:02.180 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T08:34:02.180 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T08:34:02.181 INFO:teuthology.provision.fog.smithi079:Deploy complete!
2024-04-17T08:34:02.183 DEBUG:teuthology.parallel:result is None
2024-04-17T08:34:06.505 INFO:teuthology.provision.fog.smithi192:Node is ready
2024-04-17T08:34:06.506 DEBUG:teuthology.orchestra.run.smithi192:> hostname
2024-04-17T08:34:06.524 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com
2024-04-17T08:34:06.524 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts
2024-04-17T08:34:06.583 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192
2024-04-17T08:34:06.583 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2024-04-17T08:34:06.708 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts
2024-04-17T08:34:06.739 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts
2024-04-17T08:34:06.808 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname
2024-04-17T08:34:06.876 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2024-04-17T08:34:06.943 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2024-04-17T08:34:06.999 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream"
2024-04-17T08:34:06.999 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9"
2024-04-17T08:34:06.999 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos"
2024-04-17T08:34:06.999 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora"
2024-04-17T08:34:06.999 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9"
2024-04-17T08:34:06.999 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9"
2024-04-17T08:34:06.999 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T08:34:06.999 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2024-04-17T08:34:06.999 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon"
2024-04-17T08:34:06.999 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T08:34:06.999 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/"
2024-04-17T08:34:06.999 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T08:34:07.000 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T08:34:07.000 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T08:34:07.000 INFO:teuthology.provision.fog.smithi192:Deploy complete!
2024-04-17T08:34:07.000 DEBUG:teuthology.parallel:result is None
2024-04-17T08:34:36.019 WARNING:teuthology.provision.fog.smithi113:timed out
2024-04-17T08:34:42.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:34:42.286 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-17T08:34:42.286 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-17T08:34:42.592 INFO:teuthology.provision.fog.smithi113:Node is ready
2024-04-17T08:34:42.593 DEBUG:teuthology.orchestra.run.smithi113:> hostname
2024-04-17T08:34:42.607 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113.front.sepia.ceph.com
2024-04-17T08:34:42.607 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113.front.sepia.ceph.com /etc/hosts
2024-04-17T08:34:42.663 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113
2024-04-17T08:34:42.663 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-04-17T08:34:42.768 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hosts
2024-04-17T08:34:42.796 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts
2024-04-17T08:34:42.863 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hostname
2024-04-17T08:34:42.930 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-04-17T08:34:42.996 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-04-17T08:34:43.051 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream"
2024-04-17T08:34:43.051 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9"
2024-04-17T08:34:43.051 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos"
2024-04-17T08:34:43.051 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora"
2024-04-17T08:34:43.052 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9"
2024-04-17T08:34:43.052 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9"
2024-04-17T08:34:43.052 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T08:34:43.052 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31"
2024-04-17T08:34:43.052 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon"
2024-04-17T08:34:43.052 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T08:34:43.052 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/"
2024-04-17T08:34:43.052 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T08:34:43.052 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T08:34:43.052 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T08:34:43.052 INFO:teuthology.provision.fog.smithi113:Deploy complete!
2024-04-17T08:34:43.053 DEBUG:teuthology.parallel:result is None
2024-04-17T08:34:43.263 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com
2024-04-17T08:34:43.264 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T08:34:43.287 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com
2024-04-17T08:34:43.287 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T08:34:43.303 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com
2024-04-17T08:34:43.303 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-17T08:34:43.321 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server
2024-04-17T08:34:43.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com'
2024-04-17T08:34:43.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:34:43.413 DEBUG:teuthology.orchestra.run.smithi079:> true
2024-04-17T08:34:43.584 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com'
2024-04-17T08:34:43.585 DEBUG:teuthology.orchestra.run.smithi079:> uname -m
2024-04-17T08:34:43.638 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64
2024-04-17T08:34:43.639 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2024-04-17T08:34:43.694 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream"
2024-04-17T08:34:43.694 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9"
2024-04-17T08:34:43.694 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos"
2024-04-17T08:34:43.694 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora"
2024-04-17T08:34:43.694 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9"
2024-04-17T08:34:43.694 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9"
2024-04-17T08:34:43.694 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T08:34:43.694 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2024-04-17T08:34:43.694 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon"
2024-04-17T08:34:43.694 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T08:34:43.695 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/"
2024-04-17T08:34:43.695 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T08:34:43.695 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T08:34:43.695 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T08:34:43.697 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2024-04-17T08:34:43.720 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server
2024-04-17T08:34:43.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-04-17T08:34:43.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:34:43.808 DEBUG:teuthology.orchestra.run.smithi113:> true
2024-04-17T08:34:43.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-04-17T08:34:43.872 DEBUG:teuthology.orchestra.run.smithi113:> uname -m
2024-04-17T08:34:43.927 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64
2024-04-17T08:34:43.928 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-04-17T08:34:43.982 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="CentOS Stream"
2024-04-17T08:34:43.982 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="9"
2024-04-17T08:34:43.983 INFO:teuthology.orchestra.run.smithi113.stdout:ID="centos"
2024-04-17T08:34:43.983 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="rhel fedora"
2024-04-17T08:34:43.983 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="9"
2024-04-17T08:34:43.983 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el9"
2024-04-17T08:34:43.983 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T08:34:43.983 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31"
2024-04-17T08:34:43.983 INFO:teuthology.orchestra.run.smithi113.stdout:LOGO="fedora-logo-icon"
2024-04-17T08:34:43.983 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T08:34:43.983 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://centos.org/"
2024-04-17T08:34:43.983 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T08:34:43.983 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T08:34:43.983 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T08:34:43.984 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-04-17T08:34:44.003 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server
2024-04-17T08:34:44.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com'
2024-04-17T08:34:44.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-17T08:34:44.090 DEBUG:teuthology.orchestra.run.smithi192:> true
2024-04-17T08:34:44.260 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com'
2024-04-17T08:34:44.260 DEBUG:teuthology.orchestra.run.smithi192:> uname -m
2024-04-17T08:34:44.314 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64
2024-04-17T08:34:44.315 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2024-04-17T08:34:44.369 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream"
2024-04-17T08:34:44.369 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9"
2024-04-17T08:34:44.369 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos"
2024-04-17T08:34:44.369 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora"
2024-04-17T08:34:44.369 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9"
2024-04-17T08:34:44.369 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9"
2024-04-17T08:34:44.369 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-17T08:34:44.370 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2024-04-17T08:34:44.370 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon"
2024-04-17T08:34:44.370 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-17T08:34:44.370 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/"
2024-04-17T08:34:44.370 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-17T08:34:44.370 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-17T08:34:44.370 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-17T08:34:44.370 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2024-04-17T08:34:44.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T08:34:44.499 INFO:teuthology.dispatcher.supervisor:Running job 7659955
2024-04-17T08:34:44.499 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659955 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659955/orig.config.yaml
2024-04-17T08:34:44.502 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659955
2024-04-17T08:34:44.502 INFO:teuthology.dispatcher.supervisor:Job PID: 404549
2024-04-17T08:34:44.503 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-17T08:36:44.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T08:38:44.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T08:40:44.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T08:42:44.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-17T08:42:44.812 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1