2024-03-26T07:44:56.770 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-26T07:44:56.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T07:44:56.954 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f6327644f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f63286a5c10>, signals=[15])
2024-03-26T07:44:56.955 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging
2024-03-26T07:44:56.955 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server
2024-03-26T07:44:56.955 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-03-26T07:44:56.976 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging
2024-03-26T07:44:56.977 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server
2024-03-26T07:44:56.977 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2024-03-26T07:44:57.001 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging
2024-03-26T07:44:57.001 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server
2024-03-26T07:44:57.001 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2024-03-26T07:44:57.103 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_rhel_8.6 (ID 5)
2024-03-26T07:44:57.112 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_rhel_8.6 (ID 5)
2024-03-26T07:44:57.141 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_rhel_8.6 (ID 5)
2024-03-26T07:44:57.145 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of rhel 8.6
2024-03-26T07:44:57.161 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of rhel 8.6
2024-03-26T07:44:57.183 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of rhel 8.6
2024-03-26T07:44:57.429 INFO:teuthology.orchestra.console.smithi113:Power off
2024-03-26T07:44:57.430 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-26T07:44:57.451 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off
2024-03-26T07:44:57.451 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:44:57.473 INFO:teuthology.orchestra.console.smithi177:Power off
2024-03-26T07:44:57.473 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-26T07:44:57.486 INFO:teuthology.orchestra.console.smithi114:Power off
2024-03-26T07:44:57.486 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-26T07:44:57.492 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-03-26T07:44:57.494 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off
2024-03-26T07:44:57.494 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:44:57.509 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off
2024-03-26T07:44:57.509 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:44:57.517 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2024-03-26T07:44:57.530 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2024-03-26T07:44:57.593 INFO:teuthology.orchestra.console.smithi113:Power off completed
2024-03-26T07:44:57.618 INFO:teuthology.orchestra.console.smithi177:Power off completed
2024-03-26T07:44:57.630 INFO:teuthology.orchestra.console.smithi114:Power off completed
2024-03-26T07:44:57.695 INFO:teuthology.orchestra.console.smithi113:Power on
2024-03-26T07:44:57.695 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-26T07:44:57.716 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On
2024-03-26T07:44:57.717 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:44:57.724 INFO:teuthology.orchestra.console.smithi177:Power on
2024-03-26T07:44:57.725 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-26T07:44:57.731 INFO:teuthology.orchestra.console.smithi114:Power on
2024-03-26T07:44:57.732 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-26T07:44:57.741 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-03-26T07:44:57.745 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On
2024-03-26T07:44:57.745 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:44:57.754 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On
2024-03-26T07:44:57.754 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:44:57.766 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2024-03-26T07:44:57.774 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2024-03-26T07:45:01.745 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:45:01.766 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:45:01.775 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:45:01.855 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-03-26T07:45:01.875 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2024-03-26T07:45:01.884 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on
2024-03-26T07:45:01.985 INFO:teuthology.orchestra.console.smithi114:Power on completed
2024-03-26T07:45:02.085 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish
2024-03-26T07:45:05.859 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:45:05.876 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-26T07:45:05.969 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on
2024-03-26T07:45:05.985 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2024-03-26T07:45:06.070 INFO:teuthology.orchestra.console.smithi113:Power on completed
2024-03-26T07:45:06.086 INFO:teuthology.orchestra.console.smithi177:Power on completed
2024-03-26T07:45:06.171 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish
2024-03-26T07:45:06.186 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish
2024-03-26T07:47:48.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:47:51.294 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-03-26T07:47:52.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:47:55.298 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-26T07:47:57.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:00.350 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-03-26T07:48:01.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:04.382 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-26T07:48:06.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:09.406 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-03-26T07:48:10.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:13.438 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-26T07:48:15.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:18.462 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-03-26T07:48:19.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:22.494 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-26T07:48:24.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:27.518 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-03-26T07:48:28.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:31.550 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-26T07:48:33.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:37.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:37.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:40.482 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-03-26T07:48:40.606 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2024-03-26T07:48:46.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:46.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:49.570 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-03-26T07:48:55.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:48:58.658 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-03-26T07:49:04.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:07.742 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-03-26T07:49:13.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:16.834 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-03-26T07:49:22.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:25.918 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-03-26T07:49:31.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:33.525 WARNING:teuthology.provision.fog.smithi114:timed out
2024-03-26T07:49:35.006 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-03-26T07:49:39.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:39.730 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-26T07:49:39.730 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-26T07:49:40.006 INFO:teuthology.provision.fog.smithi114:Node is ready
2024-03-26T07:49:40.007 DEBUG:teuthology.orchestra.run.smithi114:> hostname
2024-03-26T07:49:40.025 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com
2024-03-26T07:49:40.025 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114.front.sepia.ceph.com /etc/hosts
2024-03-26T07:49:40.084 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114
2024-03-26T07:49:40.084 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114
2024-03-26T07:49:40.221 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hosts
2024-03-26T07:49:40.252 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts
2024-03-26T07:49:40.321 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hostname
2024-03-26T07:49:40.389 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114
2024-03-26T07:49:40.457 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release
2024-03-26T07:49:40.514 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux"
2024-03-26T07:49:40.514 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)"
2024-03-26T07:49:40.514 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel"
2024-03-26T07:49:40.514 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora"
2024-03-26T07:49:40.514 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6"
2024-03-26T07:49:40.514 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8"
2024-03-26T07:49:40.514 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-26T07:49:40.514 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2024-03-26T07:49:40.514 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-26T07:49:40.515 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/"
2024-03-26T07:49:40.515 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-26T07:49:40.515 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T07:49:40.515 INFO:teuthology.orchestra.run.smithi114.stdout:
2024-03-26T07:49:40.515 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-26T07:49:40.515 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-26T07:49:40.515 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-26T07:49:40.515 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-26T07:49:40.516 INFO:teuthology.provision.fog.smithi114:Deploy complete!
2024-03-26T07:49:40.517 DEBUG:teuthology.parallel:result is None
2024-03-26T07:49:41.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:46.614 WARNING:teuthology.provision.fog.smithi177:timed out
2024-03-26T07:49:52.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:49:52.942 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-26T07:49:52.943 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-26T07:49:53.191 INFO:teuthology.provision.fog.smithi177:Node is ready
2024-03-26T07:49:53.191 DEBUG:teuthology.orchestra.run.smithi177:> hostname
2024-03-26T07:49:53.208 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177
2024-03-26T07:49:53.208 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177 /etc/hosts
2024-03-26T07:49:53.266 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177
2024-03-26T07:49:53.266 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2024-03-26T07:49:53.394 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177/smithi177/g' /etc/hosts
2024-03-26T07:49:53.422 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts
2024-03-26T07:49:53.489 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177/smithi177/g' /etc/hostname
2024-03-26T07:49:53.556 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2024-03-26T07:49:53.622 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2024-03-26T07:49:53.679 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux"
2024-03-26T07:49:53.679 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.6 (Ootpa)"
2024-03-26T07:49:53.679 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel"
2024-03-26T07:49:53.679 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora"
2024-03-26T07:49:53.679 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.6"
2024-03-26T07:49:53.679 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8"
2024-03-26T07:49:53.679 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-26T07:49:53.679 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2024-03-26T07:49:53.679 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-26T07:49:53.679 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/"
2024-03-26T07:49:53.679 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-26T07:49:53.679 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T07:49:53.680 INFO:teuthology.orchestra.run.smithi177.stdout:
2024-03-26T07:49:53.680 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-26T07:49:53.680 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-26T07:49:53.680 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-26T07:49:53.680 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-26T07:49:53.680 INFO:teuthology.provision.fog.smithi177:Deploy complete!
2024-03-26T07:49:53.681 DEBUG:teuthology.parallel:result is None
2024-03-26T07:50:41.052 WARNING:teuthology.provision.fog.smithi113:timed out
2024-03-26T07:50:47.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:47.317 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-26T07:50:47.318 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-26T07:50:47.618 INFO:teuthology.provision.fog.smithi113:Node is ready
2024-03-26T07:50:47.619 DEBUG:teuthology.orchestra.run.smithi113:> hostname
2024-03-26T07:50:47.636 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113.front.sepia.ceph.com
2024-03-26T07:50:47.636 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113.front.sepia.ceph.com /etc/hosts
2024-03-26T07:50:47.694 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113
2024-03-26T07:50:47.694 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-03-26T07:50:47.818 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hosts
2024-03-26T07:50:47.846 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts
2024-03-26T07:50:47.914 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hostname
2024-03-26T07:50:47.981 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-03-26T07:50:48.048 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-03-26T07:50:48.104 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="Red Hat Enterprise Linux"
2024-03-26T07:50:48.104 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8.6 (Ootpa)"
2024-03-26T07:50:48.104 INFO:teuthology.orchestra.run.smithi113.stdout:ID="rhel"
2024-03-26T07:50:48.104 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="fedora"
2024-03-26T07:50:48.104 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8.6"
2024-03-26T07:50:48.105 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8"
2024-03-26T07:50:48.105 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-26T07:50:48.105 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31"
2024-03-26T07:50:48.105 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-26T07:50:48.105 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://www.redhat.com/"
2024-03-26T07:50:48.105 INFO:teuthology.orchestra.run.smithi113.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-26T07:50:48.105 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T07:50:48.105 INFO:teuthology.orchestra.run.smithi113.stdout:
2024-03-26T07:50:48.105 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-26T07:50:48.105 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-26T07:50:48.105 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-26T07:50:48.105 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-26T07:50:48.105 INFO:teuthology.provision.fog.smithi113:Deploy complete!
2024-03-26T07:50:48.106 DEBUG:teuthology.parallel:result is None
2024-03-26T07:50:48.295 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com
2024-03-26T07:50:48.295 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-26T07:50:48.321 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com
2024-03-26T07:50:48.322 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-26T07:50:48.346 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com
2024-03-26T07:50:48.346 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-26T07:50:48.364 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server
2024-03-26T07:50:48.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-03-26T07:50:48.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:48.481 DEBUG:teuthology.orchestra.run.smithi113:> true
2024-03-26T07:50:48.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-03-26T07:50:48.547 DEBUG:teuthology.orchestra.run.smithi113:> uname -m
2024-03-26T07:50:48.603 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64
2024-03-26T07:50:48.603 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-03-26T07:50:48.659 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="Red Hat Enterprise Linux"
2024-03-26T07:50:48.659 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8.6 (Ootpa)"
2024-03-26T07:50:48.659 INFO:teuthology.orchestra.run.smithi113.stdout:ID="rhel"
2024-03-26T07:50:48.659 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="fedora"
2024-03-26T07:50:48.659 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8.6"
2024-03-26T07:50:48.660 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8"
2024-03-26T07:50:48.660 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-26T07:50:48.660 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31"
2024-03-26T07:50:48.660 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-26T07:50:48.660 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://www.redhat.com/"
2024-03-26T07:50:48.660 INFO:teuthology.orchestra.run.smithi113.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-26T07:50:48.660 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T07:50:48.660 INFO:teuthology.orchestra.run.smithi113.stdout:
2024-03-26T07:50:48.660 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-26T07:50:48.660 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-26T07:50:48.660 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-26T07:50:48.660 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-26T07:50:48.661 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-03-26T07:50:48.688 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server
2024-03-26T07:50:48.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com'
2024-03-26T07:50:48.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:48.765 DEBUG:teuthology.orchestra.run.smithi114:> true
2024-03-26T07:50:48.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com'
2024-03-26T07:50:48.904 DEBUG:teuthology.orchestra.run.smithi114:> uname -m
2024-03-26T07:50:48.961 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64
2024-03-26T07:50:48.962 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release
2024-03-26T07:50:49.019 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux"
2024-03-26T07:50:49.020 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)"
2024-03-26T07:50:49.020 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel"
2024-03-26T07:50:49.020 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora"
2024-03-26T07:50:49.020 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6"
2024-03-26T07:50:49.020 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8"
2024-03-26T07:50:49.020 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-26T07:50:49.020 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2024-03-26T07:50:49.020 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-26T07:50:49.020 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/"
2024-03-26T07:50:49.020 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-26T07:50:49.020 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T07:50:49.021 INFO:teuthology.orchestra.run.smithi114.stdout:
2024-03-26T07:50:49.021 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-26T07:50:49.021 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-26T07:50:49.021 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-26T07:50:49.021 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-26T07:50:49.021 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2024-03-26T07:50:49.055 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server
2024-03-26T07:50:49.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com'
2024-03-26T07:50:49.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-26T07:50:49.129 DEBUG:teuthology.orchestra.run.smithi177:> true
2024-03-26T07:50:49.264 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com'
2024-03-26T07:50:49.264 DEBUG:teuthology.orchestra.run.smithi177:> uname -m
2024-03-26T07:50:49.322 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64
2024-03-26T07:50:49.322 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2024-03-26T07:50:49.379 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux"
2024-03-26T07:50:49.380 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.6 (Ootpa)"
2024-03-26T07:50:49.380 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel"
2024-03-26T07:50:49.380 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora"
2024-03-26T07:50:49.380 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.6"
2024-03-26T07:50:49.380 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8"
2024-03-26T07:50:49.380 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-26T07:50:49.380 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2024-03-26T07:50:49.380 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-26T07:50:49.380 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/"
2024-03-26T07:50:49.380 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-26T07:50:49.380 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-26T07:50:49.381 INFO:teuthology.orchestra.run.smithi177.stdout:
2024-03-26T07:50:49.381 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-26T07:50:49.381 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-26T07:50:49.381 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-26T07:50:49.381 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-26T07:50:49.381 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2024-03-26T07:50:49.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T07:50:49.501 INFO:teuthology.dispatcher.supervisor:Running job 7622827
2024-03-26T07:50:49.502 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-03-26_06:02:13-fs-rishabh-yuri-RunCephCmd-reef-testing-default-smithi/7622827 --name rishabh-2024-03-26_06:02:13-fs-rishabh-yuri-RunCephCmd-reef-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/rishabh-2024-03-26_06:02:13-fs-rishabh-yuri-RunCephCmd-reef-testing-default-smithi/7622827/orig.config.yaml
2024-03-26T07:50:49.504 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-03-26_06:02:13-fs-rishabh-yuri-RunCephCmd-reef-testing-default-smithi/7622827
2024-03-26T07:50:49.505 INFO:teuthology.dispatcher.supervisor:Job PID: 1168726
2024-03-26T07:50:49.505 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-26T07:52:49.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T07:54:49.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T07:56:49.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T07:58:50.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:00:50.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:02:50.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:04:50.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:06:50.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:08:50.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:10:51.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:12:51.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:14:51.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-26T08:14:51.931 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1