2024-04-18T03:18:02.228 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d
2024-04-18T03:18:02.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:18:02.396 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f71049ebf70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f7105a4cc10>, signals=[15])
2024-04-18T03:18:02.397 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging
2024-04-18T03:18:02.397 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T03:18:02.397 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2024-04-18T03:18:02.415 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2024-04-18T03:18:02.415 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T03:18:02.415 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-04-18T03:18:02.440 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging
2024-04-18T03:18:02.440 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T03:18:02.440 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2024-04-18T03:18:02.525 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T03:18:02.552 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T03:18:02.561 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of rhel 8.6
2024-04-18T03:18:02.569 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T03:18:02.595 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of rhel 8.6
2024-04-18T03:18:02.612 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of rhel 8.6
2024-04-18T03:18:02.858 INFO:teuthology.orchestra.console.smithi112:Power off
2024-04-18T03:18:02.859 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T03:18:02.873 INFO:teuthology.orchestra.console.smithi179:Power off
2024-04-18T03:18:02.873 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T03:18:02.888 INFO:teuthology.orchestra.console.smithi161:Power off
2024-04-18T03:18:02.888 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T03:18:02.895 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2024-04-18T03:18:02.896 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:18:02.903 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off
2024-04-18T03:18:02.904 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:18:02.913 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2024-04-18T03:18:02.913 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:18:02.921 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-04-18T03:18:02.925 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2024-04-18T03:18:02.934 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-04-18T03:18:03.022 INFO:teuthology.orchestra.console.smithi112:Power off completed
2024-04-18T03:18:03.026 INFO:teuthology.orchestra.console.smithi179:Power off completed
2024-04-18T03:18:03.035 INFO:teuthology.orchestra.console.smithi161:Power off completed
2024-04-18T03:18:03.123 INFO:teuthology.orchestra.console.smithi112:Power on
2024-04-18T03:18:03.124 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T03:18:03.132 INFO:teuthology.orchestra.console.smithi179:Power on
2024-04-18T03:18:03.132 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T03:18:03.139 INFO:teuthology.orchestra.console.smithi161:Power on
2024-04-18T03:18:03.139 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T03:18:03.148 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On
2024-04-18T03:18:03.148 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:18:03.157 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On
2024-04-18T03:18:03.157 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:18:03.165 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On
2024-04-18T03:18:03.166 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:18:03.173 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-04-18T03:18:03.178 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2024-04-18T03:18:03.186 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2024-04-18T03:18:07.178 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:18:07.185 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:18:07.192 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:18:07.288 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-04-18T03:18:07.294 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2024-04-18T03:18:07.300 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2024-04-18T03:18:07.389 INFO:teuthology.orchestra.console.smithi112:Power on completed
2024-04-18T03:18:07.401 INFO:teuthology.orchestra.console.smithi161:Power on completed
2024-04-18T03:18:07.490 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish
2024-04-18T03:18:07.502 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2024-04-18T03:18:11.298 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:18:11.407 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2024-04-18T03:18:11.508 INFO:teuthology.orchestra.console.smithi179:Power on completed
2024-04-18T03:18:11.609 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish
2024-04-18T03:20:53.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:20:53.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:20:57.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:21:12.223 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-18T03:21:12.223 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-04-18T03:21:16.318 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-04-18T03:21:18.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:21:18.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:21:21.278 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-18T03:21:21.279 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-04-18T03:21:22.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:21:25.377 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-04-18T03:21:27.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:21:27.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:21:30.338 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-18T03:21:30.339 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-04-18T03:21:31.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:21:34.430 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-04-18T03:21:36.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:21:36.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:21:39.390 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-18T03:21:39.422 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-04-18T03:21:40.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:21:43.486 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-04-18T03:21:45.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:21:45.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:21:48.478 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2024-04-18T03:21:49.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:21:54.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:22:03.939 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-18T03:22:09.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:22:13.026 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-18T03:22:19.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:22:22.110 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-18T03:22:28.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:22:28.657 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T03:22:28.658 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T03:22:44.465 INFO:teuthology.provision.fog.smithi112:Node is ready
2024-04-18T03:22:44.465 DEBUG:teuthology.orchestra.run.smithi112:> hostname
2024-04-18T03:22:44.487 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com
2024-04-18T03:22:44.487 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts
2024-04-18T03:22:44.547 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112
2024-04-18T03:22:44.548 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2024-04-18T03:22:44.670 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts
2024-04-18T03:22:44.702 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts
2024-04-18T03:22:44.771 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname
2024-04-18T03:22:44.839 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2024-04-18T03:22:44.908 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2024-04-18T03:22:44.964 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:22:44.965 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:22:44.965 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel"
2024-04-18T03:22:44.965 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora"
2024-04-18T03:22:44.965 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6"
2024-04-18T03:22:44.965 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:22:44.965 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:22:44.965 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2024-04-18T03:22:44.965 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:22:44.965 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:22:44.965 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:22:44.965 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:22:44.966 INFO:teuthology.orchestra.run.smithi112.stdout:
2024-04-18T03:22:44.966 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:22:44.966 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:22:44.966 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:22:44.966 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:22:44.967 INFO:teuthology.provision.fog.smithi112:Deploy complete!
2024-04-18T03:22:44.968 DEBUG:teuthology.parallel:result is None
2024-04-18T03:22:49.494 WARNING:teuthology.provision.fog.smithi179:timed out
2024-04-18T03:22:54.490 WARNING:teuthology.provision.fog.smithi161:timed out
2024-04-18T03:22:55.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:22:55.738 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T03:22:55.738 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T03:22:55.974 INFO:teuthology.provision.fog.smithi179:Node is ready
2024-04-18T03:22:55.974 DEBUG:teuthology.orchestra.run.smithi179:> hostname
2024-04-18T03:22:55.991 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179
2024-04-18T03:22:55.991 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179 /etc/hosts
2024-04-18T03:22:56.049 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179
2024-04-18T03:22:56.049 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179
2024-04-18T03:22:56.173 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179/smithi179/g' /etc/hosts
2024-04-18T03:22:56.200 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts
2024-04-18T03:22:56.268 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179/smithi179/g' /etc/hostname
2024-04-18T03:22:56.335 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179
2024-04-18T03:22:56.401 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release
2024-04-18T03:22:56.458 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:22:56.458 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:22:56.458 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel"
2024-04-18T03:22:56.458 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora"
2024-04-18T03:22:56.458 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6"
2024-04-18T03:22:56.458 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:22:56.458 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:22:56.458 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31"
2024-04-18T03:22:56.458 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:22:56.459 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:22:56.459 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:22:56.459 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:22:56.459 INFO:teuthology.orchestra.run.smithi179.stdout:
2024-04-18T03:22:56.459 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:22:56.459 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:22:56.459 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:22:56.459 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:22:56.459 INFO:teuthology.provision.fog.smithi179:Deploy complete!
2024-04-18T03:22:56.460 DEBUG:teuthology.parallel:result is None
2024-04-18T03:23:00.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:23:00.714 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T03:23:00.714 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T03:23:00.980 INFO:teuthology.provision.fog.smithi161:Node is ready
2024-04-18T03:23:00.981 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2024-04-18T03:23:00.999 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2024-04-18T03:23:00.999 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts
2024-04-18T03:23:01.057 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2024-04-18T03:23:01.057 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-04-18T03:23:01.167 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts
2024-04-18T03:23:01.196 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts
2024-04-18T03:23:01.263 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname
2024-04-18T03:23:01.330 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2024-04-18T03:23:01.396 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-04-18T03:23:01.453 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:23:01.453 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:23:01.453 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel"
2024-04-18T03:23:01.453 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora"
2024-04-18T03:23:01.453 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6"
2024-04-18T03:23:01.453 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:23:01.453 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:23:01.453 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-04-18T03:23:01.453 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:23:01.453 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:23:01.453 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:23:01.454 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:23:01.454 INFO:teuthology.orchestra.run.smithi161.stdout:
2024-04-18T03:23:01.454 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:23:01.454 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:23:01.454 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:23:01.454 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:23:01.454 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2024-04-18T03:23:01.455 DEBUG:teuthology.parallel:result is None
2024-04-18T03:23:01.644 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com
2024-04-18T03:23:01.645 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T03:23:01.666 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2024-04-18T03:23:01.666 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T03:23:01.682 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com
2024-04-18T03:23:01.682 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T03:23:01.700 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server
2024-04-18T03:23:01.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com'
2024-04-18T03:23:01.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:23:01.776 DEBUG:teuthology.orchestra.run.smithi112:> true
2024-04-18T03:23:01.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com'
2024-04-18T03:23:01.870 DEBUG:teuthology.orchestra.run.smithi112:> uname -m
2024-04-18T03:23:01.928 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64
2024-04-18T03:23:01.928 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2024-04-18T03:23:01.984 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:23:01.985 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:23:01.985 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel"
2024-04-18T03:23:01.985 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora"
2024-04-18T03:23:01.985 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6"
2024-04-18T03:23:01.985 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:23:01.985 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:23:01.985 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2024-04-18T03:23:01.985 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:23:01.985 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:23:01.985 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:23:01.985 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:23:01.986 INFO:teuthology.orchestra.run.smithi112.stdout:
2024-04-18T03:23:01.986 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:23:01.986 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:23:01.986 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:23:01.986 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:23:01.986 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2024-04-18T03:23:02.007 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2024-04-18T03:23:02.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-04-18T03:23:02.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:23:02.077 DEBUG:teuthology.orchestra.run.smithi161:> true
2024-04-18T03:23:02.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2024-04-18T03:23:02.144 DEBUG:teuthology.orchestra.run.smithi161:> uname -m
2024-04-18T03:23:02.202 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2024-04-18T03:23:02.202 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2024-04-18T03:23:02.260 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:23:02.260 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:23:02.260 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel"
2024-04-18T03:23:02.260 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora"
2024-04-18T03:23:02.260 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6"
2024-04-18T03:23:02.260 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:23:02.260 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:23:02.261 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2024-04-18T03:23:02.261 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:23:02.261 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:23:02.261 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:23:02.261 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:23:02.261 INFO:teuthology.orchestra.run.smithi161.stdout:
2024-04-18T03:23:02.261 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:23:02.261 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:23:02.261 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:23:02.261 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:23:02.261 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2024-04-18T03:23:02.283 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server
2024-04-18T03:23:02.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com'
2024-04-18T03:23:02.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:23:02.356 DEBUG:teuthology.orchestra.run.smithi179:> true
2024-04-18T03:23:02.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com'
2024-04-18T03:23:02.426 DEBUG:teuthology.orchestra.run.smithi179:> uname -m
2024-04-18T03:23:02.485 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64
2024-04-18T03:23:02.486 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release
2024-04-18T03:23:02.544 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:23:02.544 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:23:02.544 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel"
2024-04-18T03:23:02.544 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora"
2024-04-18T03:23:02.544 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6"
2024-04-18T03:23:02.545 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:23:02.545 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:23:02.545 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31"
2024-04-18T03:23:02.545 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:23:02.545 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:23:02.545 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:23:02.545 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:23:02.545 INFO:teuthology.orchestra.run.smithi179.stdout:
2024-04-18T03:23:02.545 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:23:02.545 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:23:02.545 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:23:02.545 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:23:02.546 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2024-04-18T03:23:02.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:23:02.660 INFO:teuthology.dispatcher.supervisor:Running job 7661438
2024-04-18T03:23:02.660 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661438 --name teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/direct_io}} -- /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661438/orig.config.yaml
2024-04-18T03:23:02.663 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661438
2024-04-18T03:23:02.664 INFO:teuthology.dispatcher.supervisor:Job PID: 891753
2024-04-18T03:23:02.664 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-18T03:25:02.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:27:02.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:29:03.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:31:03.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:33:03.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:35:03.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:37:03.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:39:03.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:41:04.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:43:04.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:43:04.319 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1