2024-04-18T03:33:29.746 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d
2024-04-18T03:33:29.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:33:29.936 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fcaaa4b4f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fcaab514c10>, signals=[15])
2024-04-18T03:33:29.936 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging
2024-04-18T03:33:29.936 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T03:33:29.937 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2024-04-18T03:33:29.960 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging
2024-04-18T03:33:29.960 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T03:33:29.960 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2024-04-18T03:33:29.984 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging
2024-04-18T03:33:29.985 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T03:33:29.985 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2024-04-18T03:33:30.075 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T03:33:30.093 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T03:33:30.115 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of rhel 8.6
2024-04-18T03:33:30.128 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T03:33:30.138 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of rhel 8.6
2024-04-18T03:33:30.194 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of rhel 8.6
2024-04-18T03:33:30.359 INFO:teuthology.orchestra.console.smithi114:Power off
2024-04-18T03:33:30.359 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T03:33:30.375 INFO:teuthology.orchestra.console.smithi022:Power off
2024-04-18T03:33:30.375 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T03:33:30.390 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off
2024-04-18T03:33:30.391 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:30.399 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off
2024-04-18T03:33:30.400 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:30.411 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2024-04-18T03:33:30.421 INFO:teuthology.orchestra.console.smithi178:Power off
2024-04-18T03:33:30.421 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T03:33:30.429 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2024-04-18T03:33:30.446 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off
2024-04-18T03:33:30.446 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:30.467 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2024-04-18T03:33:30.512 INFO:teuthology.orchestra.console.smithi114:Power off completed
2024-04-18T03:33:30.530 INFO:teuthology.orchestra.console.smithi022:Power off completed
2024-04-18T03:33:30.568 INFO:teuthology.orchestra.console.smithi178:Power off completed
2024-04-18T03:33:30.612 INFO:teuthology.orchestra.console.smithi114:Power on
2024-04-18T03:33:30.612 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T03:33:30.631 INFO:teuthology.orchestra.console.smithi022:Power on
2024-04-18T03:33:30.631 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T03:33:30.643 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On
2024-04-18T03:33:30.643 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:30.654 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On
2024-04-18T03:33:30.654 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:30.665 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2024-04-18T03:33:30.668 INFO:teuthology.orchestra.console.smithi178:Power on
2024-04-18T03:33:30.669 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T03:33:30.677 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2024-04-18T03:33:30.691 DEBUG:teuthology.orchestra.console.smithi178:power on output: Chassis Power Control: Up/On
2024-04-18T03:33:30.691 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:30.713 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2024-04-18T03:33:34.666 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:34.678 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:34.714 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:34.775 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on
2024-04-18T03:33:34.785 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2024-04-18T03:33:34.822 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on
2024-04-18T03:33:34.876 INFO:teuthology.orchestra.console.smithi114:Power on completed
2024-04-18T03:33:34.923 INFO:teuthology.orchestra.console.smithi178:Power on completed
2024-04-18T03:33:34.977 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish
2024-04-18T03:33:35.024 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish
2024-04-18T03:33:38.789 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:33:38.897 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on
2024-04-18T03:33:38.998 INFO:teuthology.orchestra.console.smithi022:Power on completed
2024-04-18T03:33:39.098 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish
2024-04-18T03:36:10.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:36:21.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:36:28.702 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2024-04-18T03:36:34.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:36:37.790 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2024-04-18T03:36:39.710 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-04-18T03:36:43.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:36:45.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:36:46.846 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2024-04-18T03:36:48.766 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-04-18T03:36:52.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:36:54.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:36:57.823 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-04-18T03:37:03.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:06.882 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-04-18T03:37:12.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:15.966 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-04-18T03:37:21.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:21.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:24.638 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-18T03:37:30.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:33.729 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-18T03:37:39.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:40.382 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-04-18T03:37:42.817 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-18T03:37:46.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:48.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:49.442 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-04-18T03:37:51.906 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-18T03:37:52.852 WARNING:teuthology.provision.fog.smithi022:timed out
2024-04-18T03:37:55.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:57.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:58.526 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2024-04-18T03:37:58.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:37:59.156 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T03:37:59.157 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T03:37:59.412 INFO:teuthology.provision.fog.smithi022:Node is ready
2024-04-18T03:37:59.412 DEBUG:teuthology.orchestra.run.smithi022:> hostname
2024-04-18T03:37:59.433 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com
2024-04-18T03:37:59.433 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts
2024-04-18T03:37:59.494 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2024-04-18T03:37:59.495 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022
2024-04-18T03:37:59.607 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts
2024-04-18T03:37:59.642 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts
2024-04-18T03:37:59.717 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname
2024-04-18T03:37:59.792 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022
2024-04-18T03:37:59.866 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release
2024-04-18T03:37:59.927 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:37:59.927 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:37:59.928 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel"
2024-04-18T03:37:59.928 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora"
2024-04-18T03:37:59.928 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.6"
2024-04-18T03:37:59.928 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:37:59.928 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:37:59.928 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31"
2024-04-18T03:37:59.928 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:37:59.928 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:37:59.928 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:37:59.928 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:37:59.928 INFO:teuthology.orchestra.run.smithi022.stdout:
2024-04-18T03:37:59.928 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:37:59.928 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:37:59.928 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:37:59.929 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:37:59.929 INFO:teuthology.provision.fog.smithi022:Deploy complete!
2024-04-18T03:37:59.931 DEBUG:teuthology.parallel:result is None
2024-04-18T03:38:00.990 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-18T03:38:04.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:38:05.405 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T03:38:05.405 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T03:38:06.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:38:10.046 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-18T03:38:16.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:38:19.102 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-18T03:38:21.328 INFO:teuthology.provision.fog.smithi114:Node is ready
2024-04-18T03:38:21.329 DEBUG:teuthology.orchestra.run.smithi114:> hostname
2024-04-18T03:38:21.350 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com
2024-04-18T03:38:21.351 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114.front.sepia.ceph.com /etc/hosts
2024-04-18T03:38:21.410 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114
2024-04-18T03:38:21.410 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114
2024-04-18T03:38:21.531 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hosts
2024-04-18T03:38:21.561 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts
2024-04-18T03:38:21.630 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hostname
2024-04-18T03:38:21.699 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114
2024-04-18T03:38:21.767 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release
2024-04-18T03:38:21.824 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:38:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:38:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel"
2024-04-18T03:38:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora"
2024-04-18T03:38:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6"
2024-04-18T03:38:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:38:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:38:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2024-04-18T03:38:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:38:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:38:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:38:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:38:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:
2024-04-18T03:38:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:38:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:38:21.826 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:38:21.826 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:38:21.826 INFO:teuthology.provision.fog.smithi114:Deploy complete!
2024-04-18T03:38:21.826 DEBUG:teuthology.parallel:result is None
2024-04-18T03:38:25.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:39:25.168 WARNING:teuthology.provision.fog.smithi178:timed out
2024-04-18T03:39:31.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:39:31.425 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T03:39:31.425 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T03:39:31.674 INFO:teuthology.provision.fog.smithi178:Node is ready
2024-04-18T03:39:31.675 DEBUG:teuthology.orchestra.run.smithi178:> hostname
2024-04-18T03:39:31.692 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com
2024-04-18T03:39:31.693 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts
2024-04-18T03:39:31.751 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178
2024-04-18T03:39:31.751 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178
2024-04-18T03:39:31.887 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts
2024-04-18T03:39:31.916 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts
2024-04-18T03:39:31.984 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname
2024-04-18T03:39:32.052 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178
2024-04-18T03:39:32.119 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release
2024-04-18T03:39:32.176 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:39:32.176 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:39:32.176 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel"
2024-04-18T03:39:32.176 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora"
2024-04-18T03:39:32.176 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6"
2024-04-18T03:39:32.176 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:39:32.176 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:39:32.176 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2024-04-18T03:39:32.177 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:39:32.177 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:39:32.177 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:39:32.177 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:39:32.177 INFO:teuthology.orchestra.run.smithi178.stdout:
2024-04-18T03:39:32.177 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:39:32.177 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:39:32.177 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:39:32.177 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:39:32.177 INFO:teuthology.provision.fog.smithi178:Deploy complete!
2024-04-18T03:39:32.178 DEBUG:teuthology.parallel:result is None
2024-04-18T03:39:32.366 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com
2024-04-18T03:39:32.367 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T03:39:32.394 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com
2024-04-18T03:39:32.394 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T03:39:32.410 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com
2024-04-18T03:39:32.410 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T03:39:32.428 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server
2024-04-18T03:39:32.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com'
2024-04-18T03:39:32.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:39:32.500 DEBUG:teuthology.orchestra.run.smithi022:> true
2024-04-18T03:39:32.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com'
2024-04-18T03:39:32.647 DEBUG:teuthology.orchestra.run.smithi022:> uname -m
2024-04-18T03:39:32.708 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64
2024-04-18T03:39:32.709 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release
2024-04-18T03:39:32.769 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:39:32.769 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:39:32.769 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel"
2024-04-18T03:39:32.770 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora"
2024-04-18T03:39:32.770 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.6"
2024-04-18T03:39:32.770 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:39:32.770 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:39:32.770 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31"
2024-04-18T03:39:32.770 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:39:32.770 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:39:32.770 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:39:32.770 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:39:32.770 INFO:teuthology.orchestra.run.smithi022.stdout:
2024-04-18T03:39:32.770 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:39:32.770 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:39:32.770 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:39:32.771 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:39:32.771 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2024-04-18T03:39:32.794 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server
2024-04-18T03:39:32.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com'
2024-04-18T03:39:32.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:39:32.870 DEBUG:teuthology.orchestra.run.smithi114:> true
2024-04-18T03:39:33.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com'
2024-04-18T03:39:33.014 DEBUG:teuthology.orchestra.run.smithi114:> uname -m
2024-04-18T03:39:33.072 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64
2024-04-18T03:39:33.073 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release
2024-04-18T03:39:33.130 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:39:33.130 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:39:33.130 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel"
2024-04-18T03:39:33.130 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora"
2024-04-18T03:39:33.130 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6"
2024-04-18T03:39:33.131 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:39:33.131 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:39:33.131 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2024-04-18T03:39:33.131 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:39:33.131 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:39:33.131 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:39:33.131 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:39:33.131 INFO:teuthology.orchestra.run.smithi114.stdout:
2024-04-18T03:39:33.131 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:39:33.131 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:39:33.131 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:39:33.131 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:39:33.132 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2024-04-18T03:39:33.160 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server
2024-04-18T03:39:33.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com'
2024-04-18T03:39:33.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:39:33.238 DEBUG:teuthology.orchestra.run.smithi178:> true
2024-04-18T03:39:33.310 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com'
2024-04-18T03:39:33.310 DEBUG:teuthology.orchestra.run.smithi178:> uname -m
2024-04-18T03:39:33.369 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64
2024-04-18T03:39:33.370 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release
2024-04-18T03:39:33.428 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:39:33.429 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:39:33.429 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel"
2024-04-18T03:39:33.429 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora"
2024-04-18T03:39:33.429 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6"
2024-04-18T03:39:33.429 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:39:33.429 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:39:33.429 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2024-04-18T03:39:33.429 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:39:33.429 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:39:33.429 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:39:33.429 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:39:33.429 INFO:teuthology.orchestra.run.smithi178.stdout:
2024-04-18T03:39:33.429 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:39:33.429 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:39:33.430 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:39:33.430 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:39:33.430 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2024-04-18T03:39:33.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:39:33.565 INFO:teuthology.dispatcher.supervisor:Running job 7661451
2024-04-18T03:39:33.565 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661451 --name teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} -- /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661451/orig.config.yaml
2024-04-18T03:39:33.568 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661451
2024-04-18T03:39:33.569 INFO:teuthology.dispatcher.supervisor:Job PID: 967542
2024-04-18T03:39:33.569 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-18T03:41:33.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:43:33.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:45:34.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:47:34.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:49:34.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:51:34.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:53:34.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:53:34.780 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1