2024-04-18T03:44:47.369 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d
2024-04-18T03:44:47.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:44:47.555 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa6d15e8f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa6d2649c10>, signals=[15])
2024-04-18T03:44:47.556 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging
2024-04-18T03:44:47.556 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T03:44:47.556 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2024-04-18T03:44:47.580 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging
2024-04-18T03:44:47.580 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T03:44:47.580 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2024-04-18T03:44:47.596 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging
2024-04-18T03:44:47.597 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T03:44:47.597 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2024-04-18T03:44:47.695 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T03:44:47.730 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T03:44:47.734 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of rhel 8.6
2024-04-18T03:44:47.741 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T03:44:47.775 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of rhel 8.6
2024-04-18T03:44:47.779 DEBUG:teuthology.provision.fog.smithi152:Canceling deploy task with ID 969501
2024-04-18T03:44:47.790 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of rhel 8.6
2024-04-18T03:44:47.981 INFO:teuthology.orchestra.console.smithi152:Power off
2024-04-18T03:44:47.982 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T03:44:48.000 INFO:teuthology.orchestra.console.smithi157:Power off
2024-04-18T03:44:48.000 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T03:44:48.007 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off
2024-04-18T03:44:48.008 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:44:48.020 INFO:teuthology.orchestra.console.smithi175:Power off
2024-04-18T03:44:48.020 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T03:44:48.028 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2024-04-18T03:44:48.028 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off
2024-04-18T03:44:48.028 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:44:48.041 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off
2024-04-18T03:44:48.042 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:44:48.051 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-04-18T03:44:48.064 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2024-04-18T03:44:48.129 INFO:teuthology.orchestra.console.smithi152:Power off completed
2024-04-18T03:44:48.230 INFO:teuthology.orchestra.console.smithi152:Power on
2024-04-18T03:44:48.230 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T03:44:48.254 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On
2024-04-18T03:44:48.255 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:44:48.275 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2024-04-18T03:44:52.054 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:44:52.065 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:44:52.163 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-04-18T03:44:52.173 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2024-04-18T03:44:52.277 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:44:52.386 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2024-04-18T03:44:56.164 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:44:56.175 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:44:56.274 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-04-18T03:44:56.283 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-04-18T03:44:56.375 INFO:teuthology.orchestra.console.smithi157:Power off completed
2024-04-18T03:44:56.384 INFO:teuthology.orchestra.console.smithi175:Power off completed
2024-04-18T03:44:56.387 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:44:56.477 INFO:teuthology.orchestra.console.smithi157:Power on
2024-04-18T03:44:56.477 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T03:44:56.485 INFO:teuthology.orchestra.console.smithi175:Power on
2024-04-18T03:44:56.485 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T03:44:56.497 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2024-04-18T03:44:56.499 DEBUG:teuthology.orchestra.console.smithi157:power on output: Chassis Power Control: Up/On
2024-04-18T03:44:56.499 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:44:56.509 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On
2024-04-18T03:44:56.510 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:44:56.521 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-04-18T03:44:56.530 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-04-18T03:44:56.598 INFO:teuthology.orchestra.console.smithi152:Power on completed
2024-04-18T03:44:56.699 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish
2024-04-18T03:45:00.525 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:45:00.533 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:45:00.635 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off
2024-04-18T03:45:00.643 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-04-18T03:45:04.639 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:45:04.647 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T03:45:04.756 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2024-04-18T03:45:04.803 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on
2024-04-18T03:45:04.857 INFO:teuthology.orchestra.console.smithi175:Power on completed
2024-04-18T03:45:04.904 INFO:teuthology.orchestra.console.smithi157:Power on completed
2024-04-18T03:45:04.958 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish
2024-04-18T03:45:05.005 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish
2024-04-18T03:47:35.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:47:42.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:47:45.538 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T03:47:51.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:47:54.018 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-18T03:47:54.590 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T03:48:00.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:00.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:03.102 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-18T03:48:03.650 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T03:48:05.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:09.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:09.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:12.158 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-18T03:48:12.734 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T03:48:18.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:18.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:21.214 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-18T03:48:21.790 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T03:48:24.222 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-04-18T03:48:27.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:27.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:30.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:30.270 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-18T03:48:30.846 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T03:48:33.278 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-04-18T03:48:36.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:36.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:39.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:39.902 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T03:48:42.334 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-04-18T03:48:45.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:48.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:48.958 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T03:48:51.390 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-04-18T03:48:54.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:48:57.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:49:00.450 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-04-18T03:49:06.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:49:09.534 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-04-18T03:49:15.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:49:18.590 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157
2024-04-18T03:49:24.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:49:36.286 WARNING:teuthology.provision.fog.smithi175:timed out
2024-04-18T03:49:42.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:49:42.561 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T03:49:42.561 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T03:49:42.803 INFO:teuthology.provision.fog.smithi175:Node is ready
2024-04-18T03:49:42.803 DEBUG:teuthology.orchestra.run.smithi175:> hostname
2024-04-18T03:49:42.821 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com
2024-04-18T03:49:42.821 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts
2024-04-18T03:49:42.879 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175
2024-04-18T03:49:42.880 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175
2024-04-18T03:49:42.998 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts
2024-04-18T03:49:43.027 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts
2024-04-18T03:49:43.095 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname
2024-04-18T03:49:43.162 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175
2024-04-18T03:49:43.229 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release
2024-04-18T03:49:43.286 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:49:43.286 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:49:43.286 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel"
2024-04-18T03:49:43.286 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora"
2024-04-18T03:49:43.286 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6"
2024-04-18T03:49:43.286 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:49:43.286 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:49:43.286 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31"
2024-04-18T03:49:43.286 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:49:43.286 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:49:43.287 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:49:43.287 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:49:43.287 INFO:teuthology.orchestra.run.smithi175.stdout:
2024-04-18T03:49:43.287 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:49:43.287 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:49:43.287 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:49:43.287 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:49:43.288 INFO:teuthology.provision.fog.smithi175:Deploy complete!
2024-04-18T03:49:43.289 DEBUG:teuthology.parallel:result is None
2024-04-18T03:49:54.974 WARNING:teuthology.provision.fog.smithi152:timed out
2024-04-18T03:50:00.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:50:01.203 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T03:50:01.203 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T03:50:01.464 INFO:teuthology.provision.fog.smithi152:Node is ready
2024-04-18T03:50:01.465 DEBUG:teuthology.orchestra.run.smithi152:> hostname
2024-04-18T03:50:01.483 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152
2024-04-18T03:50:01.484 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152 /etc/hosts
2024-04-18T03:50:01.542 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152
2024-04-18T03:50:01.542 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152
2024-04-18T03:50:01.646 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152/smithi152/g' /etc/hosts
2024-04-18T03:50:01.674 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts
2024-04-18T03:50:01.740 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152/smithi152/g' /etc/hostname
2024-04-18T03:50:01.808 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152
2024-04-18T03:50:01.874 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release
2024-04-18T03:50:01.931 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:50:01.932 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:50:01.932 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel"
2024-04-18T03:50:01.932 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora"
2024-04-18T03:50:01.932 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.6"
2024-04-18T03:50:01.932 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:50:01.932 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:50:01.932 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2024-04-18T03:50:01.932 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:50:01.932 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:50:01.932 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:50:01.932 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:50:01.932 INFO:teuthology.orchestra.run.smithi152.stdout:
2024-04-18T03:50:01.932 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:50:01.932 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:50:01.933 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:50:01.933 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:50:01.933 INFO:teuthology.provision.fog.smithi152:Deploy complete!
2024-04-18T03:50:01.934 DEBUG:teuthology.parallel:result is None
2024-04-18T03:50:24.621 WARNING:teuthology.provision.fog.smithi157:timed out
2024-04-18T03:50:30.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:50:30.858 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T03:50:30.858 DEBUG:teuthology.orchestra.run.smithi157:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T03:50:31.113 INFO:teuthology.provision.fog.smithi157:Node is ready
2024-04-18T03:50:31.113 DEBUG:teuthology.orchestra.run.smithi157:> hostname
2024-04-18T03:50:31.131 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157
2024-04-18T03:50:31.131 DEBUG:teuthology.orchestra.run.smithi157:> grep smithi157 /etc/hosts
2024-04-18T03:50:31.189 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157
2024-04-18T03:50:31.190 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2024-04-18T03:50:31.312 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157/smithi157/g' /etc/hosts
2024-04-18T03:50:31.340 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/172.21.15.157/172.21.15.157/g' /etc/hosts
2024-04-18T03:50:31.409 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i -e 's/smithi157/smithi157/g' /etc/hostname
2024-04-18T03:50:31.477 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname smithi157
2024-04-18T03:50:31.543 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2024-04-18T03:50:31.600 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:50:31.601 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:50:31.601 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel"
2024-04-18T03:50:31.601 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora"
2024-04-18T03:50:31.601 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6"
2024-04-18T03:50:31.601 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:50:31.602 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:50:31.602 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2024-04-18T03:50:31.602 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:50:31.602 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:50:31.602 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:50:31.602 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:50:31.602 INFO:teuthology.orchestra.run.smithi157.stdout:
2024-04-18T03:50:31.602 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:50:31.602 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:50:31.602 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:50:31.602 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:50:31.603 INFO:teuthology.provision.fog.smithi157:Deploy complete!
2024-04-18T03:50:31.604 DEBUG:teuthology.parallel:result is None
2024-04-18T03:50:31.794 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com
2024-04-18T03:50:31.795 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T03:50:31.826 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com
2024-04-18T03:50:31.826 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T03:50:31.842 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com
2024-04-18T03:50:31.842 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T03:50:31.860 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server
2024-04-18T03:50:31.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com'
2024-04-18T03:50:31.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:50:31.934 DEBUG:teuthology.orchestra.run.smithi152:> true
2024-04-18T03:50:32.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com'
2024-04-18T03:50:32.073 DEBUG:teuthology.orchestra.run.smithi152:> uname -m
2024-04-18T03:50:32.131 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64
2024-04-18T03:50:32.132 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release
2024-04-18T03:50:32.189 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:50:32.190 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:50:32.190 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel"
2024-04-18T03:50:32.190 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora"
2024-04-18T03:50:32.190 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.6"
2024-04-18T03:50:32.190 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:50:32.190 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:50:32.190 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2024-04-18T03:50:32.190 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:50:32.190 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:50:32.190 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:50:32.190 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:50:32.190 INFO:teuthology.orchestra.run.smithi152.stdout:
2024-04-18T03:50:32.191 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:50:32.191 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:50:32.191 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:50:32.191 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:50:32.191 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2024-04-18T03:50:32.217 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server
2024-04-18T03:50:32.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com'
2024-04-18T03:50:32.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:50:32.289 DEBUG:teuthology.orchestra.run.smithi157:> true
2024-04-18T03:50:32.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com'
2024-04-18T03:50:32.357 DEBUG:teuthology.orchestra.run.smithi157:> uname -m
2024-04-18T03:50:32.415 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64
2024-04-18T03:50:32.415 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release
2024-04-18T03:50:32.473 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:50:32.473 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:50:32.473 INFO:teuthology.orchestra.run.smithi157.stdout:ID="rhel"
2024-04-18T03:50:32.473 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="fedora"
2024-04-18T03:50:32.473 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8.6"
2024-04-18T03:50:32.473 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:50:32.473 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:50:32.473 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31"
2024-04-18T03:50:32.473 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:50:32.473 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:50:32.474 INFO:teuthology.orchestra.run.smithi157.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:50:32.474 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:50:32.474 INFO:teuthology.orchestra.run.smithi157.stdout:
2024-04-18T03:50:32.474 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:50:32.474 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:50:32.474 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:50:32.474 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:50:32.474 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server
2024-04-18T03:50:32.501 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server
2024-04-18T03:50:32.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com'
2024-04-18T03:50:32.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T03:50:32.575 DEBUG:teuthology.orchestra.run.smithi175:> true
2024-04-18T03:50:32.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com'
2024-04-18T03:50:32.716 DEBUG:teuthology.orchestra.run.smithi175:> uname -m
2024-04-18T03:50:32.774 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64
2024-04-18T03:50:32.775 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release
2024-04-18T03:50:32.832 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T03:50:32.832 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T03:50:32.832 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel"
2024-04-18T03:50:32.833 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora"
2024-04-18T03:50:32.833 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6"
2024-04-18T03:50:32.833 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8"
2024-04-18T03:50:32.833 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T03:50:32.833 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31"
2024-04-18T03:50:32.833 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T03:50:32.833 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T03:50:32.833 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T03:50:32.833 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T03:50:32.833 INFO:teuthology.orchestra.run.smithi175.stdout:
2024-04-18T03:50:32.833 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T03:50:32.833 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T03:50:32.833 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T03:50:32.833 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T03:50:32.834 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2024-04-18T03:50:32.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:50:32.956 INFO:teuthology.dispatcher.supervisor:Running job 7661465
2024-04-18T03:50:32.956 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661465 --name teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661465/orig.config.yaml
2024-04-18T03:50:32.959 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661465
2024-04-18T03:50:32.959 INFO:teuthology.dispatcher.supervisor:Job PID: 1028213
2024-04-18T03:50:32.959 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-18T03:52:33.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:54:33.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:56:33.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T03:58:33.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T04:00:33.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T04:02:33.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T04:04:34.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T04:04:34.122 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1