2023-07-12T14:49:22.801 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-12T14:49:22.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T14:49:22.803 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T14:49:22.957 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc398e2b610>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc3987b2d30>, signals=[15])
2023-07-12T14:49:22.958 INFO:teuthology.lock.ops:Start node 'smithi060.front.sepia.ceph.com' reimaging
2023-07-12T14:49:22.959 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: reset os type and version on server
2023-07-12T14:49:22.959 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2023-07-12T14:49:22.986 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging
2023-07-12T14:49:22.986 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server
2023-07-12T14:49:22.986 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2023-07-12T14:49:22.988 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /host {"name": "smithi060"}
2023-07-12T14:49:23.011 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"}
2023-07-12T14:49:23.078 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-12T14:49:23.091 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-12T14:49:23.122 DEBUG:teuthology.provision.fog.smithi060:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-12T14:49:23.122 DEBUG:teuthology.provision.fog.smithi060:FOG request: PUT /host/165 {"imageID": 5}
2023-07-12T14:49:23.132 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-12T14:49:23.133 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 5}
2023-07-12T14:49:23.161 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of rhel 8.6
2023-07-12T14:49:23.161 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-12T14:49:23.179 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of rhel 8.6
2023-07-12T14:49:23.179 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-12T14:49:23.224 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /tasktype {"name": "deploy"}
2023-07-12T14:49:23.238 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"}
2023-07-12T14:49:23.258 DEBUG:teuthology.provision.fog.smithi060:FOG request: POST /host/165/task {"taskTypeID": 1}
2023-07-12T14:49:23.283 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1}
2023-07-12T14:49:23.311 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-12T14:49:23.327 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-12T14:49:23.412 INFO:teuthology.orchestra.console:Power off smithi060
2023-07-12T14:49:23.413 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-12T14:49:23.427 INFO:teuthology.orchestra.console:Power off smithi123
2023-07-12T14:49:23.427 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-12T14:49:23.435 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T14:49:23.447 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T14:49:27.461 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T14:49:27.470 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T14:49:31.577 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T14:49:31.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T14:49:31.789 INFO:teuthology.orchestra.console:Power off for smithi060 completed
2023-07-12T14:49:31.796 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2023-07-12T14:49:31.891 INFO:teuthology.orchestra.console:Power on smithi060
2023-07-12T14:49:31.891 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-12T14:49:31.899 INFO:teuthology.orchestra.console:Power on smithi123
2023-07-12T14:49:31.900 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-12T14:49:31.912 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T14:49:31.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T14:49:35.936 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T14:49:35.946 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T14:49:40.051 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T14:49:40.059 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T14:49:40.261 INFO:teuthology.orchestra.console:Power on for smithi060 completed
2023-07-12T14:49:40.340 INFO:teuthology.orchestra.console:Power on for smithi123 completed
2023-07-12T14:49:40.363 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish
2023-07-12T14:49:40.363 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-12T14:49:40.441 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2023-07-12T14:49:40.442 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-12T14:49:55.445 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-12T14:49:55.505 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-12T14:50:10.528 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-12T14:50:10.560 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-12T14:50:25.620 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-12T14:50:25.639 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-12T14:50:40.713 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-12T14:50:40.715 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-12T14:50:55.801 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-12T14:50:55.802 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-12T14:51:10.898 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-12T14:51:10.899 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-12T14:51:25.999 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-12T14:51:26.000 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-12T14:51:41.098 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-12T14:51:41.099 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-12T14:51:56.176 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-12T14:51:56.179 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-12T14:52:11.272 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-12T14:52:11.273 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-12T14:52:11.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:52:14.416 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2023-07-12T14:52:20.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:52:23.504 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2023-07-12T14:52:26.354 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-12T14:52:29.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:52:32.560 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2023-07-12T14:52:38.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:52:41.432 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-12T14:52:41.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:52:41.648 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2023-07-12T14:52:44.560 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-07-12T14:52:47.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:52:50.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:52:50.704 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2023-07-12T14:52:53.616 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-07-12T14:52:56.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:52:59.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:53:02.672 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-07-12T14:53:08.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:53:11.728 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-07-12T14:53:17.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:53:20.784 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-07-12T14:53:26.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:53:29.840 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-07-12T14:53:35.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:53:38.896 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-07-12T14:53:44.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:53:56.721 WARNING:teuthology.provision.fog.smithi060:timed out
2023-07-12T14:54:02.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:54:03.054 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-12T14:54:03.055 DEBUG:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-12T14:54:03.321 INFO:teuthology.provision.fog.smithi060:Node is ready
2023-07-12T14:54:03.322 DEBUG:teuthology.orchestra.run.smithi060:> hostname
2023-07-12T14:54:03.339 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com
2023-07-12T14:54:03.340 DEBUG:teuthology.orchestra.run.smithi060:> grep smithi060.front.sepia.ceph.com /etc/hosts
2023-07-12T14:54:03.398 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060
2023-07-12T14:54:03.398 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060
2023-07-12T14:54:03.530 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hosts
2023-07-12T14:54:03.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/172.21.15.60/172.21.15.60/g' /etc/hosts
2023-07-12T14:54:03.628 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hostname
2023-07-12T14:54:03.697 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060
2023-07-12T14:54:03.765 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release
2023-07-12T14:54:03.822 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux"
2023-07-12T14:54:03.823 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.6 (Ootpa)"
2023-07-12T14:54:03.823 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel"
2023-07-12T14:54:03.823 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora"
2023-07-12T14:54:03.823 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.6"
2023-07-12T14:54:03.823 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8"
2023-07-12T14:54:03.824 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-12T14:54:03.824 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31"
2023-07-12T14:54:03.824 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-12T14:54:03.824 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/"
2023-07-12T14:54:03.824 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-12T14:54:03.824 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-12T14:54:03.824 INFO:teuthology.orchestra.run.smithi060.stdout:
2023-07-12T14:54:03.825 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-12T14:54:03.825 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-12T14:54:03.825 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-12T14:54:03.825 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-12T14:54:03.826 INFO:teuthology.provision.fog.smithi060:Deploy complete!
2023-07-12T14:54:03.827 DEBUG:teuthology.parallel:result is None
2023-07-12T14:54:44.918 WARNING:teuthology.provision.fog.smithi123:timed out
2023-07-12T14:54:50.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:54:51.286 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-12T14:54:51.286 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-12T14:54:51.584 INFO:teuthology.provision.fog.smithi123:Node is ready
2023-07-12T14:54:51.584 DEBUG:teuthology.orchestra.run.smithi123:> hostname
2023-07-12T14:54:51.603 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123
2023-07-12T14:54:51.604 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123 /etc/hosts
2023-07-12T14:54:51.667 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123
2023-07-12T14:54:51.667 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2023-07-12T14:54:51.787 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123/smithi123/g' /etc/hosts
2023-07-12T14:54:51.817 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts
2023-07-12T14:54:51.889 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123/smithi123/g' /etc/hostname
2023-07-12T14:54:51.962 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2023-07-12T14:54:52.032 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2023-07-12T14:54:52.092 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux"
2023-07-12T14:54:52.092 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)"
2023-07-12T14:54:52.092 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel"
2023-07-12T14:54:52.093 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora"
2023-07-12T14:54:52.093 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6"
2023-07-12T14:54:52.093 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8"
2023-07-12T14:54:52.093 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-12T14:54:52.093 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2023-07-12T14:54:52.093 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-12T14:54:52.093 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/"
2023-07-12T14:54:52.094 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-12T14:54:52.094 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-12T14:54:52.094 INFO:teuthology.orchestra.run.smithi123.stdout:
2023-07-12T14:54:52.094 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-12T14:54:52.094 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-12T14:54:52.094 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-12T14:54:52.094 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-12T14:54:52.095 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2023-07-12T14:54:52.095 DEBUG:teuthology.parallel:result is None
2023-07-12T14:54:52.251 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com
2023-07-12T14:54:52.252 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com
2023-07-12T14:54:52.252 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-12T14:54:52.283 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server
2023-07-12T14:54:52.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com'
2023-07-12T14:54:52.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:54:52.350 DEBUG:teuthology.orchestra.run.smithi060:> true
2023-07-12T14:54:52.486 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com'
2023-07-12T14:54:52.486 DEBUG:teuthology.orchestra.run.smithi060:> uname -m
2023-07-12T14:54:52.542 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64
2023-07-12T14:54:52.543 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release
2023-07-12T14:54:52.599 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux"
2023-07-12T14:54:52.599 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.6 (Ootpa)"
2023-07-12T14:54:52.599 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel"
2023-07-12T14:54:52.600 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora"
2023-07-12T14:54:52.600 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.6"
2023-07-12T14:54:52.600 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8"
2023-07-12T14:54:52.600 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-12T14:54:52.600 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31"
2023-07-12T14:54:52.600 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-12T14:54:52.600 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/"
2023-07-12T14:54:52.601 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-12T14:54:52.601 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-12T14:54:52.601 INFO:teuthology.orchestra.run.smithi060.stdout:
2023-07-12T14:54:52.601 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-12T14:54:52.601 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-12T14:54:52.601 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-12T14:54:52.601 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-12T14:54:52.602 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2023-07-12T14:54:52.623 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server
2023-07-12T14:54:52.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2023-07-12T14:54:52.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-12T14:54:52.692 DEBUG:teuthology.orchestra.run.smithi123:> true
2023-07-12T14:54:52.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com'
2023-07-12T14:54:52.717 DEBUG:teuthology.orchestra.run.smithi123:> uname -m
2023-07-12T14:54:52.777 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64
2023-07-12T14:54:52.777 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2023-07-12T14:54:52.838 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux"
2023-07-12T14:54:52.838 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)"
2023-07-12T14:54:52.838 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel"
2023-07-12T14:54:52.838 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora"
2023-07-12T14:54:52.839 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6"
2023-07-12T14:54:52.839 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8"
2023-07-12T14:54:52.839 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-12T14:54:52.840 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2023-07-12T14:54:52.840 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-12T14:54:52.840 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/"
2023-07-12T14:54:52.841 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-12T14:54:52.841 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-12T14:54:52.841 INFO:teuthology.orchestra.run.smithi123.stdout:
2023-07-12T14:54:52.841 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-12T14:54:52.841 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-12T14:54:52.841 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-12T14:54:52.842 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-12T14:54:52.842 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2023-07-12T14:54:52.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T14:54:52.865 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T14:54:52.956 INFO:teuthology.dispatcher.supervisor:Running job 7335370
2023-07-12T14:54:52.956 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_choffman@teuthology --archive /home/teuthworker/archive/choffman-2023-07-12_14:43:48-rbd:mirror-wip-choffman-61707-distro-default-smithi/7335370 --name choffman-2023-07-12_14:43:48-rbd:mirror-wip-choffman-61707-distro-default-smithi --description rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} -- /home/teuthworker/archive/choffman-2023-07-12_14:43:48-rbd:mirror-wip-choffman-61707-distro-default-smithi/7335370/orig.config.yaml
2023-07-12T14:54:52.960 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/choffman-2023-07-12_14:43:48-rbd:mirror-wip-choffman-61707-distro-default-smithi/7335370
2023-07-12T14:54:52.961 INFO:teuthology.dispatcher.supervisor:Job PID: 23517
2023-07-12T14:54:52.961 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-12T14:56:53.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T14:56:53.046 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T14:58:53.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T14:58:53.218 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T15:00:53.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T15:00:53.399 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T15:02:53.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T15:02:53.581 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T15:04:53.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T15:04:53.750 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T15:06:53.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T15:06:53.927 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T15:08:54.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T15:08:54.108 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T15:10:54.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T15:10:54.282 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T15:12:54.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T15:12:54.448 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T15:14:54.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T15:14:54.620 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T15:16:54.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-12T15:16:54.794 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-12T15:16:54.868 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-12T15:16:54.983 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-12T15:16:54.984 INFO:teuthology.nuke:Checking targets against current locks
2023-07-12T15:16:55.041 DEBUG:teuthology.nuke:shortname: smithi060
2023-07-12T15:16:55.042 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-12T15:16:55.065 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-07-12_14:43:48-rbd:mirror-wip-choffman-61707-distro-default-smithi/7335370', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 14:49:22.006626', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-12T15:16:55.068 DEBUG:teuthology.nuke:shortname: smithi123
2023-07-12T15:16:55.068 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-12T15:16:55.091 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-07-12_14:43:48-rbd:mirror-wip-choffman-61707-distro-default-smithi/7335370', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-12 14:49:22.008325', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-12T15:16:55.123 INFO:teuthology.orchestra.console:Power off smithi060
2023-07-12T15:16:55.123 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-12T15:16:55.141 INFO:teuthology.orchestra.console:Power off smithi123
2023-07-12T15:16:55.141 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-12T15:16:55.152 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T15:16:55.164 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-12T15:16:55.275 INFO:teuthology.orchestra.console:Power off for smithi060 completed
2023-07-12T15:16:55.285 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2023-07-12T15:16:55.424 INFO:teuthology.lock.ops:unlocked: smithi060.front.sepia.ceph.com
2023-07-12T15:16:55.435 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com