2023-10-20T14:11:49.070 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07
2023-10-20T14:11:49.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:11:49.212 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f0fb6a33b50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f0fb62dfee0>, signals=[15])
2023-10-20T14:11:49.214 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging
2023-10-20T14:11:49.214 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server
2023-10-20T14:11:49.214 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2023-10-20T14:11:49.234 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging
2023-10-20T14:11:49.235 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server
2023-10-20T14:11:49.235 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2023-10-20T14:11:49.237 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /host {"name": "smithi088"}
2023-10-20T14:11:49.259 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"}
2023-10-20T14:11:49.307 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-10-20T14:11:49.323 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-10-20T14:11:49.358 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_rhel_8.6 (ID 5)
2023-10-20T14:11:49.359 DEBUG:teuthology.provision.fog.smithi088:FOG request: PUT /host/193 {"imageID": 5}
2023-10-20T14:11:49.368 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_rhel_8.6 (ID 5)
2023-10-20T14:11:49.369 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 5}
2023-10-20T14:11:49.403 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of rhel 8.6
2023-10-20T14:11:49.404 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-10-20T14:11:49.415 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of rhel 8.6
2023-10-20T14:11:49.416 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-10-20T14:11:49.450 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"}
2023-10-20T14:11:49.454 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /tasktype {"name": "deploy"}
2023-10-20T14:11:49.491 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1}
2023-10-20T14:11:49.494 DEBUG:teuthology.provision.fog.smithi088:FOG request: POST /host/193/task {"taskTypeID": 1}
2023-10-20T14:11:49.549 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-10-20T14:11:49.580 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-10-20T14:11:49.618 INFO:teuthology.orchestra.console.smithi088:Power off
2023-10-20T14:11:49.619 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-20T14:11:49.644 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2023-10-20T14:11:49.644 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-20T14:11:49.660 INFO:teuthology.orchestra.console.smithi169:Power off
2023-10-20T14:11:49.661 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-20T14:11:49.669 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2023-10-20T14:11:49.681 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off
2023-10-20T14:11:49.682 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-20T14:11:49.702 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-10-20T14:11:49.771 INFO:teuthology.orchestra.console.smithi088:Power off completed
2023-10-20T14:11:49.804 INFO:teuthology.orchestra.console.smithi169:Power off completed
2023-10-20T14:11:49.872 INFO:teuthology.orchestra.console.smithi088:Power on
2023-10-20T14:11:49.873 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-20T14:11:49.895 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On
2023-10-20T14:11:49.896 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-20T14:11:49.905 INFO:teuthology.orchestra.console.smithi169:Power on
2023-10-20T14:11:49.906 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-20T14:11:49.916 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2023-10-20T14:11:49.930 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On
2023-10-20T14:11:49.931 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-20T14:11:49.953 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-10-20T14:11:53.918 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-20T14:11:53.954 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-20T14:11:54.030 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2023-10-20T14:11:54.064 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-10-20T14:11:54.132 INFO:teuthology.orchestra.console.smithi088:Power on completed
2023-10-20T14:11:54.233 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish
2023-10-20T14:11:54.234 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-10-20T14:11:58.066 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-20T14:11:58.175 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2023-10-20T14:11:58.276 INFO:teuthology.orchestra.console.smithi169:Power on completed
2023-10-20T14:11:58.377 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish
2023-10-20T14:11:58.377 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-10-20T14:12:09.290 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-10-20T14:12:13.442 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-10-20T14:12:24.354 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-10-20T14:12:28.506 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-10-20T14:12:39.417 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-10-20T14:12:43.562 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-10-20T14:12:54.482 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-10-20T14:12:58.614 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-10-20T14:13:09.542 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-10-20T14:13:13.669 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-10-20T14:13:24.610 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-10-20T14:13:28.722 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-10-20T14:13:39.678 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-10-20T14:13:43.774 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-10-20T14:13:54.740 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-10-20T14:13:58.826 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-10-20T14:14:09.806 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-10-20T14:14:13.886 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-10-20T14:14:24.866 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-10-20T14:14:28.942 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-10-20T14:14:39.922 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-10-20T14:14:43.996 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-10-20T14:14:44.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-20T14:14:54.977 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-10-20T14:14:55.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-20T14:15:13.534 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-10-20T14:15:19.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-20T14:15:22.590 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-10-20T14:15:28.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-20T14:15:31.678 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-10-20T14:15:37.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-20T14:15:40.734 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-10-20T14:15:46.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-20T14:15:49.790 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-10-20T14:15:55.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-20T14:15:58.842 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-10-20T14:16:04.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-20T14:16:14.218 ERROR:teuthology.orchestra.connection:Error authenticating with smithi169.front.sepia.ceph.com: AuthenticationException('Authentication timeout.')
2023-10-20T14:16:21.274 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-10-20T14:16:27.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-20T14:16:27.770 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-10-20T14:16:33.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-20T14:16:34.116 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-20T14:16:34.118 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-20T14:16:34.394 INFO:teuthology.provision.fog.smithi169:Node is ready
2023-10-20T14:16:34.395 DEBUG:teuthology.orchestra.run.smithi169:> hostname
2023-10-20T14:16:34.411 INFO:teuthology.orchestra.run.smithi169.stdout:smithi022
2023-10-20T14:16:34.412 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi022 /etc/hosts
2023-10-20T14:16:34.468 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-10-20T14:16:34.469 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2023-10-20T14:16:34.590 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi022/smithi169/g' /etc/hosts
2023-10-20T14:16:34.616 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.22/172.21.15.169/g' /etc/hosts
2023-10-20T14:16:34.683 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi022/smithi169/g' /etc/hostname
2023-10-20T14:16:34.750 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2023-10-20T14:16:34.815 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2023-10-20T14:16:34.872 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux"
2023-10-20T14:16:34.872 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)"
2023-10-20T14:16:34.872 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel"
2023-10-20T14:16:34.873 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora"
2023-10-20T14:16:34.873 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6"
2023-10-20T14:16:34.873 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8"
2023-10-20T14:16:34.873 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-20T14:16:34.873 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2023-10-20T14:16:34.874 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-20T14:16:34.874 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/"
2023-10-20T14:16:34.874 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-20T14:16:34.874 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-20T14:16:34.874 INFO:teuthology.orchestra.run.smithi169.stdout:
2023-10-20T14:16:34.875 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-20T14:16:34.875 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-20T14:16:34.875 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-20T14:16:34.875 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-20T14:16:34.876 INFO:teuthology.provision.fog.smithi169:Deploy complete!
2023-10-20T14:16:34.877 DEBUG:teuthology.parallel:result is None
2023-10-20T14:16:38.015 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-10-20T14:17:04.846 WARNING:teuthology.provision.fog.smithi088:timed out
2023-10-20T14:17:10.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-20T14:17:11.192 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-20T14:17:11.193 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-20T14:17:11.470 INFO:teuthology.provision.fog.smithi088:Node is ready
2023-10-20T14:17:11.471 DEBUG:teuthology.orchestra.run.smithi088:> hostname
2023-10-20T14:17:11.489 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com
2023-10-20T14:17:11.489 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts
2023-10-20T14:17:11.547 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088
2023-10-20T14:17:11.548 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2023-10-20T14:17:11.664 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts
2023-10-20T14:17:11.692 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts
2023-10-20T14:17:11.759 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname
2023-10-20T14:17:11.825 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2023-10-20T14:17:11.891 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2023-10-20T14:17:11.946 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux"
2023-10-20T14:17:11.947 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)"
2023-10-20T14:17:11.947 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel"
2023-10-20T14:17:11.947 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora"
2023-10-20T14:17:11.947 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6"
2023-10-20T14:17:11.948 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8"
2023-10-20T14:17:11.948 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-20T14:17:11.948 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2023-10-20T14:17:11.948 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-20T14:17:11.948 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/"
2023-10-20T14:17:11.949 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-20T14:17:11.949 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-20T14:17:11.949 INFO:teuthology.orchestra.run.smithi088.stdout:
2023-10-20T14:17:11.949 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-20T14:17:11.949 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-20T14:17:11.949 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-20T14:17:11.950 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-20T14:17:11.950 INFO:teuthology.provision.fog.smithi088:Deploy complete!
2023-10-20T14:17:11.951 DEBUG:teuthology.parallel:result is None
2023-10-20T14:17:12.101 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com
2023-10-20T14:17:12.101 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com
2023-10-20T14:17:12.102 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-20T14:17:12.128 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server
2023-10-20T14:17:12.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com'
2023-10-20T14:17:12.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-20T14:17:12.195 DEBUG:teuthology.orchestra.run.smithi088:> true
2023-10-20T14:17:12.219 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com'
2023-10-20T14:17:12.219 DEBUG:teuthology.orchestra.run.smithi088:> uname -m
2023-10-20T14:17:12.277 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64
2023-10-20T14:17:12.277 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2023-10-20T14:17:12.334 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux"
2023-10-20T14:17:12.335 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)"
2023-10-20T14:17:12.335 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel"
2023-10-20T14:17:12.335 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora"
2023-10-20T14:17:12.335 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6"
2023-10-20T14:17:12.335 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8"
2023-10-20T14:17:12.336 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-20T14:17:12.336 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2023-10-20T14:17:12.336 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-20T14:17:12.336 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/"
2023-10-20T14:17:12.337 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-20T14:17:12.337 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-20T14:17:12.337 INFO:teuthology.orchestra.run.smithi088.stdout:
2023-10-20T14:17:12.337 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-20T14:17:12.337 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-20T14:17:12.338 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-20T14:17:12.338 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-20T14:17:12.338 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2023-10-20T14:17:12.361 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server
2023-10-20T14:17:12.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2023-10-20T14:17:12.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-20T14:17:12.430 DEBUG:teuthology.orchestra.run.smithi169:> true
2023-10-20T14:17:12.503 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com'
2023-10-20T14:17:12.503 DEBUG:teuthology.orchestra.run.smithi169:> uname -m
2023-10-20T14:17:12.562 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64
2023-10-20T14:17:12.563 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2023-10-20T14:17:12.621 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux"
2023-10-20T14:17:12.621 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)"
2023-10-20T14:17:12.622 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel"
2023-10-20T14:17:12.622 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora"
2023-10-20T14:17:12.622 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6"
2023-10-20T14:17:12.622 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8"
2023-10-20T14:17:12.622 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-20T14:17:12.623 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2023-10-20T14:17:12.623 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-20T14:17:12.623 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/"
2023-10-20T14:17:12.623 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-20T14:17:12.623 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-20T14:17:12.624 INFO:teuthology.orchestra.run.smithi169.stdout:
2023-10-20T14:17:12.624 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-20T14:17:12.624 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-20T14:17:12.624 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-20T14:17:12.624 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-20T14:17:12.625 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2023-10-20T14:17:12.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:17:12.759 INFO:teuthology.dispatcher.supervisor:Running job 7427635
2023-10-20T14:17:12.760 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427635 --name teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427635/orig.config.yaml
2023-10-20T14:17:12.764 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427635
2023-10-20T14:17:12.764 INFO:teuthology.dispatcher.supervisor:Job PID: 2263610
2023-10-20T14:17:12.765 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-20T14:19:12.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:21:13.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:23:13.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:25:13.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:27:13.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:29:13.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:31:13.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:33:14.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:35:14.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:37:14.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:39:14.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:41:14.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:43:14.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:45:14.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:47:15.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:49:15.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:51:15.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:53:15.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:55:15.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:57:16.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T14:59:16.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:01:16.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:03:16.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:05:16.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:07:16.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:09:17.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:11:17.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:13:17.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:15:17.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:17:17.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:19:17.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:21:18.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:23:18.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:25:18.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:27:18.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:29:18.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:31:18.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:33:18.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:35:19.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-20T15:35:19.217 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-10-20T15:35:19.413 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-20T15:35:19.413 INFO:teuthology.nuke:Checking targets against current locks
2023-10-20T15:35:19.462 DEBUG:teuthology.nuke:shortname: smithi088
2023-10-20T15:35:19.463 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-20T15:35:19.489 DEBUG:teuthology.nuke:shortname: smithi169
2023-10-20T15:35:19.490 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-20T15:35:19.493 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427635', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-20 14:11:48.003968', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-10-20T15:35:19.514 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427635', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-20 14:11:48.002482', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-10-20T15:35:19.544 INFO:teuthology.orchestra.console.smithi088:Power off
2023-10-20T15:35:19.545 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-20T15:35:19.566 INFO:teuthology.orchestra.console.smithi169:Power off
2023-10-20T15:35:19.567 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-20T15:35:19.575 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2023-10-20T15:35:19.576 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-20T15:35:19.588 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off
2023-10-20T15:35:19.588 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-20T15:35:19.595 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2023-10-20T15:35:19.608 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-10-20T15:35:19.696 INFO:teuthology.orchestra.console.smithi088:Power off completed
2023-10-20T15:35:19.709 INFO:teuthology.orchestra.console.smithi169:Power off completed
2023-10-20T15:35:19.849 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com
2023-10-20T15:35:19.866 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com