2023-08-10T20:24:56.564 INFO:root:teuthology version: 0.0.1.dev181+g7fda959
2023-08-10T20:24:56.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T20:24:56.702 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fcd543577f0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fcd53c38f70>, signals=[15])
2023-08-10T20:24:56.704 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging
2023-08-10T20:24:56.704 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server
2023-08-10T20:24:56.704 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2023-08-10T20:24:56.726 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging
2023-08-10T20:24:56.726 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server
2023-08-10T20:24:56.726 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2023-08-10T20:24:56.728 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /host {"name": "smithi088"}
2023-08-10T20:24:56.750 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /host {"name": "smithi187"}
2023-08-10T20:24:56.805 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-10T20:24:56.819 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-10T20:24:56.852 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-10T20:24:56.852 DEBUG:teuthology.provision.fog.smithi088:FOG request: PUT /host/193 {"imageID": 7}
2023-08-10T20:24:56.863 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-10T20:24:56.863 DEBUG:teuthology.provision.fog.smithi187:FOG request: PUT /host/292 {"imageID": 7}
2023-08-10T20:24:56.903 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of rhel 8.4
2023-08-10T20:24:56.903 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-08-10T20:24:56.906 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of rhel 8.4
2023-08-10T20:24:56.906 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-10T20:24:56.961 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /tasktype {"name": "deploy"}
2023-08-10T20:24:56.965 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /tasktype {"name": "deploy"}
2023-08-10T20:24:56.999 DEBUG:teuthology.provision.fog.smithi088:FOG request: POST /host/193/task {"taskTypeID": 1}
2023-08-10T20:24:57.003 DEBUG:teuthology.provision.fog.smithi187:FOG request: POST /host/292/task {"taskTypeID": 1}
2023-08-10T20:24:57.054 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-08-10T20:24:57.065 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-10T20:24:57.150 INFO:teuthology.orchestra.console.smithi088:Power off
2023-08-10T20:24:57.151 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-10T20:24:57.165 INFO:teuthology.orchestra.console.smithi187:Power off
2023-08-10T20:24:57.166 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-10T20:24:57.174 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2023-08-10T20:24:57.175 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T20:24:57.185 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off
2023-08-10T20:24:57.186 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T20:24:57.205 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2023-08-10T20:24:57.210 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2023-08-10T20:25:01.210 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T20:25:01.218 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T20:25:01.320 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2023-08-10T20:25:01.329 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2023-08-10T20:25:05.324 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T20:25:05.332 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T20:25:05.434 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2023-08-10T20:25:05.443 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2023-08-10T20:25:05.544 INFO:teuthology.orchestra.console.smithi187:Power off completed
2023-08-10T20:25:05.644 INFO:teuthology.orchestra.console.smithi187:Power on
2023-08-10T20:25:05.645 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-10T20:25:05.664 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On
2023-08-10T20:25:05.665 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T20:25:05.685 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2023-08-10T20:25:09.436 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T20:25:09.545 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2023-08-10T20:25:09.646 INFO:teuthology.orchestra.console.smithi088:Power off completed
2023-08-10T20:25:09.686 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T20:25:09.749 INFO:teuthology.orchestra.console.smithi088:Power on
2023-08-10T20:25:09.749 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-10T20:25:09.772 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On
2023-08-10T20:25:09.773 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T20:25:09.794 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2023-08-10T20:25:09.796 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2023-08-10T20:25:13.796 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T20:25:13.805 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T20:25:13.907 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2023-08-10T20:25:13.916 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on
2023-08-10T20:25:14.009 INFO:teuthology.orchestra.console.smithi088:Power on completed
2023-08-10T20:25:14.017 INFO:teuthology.orchestra.console.smithi187:Power on completed
2023-08-10T20:25:14.110 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish
2023-08-10T20:25:14.110 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-08-10T20:25:14.118 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish
2023-08-10T20:25:14.118 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-10T20:25:29.191 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-08-10T20:25:29.192 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-10T20:25:44.273 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-10T20:25:44.275 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-08-10T20:25:59.340 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-08-10T20:25:59.342 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-10T20:26:14.424 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-10T20:26:14.425 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-08-10T20:26:29.508 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-10T20:26:29.510 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-08-10T20:26:44.588 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-10T20:26:44.589 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-08-10T20:26:59.668 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-08-10T20:26:59.670 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-10T20:27:14.744 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-08-10T20:27:14.746 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-10T20:27:29.825 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-10T20:27:29.827 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-08-10T20:27:44.904 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-10T20:27:44.905 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-08-10T20:27:59.980 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-08-10T20:27:59.981 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None
2023-08-10T20:28:00.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:28:03.124 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-08-10T20:28:09.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:28:12.208 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-08-10T20:28:15.056 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-08-10T20:28:15.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:28:18.193 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-08-10T20:28:18.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:28:21.268 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-08-10T20:28:24.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:28:27.248 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-08-10T20:28:27.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:28:30.352 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-08-10T20:28:33.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:28:36.304 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-08-10T20:28:36.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:28:39.412 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-08-10T20:28:42.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:28:45.360 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-08-10T20:28:45.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:28:48.464 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-08-10T20:28:51.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:28:54.420 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-08-10T20:28:54.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:29:00.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:29:03.504 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-08-10T20:29:09.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:29:12.564 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-08-10T20:29:12.944 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-08-10T20:29:18.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:29:18.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:29:22.000 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-08-10T20:29:28.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:29:31.088 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187
2023-08-10T20:29:37.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:29:37.504 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-10T20:29:37.505 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-10T20:29:57.989 INFO:teuthology.provision.fog.smithi187:Node is ready
2023-08-10T20:29:57.990 DEBUG:teuthology.orchestra.run.smithi187:> hostname
2023-08-10T20:29:58.005 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187
2023-08-10T20:29:58.006 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187 /etc/hosts
2023-08-10T20:29:58.060 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187
2023-08-10T20:29:58.060 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187
2023-08-10T20:29:58.177 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187/smithi187/g' /etc/hosts
2023-08-10T20:29:58.201 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts
2023-08-10T20:29:58.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187/smithi187/g' /etc/hostname
2023-08-10T20:29:58.331 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187
2023-08-10T20:29:58.394 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release
2023-08-10T20:29:58.448 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux"
2023-08-10T20:29:58.449 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.4 (Ootpa)"
2023-08-10T20:29:58.449 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel"
2023-08-10T20:29:58.449 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora"
2023-08-10T20:29:58.449 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.4"
2023-08-10T20:29:58.449 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8"
2023-08-10T20:29:58.450 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-10T20:29:58.450 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31"
2023-08-10T20:29:58.450 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-10T20:29:58.450 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/"
2023-08-10T20:29:58.450 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-10T20:29:58.451 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-10T20:29:58.451 INFO:teuthology.orchestra.run.smithi187.stdout:
2023-08-10T20:29:58.451 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-10T20:29:58.451 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-10T20:29:58.451 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-10T20:29:58.451 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-10T20:29:58.452 INFO:teuthology.provision.fog.smithi187:Deploy complete!
2023-08-10T20:29:58.453 DEBUG:teuthology.parallel:result is None
2023-08-10T20:30:18.571 WARNING:teuthology.provision.fog.smithi088:timed out
2023-08-10T20:30:24.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:30:24.826 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-10T20:30:24.826 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-10T20:30:25.061 INFO:teuthology.provision.fog.smithi088:Node is ready
2023-08-10T20:30:25.062 DEBUG:teuthology.orchestra.run.smithi088:> hostname
2023-08-10T20:30:25.119 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088
2023-08-10T20:30:25.119 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088 /etc/hosts
2023-08-10T20:30:25.177 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088
2023-08-10T20:30:25.177 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2023-08-10T20:30:25.289 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088/smithi088/g' /etc/hosts
2023-08-10T20:30:25.314 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts
2023-08-10T20:30:25.381 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088/smithi088/g' /etc/hostname
2023-08-10T20:30:25.448 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2023-08-10T20:30:25.515 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2023-08-10T20:30:25.573 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux"
2023-08-10T20:30:25.573 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.4 (Ootpa)"
2023-08-10T20:30:25.573 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel"
2023-08-10T20:30:25.574 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora"
2023-08-10T20:30:25.574 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.4"
2023-08-10T20:30:25.574 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8"
2023-08-10T20:30:25.574 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-10T20:30:25.575 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2023-08-10T20:30:25.575 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-10T20:30:25.575 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/"
2023-08-10T20:30:25.575 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-10T20:30:25.575 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-10T20:30:25.576 INFO:teuthology.orchestra.run.smithi088.stdout:
2023-08-10T20:30:25.576 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-10T20:30:25.576 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-10T20:30:25.576 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-10T20:30:25.576 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-10T20:30:25.577 INFO:teuthology.provision.fog.smithi088:Deploy complete!
2023-08-10T20:30:25.578 DEBUG:teuthology.parallel:result is None
2023-08-10T20:30:25.721 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com
2023-08-10T20:30:25.722 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-10T20:30:25.753 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com
2023-08-10T20:30:25.754 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-10T20:30:25.781 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server
2023-08-10T20:30:25.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com'
2023-08-10T20:30:25.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:30:25.854 DEBUG:teuthology.orchestra.run.smithi088:> true
2023-08-10T20:30:25.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com'
2023-08-10T20:30:25.918 DEBUG:teuthology.orchestra.run.smithi088:> uname -m
2023-08-10T20:30:25.977 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64
2023-08-10T20:30:25.978 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2023-08-10T20:30:26.035 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux"
2023-08-10T20:30:26.035 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.4 (Ootpa)"
2023-08-10T20:30:26.035 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel"
2023-08-10T20:30:26.036 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora"
2023-08-10T20:30:26.036 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.4"
2023-08-10T20:30:26.036 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8"
2023-08-10T20:30:26.036 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-10T20:30:26.036 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2023-08-10T20:30:26.036 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-10T20:30:26.036 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/"
2023-08-10T20:30:26.037 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-10T20:30:26.037 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-10T20:30:26.037 INFO:teuthology.orchestra.run.smithi088.stdout:
2023-08-10T20:30:26.037 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-10T20:30:26.037 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-10T20:30:26.037 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-10T20:30:26.037 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-10T20:30:26.038 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2023-08-10T20:30:26.064 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server
2023-08-10T20:30:26.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com'
2023-08-10T20:30:26.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T20:30:26.133 DEBUG:teuthology.orchestra.run.smithi187:> true
2023-08-10T20:30:26.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com'
2023-08-10T20:30:26.202 DEBUG:teuthology.orchestra.run.smithi187:> uname -m
2023-08-10T20:30:26.261 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64
2023-08-10T20:30:26.261 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release
2023-08-10T20:30:26.317 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux"
2023-08-10T20:30:26.317 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.4 (Ootpa)"
2023-08-10T20:30:26.317 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel"
2023-08-10T20:30:26.317 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora"
2023-08-10T20:30:26.318 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.4"
2023-08-10T20:30:26.318 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8"
2023-08-10T20:30:26.318 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-10T20:30:26.318 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31"
2023-08-10T20:30:26.318 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-10T20:30:26.318 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/"
2023-08-10T20:30:26.318 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-10T20:30:26.319 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-10T20:30:26.319 INFO:teuthology.orchestra.run.smithi187.stdout:
2023-08-10T20:30:26.319 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-10T20:30:26.319 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-10T20:30:26.319 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-10T20:30:26.319 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-10T20:30:26.320 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server
2023-08-10T20:30:26.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T20:30:26.440 INFO:teuthology.dispatcher.supervisor:Running job 7364982
2023-08-10T20:30:26.441 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-10_19:34:43-fs-wip-yuri6-testing-2023-08-03-0807-pacific-distro-default-smithi/7364982 --name yuriw-2023-08-10_19:34:43-fs-wip-yuri6-testing-2023-08-03-0807-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/yuriw-2023-08-10_19:34:43-fs-wip-yuri6-testing-2023-08-03-0807-pacific-distro-default-smithi/7364982/orig.config.yaml
2023-08-10T20:30:26.445 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-10_19:34:43-fs-wip-yuri6-testing-2023-08-03-0807-pacific-distro-default-smithi/7364982
2023-08-10T20:30:26.446 INFO:teuthology.dispatcher.supervisor:Job PID: 10169
2023-08-10T20:30:26.446 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-10T20:32:26.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T20:34:26.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T20:36:26.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T20:38:27.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T20:40:27.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T20:42:27.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T20:44:27.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T20:46:27.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T20:48:27.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T20:50:28.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T20:52:28.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T20:54:28.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T20:56:28.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T20:58:28.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:00:28.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:02:29.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:04:29.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:06:29.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:08:29.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:10:29.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:12:29.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:14:30.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:16:30.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:18:30.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:20:30.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:22:30.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:24:30.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:26:31.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:28:31.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T21:28:31.353 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-10T21:28:31.538 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-10T21:28:31.538 INFO:teuthology.nuke:Checking targets against current locks
2023-08-10T21:28:31.582 DEBUG:teuthology.nuke:shortname: smithi088
2023-08-10T21:28:31.583 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-10T21:28:31.604 DEBUG:teuthology.nuke:shortname: smithi187
2023-08-10T21:28:31.605 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-10T21:28:31.607 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-10_19:34:43-fs-wip-yuri6-testing-2023-08-03-0807-pacific-distro-default-smithi/7364982', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 20:24:55.772749', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqYC+J8dbtpM54jGk/m6tCR8Yz/+CjU0jTEpboWwYGASoWRnnoItlwSIifqQ6TiwANgDO7kqh96l1B25IVK4sLt88RXsiTATVrqVkBmlehrbYvEgowKTTs4/gd63K7KMqywFEy4+qcJL+Xo1nXq2MeP3BwA5BeQjM/JX+Mv+lIHQFu2V2hqOVKDNu5XpYGvPR5vz86DY1S2mZTZFXsw9jpmrSwN76B7AF5kfdhnSHZMl2hf5J154rhFn7dDH0HKRLzrnZROtMecDcL6YG5P5B+lHa4zxMYL4nrft2Lio2YxXNWEn9m2LGHN1bXtaViSy836VCn8FL9J0dsTsozoWRLOW6n3ZwpYtcTt6YypNyHY+fAVBjqmqhY5P702tyq/uLW6VZ6tlDcS2aiXHSEi6p+npNrYDi7nkDZP0rvpirHCEhdnyyiZ+xQXWSd7tJOCsAdbPo6qA4ha4AibQFvP4hq+DxS8P18SYAN1bpjiZ3uKH289X87wNFGhzJYkTS3sAE='}
2023-08-10T21:28:31.627 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-10_19:34:43-fs-wip-yuri6-testing-2023-08-03-0807-pacific-distro-default-smithi/7364982', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 20:24:55.774204', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/bAHCxVd415AjaRqJG5m8jiCOQpPw6MxPfHonlfTprL+Dbmf4ysBTbkDxHefp/Epl84xW+NRJJO4PBhtFLqMzMsDGTx9V+nScAQ2RlrzQHBiFC8HAONgHDdg4FWGiHmvsh53OMiDXDix8Qo60DjM8uqoI4KbGxj9+Oh0ClUuB6ljaZP5a1M61vOFhu/b/ULr8tiRJtz/3w/PaO39FYHbLrzeIagW97lI9fmOGmla32mm1RmoEzlKy2o2grA5pyuvxK/u9UNeGNfiU41PXKgA5XCUMszXl4BoT8KAVeuXTguZX91PH2q4TQubxkSh1G8LCFag5yWQ16+urJrbvNY5zrlpDg+f4/QKwdJYkhfF0X8yyhWhHSETh8hfPHgbyBeqxPYXX0x8YQPwlbiGlXBcmwvsbh9UoFTnIQKPS0GA6KylWCVErvakKkl/jSycOlnF2h8jMMS86Dnq6M8Sp1xVk/zYHcXCYnUpnGVOyhhrsFBW8Hr7uDlsndCuABJvKK5E='}
2023-08-10T21:28:31.661 INFO:teuthology.orchestra.console.smithi088:Power off
2023-08-10T21:28:31.662 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-10T21:28:31.682 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2023-08-10T21:28:31.683 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T21:28:31.699 INFO:teuthology.orchestra.console.smithi187:Power off
2023-08-10T21:28:31.700 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-10T21:28:31.711 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2023-08-10T21:28:31.723 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off
2023-08-10T21:28:31.723 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T21:28:31.744 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off
2023-08-10T21:28:31.813 INFO:teuthology.orchestra.console.smithi088:Power off completed
2023-08-10T21:28:31.845 INFO:teuthology.orchestra.console.smithi187:Power off completed
2023-08-10T21:28:31.977 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com
2023-08-10T21:28:31.986 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com