2023-09-20T22:18:57.446 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-20T22:18:57.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:18:57.578 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff37452cca0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff375015670>, signals=[15])
2023-09-20T22:18:57.579 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging
2023-09-20T22:18:57.580 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server
2023-09-20T22:18:57.580 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2023-09-20T22:18:57.605 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging
2023-09-20T22:18:57.605 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server
2023-09-20T22:18:57.606 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server
2023-09-20T22:18:57.607 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /host {"name": "smithi022"}
2023-09-20T22:18:57.630 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /host {"name": "smithi089"}
2023-09-20T22:18:57.688 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-09-20T22:18:57.692 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-09-20T22:18:57.745 DEBUG:teuthology.provision.fog.smithi089:Requesting image smithi_rhel_8.6 (ID 5)
2023-09-20T22:18:57.746 DEBUG:teuthology.provision.fog.smithi089:FOG request: PUT /host/194 {"imageID": 5}
2023-09-20T22:18:57.748 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_rhel_8.6 (ID 5)
2023-09-20T22:18:57.748 DEBUG:teuthology.provision.fog.smithi022:FOG request: PUT /host/128 {"imageID": 5}
2023-09-20T22:18:57.796 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of rhel 8.6
2023-09-20T22:18:57.796 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-09-20T22:18:57.797 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of rhel 8.6
2023-09-20T22:18:57.797 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-20T22:18:57.863 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /tasktype {"name": "deploy"}
2023-09-20T22:18:57.867 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /tasktype {"name": "deploy"}
2023-09-20T22:18:57.901 DEBUG:teuthology.provision.fog.smithi022:FOG request: POST /host/128/task {"taskTypeID": 1}
2023-09-20T22:18:57.905 DEBUG:teuthology.provision.fog.smithi089:FOG request: POST /host/194/task {"taskTypeID": 1}
2023-09-20T22:18:57.956 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-20T22:18:57.967 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-09-20T22:18:58.051 INFO:teuthology.orchestra.console.smithi022:Power off
2023-09-20T22:18:58.052 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-20T22:18:58.064 INFO:teuthology.orchestra.console.smithi089:Power off
2023-09-20T22:18:58.065 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-20T22:18:58.075 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off
2023-09-20T22:18:58.076 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-20T22:18:58.084 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off
2023-09-20T22:18:58.084 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-20T22:18:58.097 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2023-09-20T22:18:58.104 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off
2023-09-20T22:18:58.198 INFO:teuthology.orchestra.console.smithi022:Power off completed
2023-09-20T22:18:58.205 INFO:teuthology.orchestra.console.smithi089:Power off completed
2023-09-20T22:18:58.301 INFO:teuthology.orchestra.console.smithi022:Power on
2023-09-20T22:18:58.301 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-20T22:18:58.308 INFO:teuthology.orchestra.console.smithi089:Power on
2023-09-20T22:18:58.309 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-20T22:18:58.323 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On
2023-09-20T22:18:58.324 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-20T22:18:58.331 DEBUG:teuthology.orchestra.console.smithi089:power on output: Chassis Power Control: Up/On
2023-09-20T22:18:58.332 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-20T22:18:58.345 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2023-09-20T22:18:58.352 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off
2023-09-20T22:19:02.351 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-20T22:19:02.358 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-20T22:19:02.460 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2023-09-20T22:19:02.466 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off
2023-09-20T22:19:06.466 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-20T22:19:06.472 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-20T22:19:06.574 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on
2023-09-20T22:19:06.589 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on
2023-09-20T22:19:06.676 INFO:teuthology.orchestra.console.smithi022:Power on completed
2023-09-20T22:19:06.690 INFO:teuthology.orchestra.console.smithi089:Power on completed
2023-09-20T22:19:06.777 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish
2023-09-20T22:19:06.777 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-20T22:19:06.791 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish
2023-09-20T22:19:06.792 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-09-20T22:19:21.855 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-20T22:19:21.856 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-09-20T22:19:36.918 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-20T22:19:36.919 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-09-20T22:19:51.999 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-09-20T22:19:52.000 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-20T22:20:07.078 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-20T22:20:07.079 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-09-20T22:20:22.162 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-09-20T22:20:22.164 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-20T22:20:37.239 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-09-20T22:20:37.240 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-20T22:20:52.314 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-09-20T22:20:52.317 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-20T22:21:07.406 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-09-20T22:21:07.407 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-20T22:21:22.494 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-09-20T22:21:22.496 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-20T22:21:37.591 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-20T22:21:37.596 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-09-20T22:21:37.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-20T22:21:52.678 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None
2023-09-20T22:21:52.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-20T22:21:55.998 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2023-09-20T22:22:02.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-20T22:22:05.082 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2023-09-20T22:22:11.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-20T22:22:11.098 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89
2023-09-20T22:22:14.142 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2023-09-20T22:22:17.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-20T22:22:20.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-20T22:22:20.154 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89
2023-09-20T22:22:23.226 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2023-09-20T22:22:26.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-20T22:22:29.210 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89
2023-09-20T22:22:29.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-20T22:22:35.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-20T22:22:38.266 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89
2023-09-20T22:22:44.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-20T22:22:47.322 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89
2023-09-20T22:22:53.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-20T22:23:29.266 WARNING:teuthology.provision.fog.smithi022:timed out
2023-09-20T22:23:35.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-20T22:23:35.498 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-20T22:23:35.499 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-20T22:23:35.839 INFO:teuthology.provision.fog.smithi022:Node is ready
2023-09-20T22:23:35.840 DEBUG:teuthology.orchestra.run.smithi022:> hostname
2023-09-20T22:23:35.863 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com
2023-09-20T22:23:35.864 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts
2023-09-20T22:23:35.931 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-09-20T22:23:35.931 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022
2023-09-20T22:23:36.061 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts
2023-09-20T22:23:36.095 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts
2023-09-20T22:23:36.170 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname
2023-09-20T22:23:36.246 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022
2023-09-20T22:23:36.317 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release
2023-09-20T22:23:36.375 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux"
2023-09-20T22:23:36.375 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.6 (Ootpa)"
2023-09-20T22:23:36.375 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel"
2023-09-20T22:23:36.375 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora"
2023-09-20T22:23:36.376 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.6"
2023-09-20T22:23:36.376 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8"
2023-09-20T22:23:36.376 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-09-20T22:23:36.376 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31"
2023-09-20T22:23:36.376 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-09-20T22:23:36.377 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/"
2023-09-20T22:23:36.377 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-20T22:23:36.377 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-20T22:23:36.377 INFO:teuthology.orchestra.run.smithi022.stdout:
2023-09-20T22:23:36.377 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-20T22:23:36.378 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-09-20T22:23:36.378 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-20T22:23:36.378 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-09-20T22:23:36.379 INFO:teuthology.provision.fog.smithi022:Deploy complete!
2023-09-20T22:23:36.380 DEBUG:teuthology.parallel:result is None
2023-09-20T22:23:53.342 WARNING:teuthology.provision.fog.smithi089:timed out
2023-09-20T22:23:59.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-20T22:23:59.755 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-20T22:23:59.755 DEBUG:teuthology.orchestra.run.smithi089:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-20T22:24:00.050 INFO:teuthology.provision.fog.smithi089:Node is ready
2023-09-20T22:24:00.051 DEBUG:teuthology.orchestra.run.smithi089:> hostname
2023-09-20T22:24:00.070 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com
2023-09-20T22:24:00.070 DEBUG:teuthology.orchestra.run.smithi089:> grep smithi089.front.sepia.ceph.com /etc/hosts
2023-09-20T22:24:00.129 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089
2023-09-20T22:24:00.130 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089
2023-09-20T22:24:00.272 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hosts
2023-09-20T22:24:00.301 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/172.21.15.89/172.21.15.89/g' /etc/hosts
2023-09-20T22:24:00.369 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hostname
2023-09-20T22:24:00.436 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089
2023-09-20T22:24:00.504 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release
2023-09-20T22:24:00.561 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Red Hat Enterprise Linux"
2023-09-20T22:24:00.562 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8.6 (Ootpa)"
2023-09-20T22:24:00.562 INFO:teuthology.orchestra.run.smithi089.stdout:ID="rhel"
2023-09-20T22:24:00.562 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="fedora"
2023-09-20T22:24:00.563 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8.6"
2023-09-20T22:24:00.563 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8"
2023-09-20T22:24:00.563 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-09-20T22:24:00.564 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31"
2023-09-20T22:24:00.564 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-09-20T22:24:00.565 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.redhat.com/"
2023-09-20T22:24:00.565 INFO:teuthology.orchestra.run.smithi089.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-20T22:24:00.565 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-20T22:24:00.566 INFO:teuthology.orchestra.run.smithi089.stdout:
2023-09-20T22:24:00.566 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-20T22:24:00.566 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-09-20T22:24:00.567 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-20T22:24:00.567 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-09-20T22:24:00.568 INFO:teuthology.provision.fog.smithi089:Deploy complete!
2023-09-20T22:24:00.569 DEBUG:teuthology.parallel:result is None
2023-09-20T22:24:00.755 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com
2023-09-20T22:24:00.756 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com
2023-09-20T22:24:00.759 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server
2023-09-20T22:24:00.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com'
2023-09-20T22:24:00.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-20T22:24:00.829 DEBUG:teuthology.orchestra.run.smithi022:> true
2023-09-20T22:24:00.964 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com'
2023-09-20T22:24:00.965 DEBUG:teuthology.orchestra.run.smithi022:> uname -m
2023-09-20T22:24:01.023 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64
2023-09-20T22:24:01.024 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release
2023-09-20T22:24:01.085 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux"
2023-09-20T22:24:01.085 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.6 (Ootpa)"
2023-09-20T22:24:01.085 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel"
2023-09-20T22:24:01.086 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora"
2023-09-20T22:24:01.086 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.6"
2023-09-20T22:24:01.086 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8"
2023-09-20T22:24:01.086 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-09-20T22:24:01.087 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31"
2023-09-20T22:24:01.087 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-09-20T22:24:01.087 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/"
2023-09-20T22:24:01.087 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-20T22:24:01.087 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-20T22:24:01.088 INFO:teuthology.orchestra.run.smithi022.stdout:
2023-09-20T22:24:01.088 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-20T22:24:01.088 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-09-20T22:24:01.088 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-20T22:24:01.088 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-09-20T22:24:01.089 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2023-09-20T22:24:01.110 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server
2023-09-20T22:24:01.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com'
2023-09-20T22:24:01.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-20T22:24:01.177 DEBUG:teuthology.orchestra.run.smithi089:> true
2023-09-20T22:24:01.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com'
2023-09-20T22:24:01.247 DEBUG:teuthology.orchestra.run.smithi089:> uname -m
2023-09-20T22:24:01.306 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64
2023-09-20T22:24:01.307 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release
2023-09-20T22:24:01.364 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Red Hat Enterprise Linux"
2023-09-20T22:24:01.364 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8.6 (Ootpa)"
2023-09-20T22:24:01.365 INFO:teuthology.orchestra.run.smithi089.stdout:ID="rhel"
2023-09-20T22:24:01.365 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="fedora"
2023-09-20T22:24:01.365 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8.6"
2023-09-20T22:24:01.365 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8"
2023-09-20T22:24:01.365 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-09-20T22:24:01.366 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31"
2023-09-20T22:24:01.366 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-09-20T22:24:01.366 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.redhat.com/"
2023-09-20T22:24:01.366 INFO:teuthology.orchestra.run.smithi089.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-20T22:24:01.366 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-20T22:24:01.367 INFO:teuthology.orchestra.run.smithi089.stdout:
2023-09-20T22:24:01.367 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-20T22:24:01.367 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-09-20T22:24:01.367 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-20T22:24:01.368 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-09-20T22:24:01.368 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server
2023-09-20T22:24:01.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:24:01.798 INFO:teuthology.dispatcher.supervisor:Running job 7399214
2023-09-20T22:24:01.798 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399214 --name vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} -- /home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399214/orig.config.yaml
2023-09-20T22:24:01.801 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399214
2023-09-20T22:24:01.802 INFO:teuthology.dispatcher.supervisor:Job PID: 304270
2023-09-20T22:24:01.803 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-20T22:26:01.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:28:02.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:30:02.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:32:02.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:34:02.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:36:02.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:38:02.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:40:03.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:42:03.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:44:03.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:46:03.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:48:03.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:50:03.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:52:04.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:54:04.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:56:04.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-20T22:56:04.471 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-09-20T22:56:04.582 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-20T22:56:04.582 INFO:teuthology.nuke:Checking targets against current locks
2023-09-20T22:56:04.631 DEBUG:teuthology.nuke:shortname: smithi022
2023-09-20T22:56:04.631 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-20T22:56:04.653 DEBUG:teuthology.nuke:shortname: smithi089
2023-09-20T22:56:04.653 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-20T22:56:04.657 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399214', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-20 22:18:56.663390', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-09-20T22:56:04.681 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-20_10:42:39-fs-wip-vshankar-testing-20230920.072635-testing-default-smithi/7399214', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-20 22:18:56.664894', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-09-20T22:56:04.704 INFO:teuthology.orchestra.console.smithi022:Power off
2023-09-20T22:56:04.704 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-20T22:56:04.727 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off
2023-09-20T22:56:04.727 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-20T22:56:04.741 INFO:teuthology.orchestra.console.smithi089:Power off
2023-09-20T22:56:04.742 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-20T22:56:04.750 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2023-09-20T22:56:04.762 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off
2023-09-20T22:56:04.762 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-20T22:56:04.782 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off
2023-09-20T22:56:04.851 INFO:teuthology.orchestra.console.smithi022:Power off completed
2023-09-20T22:56:04.883 INFO:teuthology.orchestra.console.smithi089:Power off completed
2023-09-20T22:56:05.004 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com
2023-09-20T22:56:05.037 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com