2023-10-06T11:05:31.047 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-06T11:05:31.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:05:31.184 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f63f2e5fb50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f63f3949670>, signals=[15])
2023-10-06T11:05:31.184 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging
2023-10-06T11:05:31.184 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server
2023-10-06T11:05:31.184 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-10-06T11:05:31.201 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging
2023-10-06T11:05:31.201 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server
2023-10-06T11:05:31.201 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server
2023-10-06T11:05:31.202 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /host {"name": "smithi081"}
2023-10-06T11:05:31.225 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /host {"name": "smithi184"}
2023-10-06T11:05:31.274 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-10-06T11:05:31.301 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-10-06T11:05:31.312 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_rhel_8.4 (ID 7)
2023-10-06T11:05:31.312 DEBUG:teuthology.provision.fog.smithi081:FOG request: PUT /host/186 {"imageID": 7}
2023-10-06T11:05:31.356 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_rhel_8.4 (ID 7)
2023-10-06T11:05:31.356 DEBUG:teuthology.provision.fog.smithi184:FOG request: PUT /host/289 {"imageID": 7}
2023-10-06T11:05:31.375 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of rhel 8.4
2023-10-06T11:05:31.375 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-10-06T11:05:31.408 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of rhel 8.4
2023-10-06T11:05:31.408 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-10-06T11:05:31.450 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /tasktype {"name": "deploy"}
2023-10-06T11:05:31.478 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /tasktype {"name": "deploy"}
2023-10-06T11:05:31.489 DEBUG:teuthology.provision.fog.smithi081:FOG request: POST /host/186/task {"taskTypeID": 1}
2023-10-06T11:05:31.518 DEBUG:teuthology.provision.fog.smithi184:FOG request: POST /host/289/task {"taskTypeID": 1}
2023-10-06T11:05:31.541 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-10-06T11:05:31.571 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-10-06T11:05:31.670 INFO:teuthology.orchestra.console.smithi081:Power off
2023-10-06T11:05:31.670 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-06T11:05:31.684 INFO:teuthology.orchestra.console.smithi184:Power off
2023-10-06T11:05:31.684 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-06T11:05:31.692 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-10-06T11:05:31.693 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T11:05:31.704 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off
2023-10-06T11:05:31.704 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T11:05:31.712 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-10-06T11:05:31.724 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off
2023-10-06T11:05:31.813 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-10-06T11:05:31.825 INFO:teuthology.orchestra.console.smithi184:Power off completed
2023-10-06T11:05:31.914 INFO:teuthology.orchestra.console.smithi081:Power on
2023-10-06T11:05:31.915 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-06T11:05:31.925 INFO:teuthology.orchestra.console.smithi184:Power on
2023-10-06T11:05:31.926 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-06T11:05:31.940 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On
2023-10-06T11:05:31.940 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T11:05:31.948 DEBUG:teuthology.orchestra.console.smithi184:power on output: Chassis Power Control: Up/On
2023-10-06T11:05:31.949 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T11:05:31.964 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-10-06T11:05:31.970 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off
2023-10-06T11:05:35.966 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T11:05:35.977 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T11:05:36.079 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-10-06T11:05:36.086 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on
2023-10-06T11:05:36.186 INFO:teuthology.orchestra.console.smithi184:Power on completed
2023-10-06T11:05:36.287 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish
2023-10-06T11:05:36.287 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-10-06T11:05:40.082 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T11:05:40.193 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-10-06T11:05:40.294 INFO:teuthology.orchestra.console.smithi081:Power on completed
2023-10-06T11:05:40.394 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2023-10-06T11:05:40.395 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-10-06T11:05:51.390 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-10-06T11:05:55.478 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-10-06T11:06:06.474 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-10-06T11:06:10.570 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-10-06T11:06:21.558 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-10-06T11:06:25.666 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-10-06T11:06:36.639 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-10-06T11:06:40.750 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-10-06T11:06:51.730 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-10-06T11:06:55.822 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-10-06T11:07:06.802 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-10-06T11:07:10.894 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-10-06T11:07:21.902 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-10-06T11:07:25.970 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-10-06T11:07:36.990 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-10-06T11:07:41.056 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-10-06T11:07:52.062 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-10-06T11:07:56.136 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-10-06T11:08:07.146 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-10-06T11:08:11.226 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-10-06T11:08:22.218 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None
2023-10-06T11:08:22.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T11:08:26.290 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-10-06T11:08:26.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T11:08:40.698 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2023-10-06T11:08:44.794 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-10-06T11:08:46.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T11:08:49.758 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2023-10-06T11:08:50.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T11:08:53.850 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-10-06T11:08:55.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T11:08:58.842 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2023-10-06T11:08:59.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T11:09:02.906 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-10-06T11:09:04.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T11:09:07.902 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184
2023-10-06T11:09:08.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T11:09:11.962 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-10-06T11:09:13.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T11:09:17.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T11:10:13.962 WARNING:teuthology.provision.fog.smithi184:timed out
2023-10-06T11:10:17.970 WARNING:teuthology.provision.fog.smithi081:timed out
2023-10-06T11:10:19.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T11:10:20.290 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-06T11:10:20.291 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-06T11:10:20.528 INFO:teuthology.provision.fog.smithi184:Node is ready
2023-10-06T11:10:20.528 DEBUG:teuthology.orchestra.run.smithi184:> hostname
2023-10-06T11:10:20.544 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184
2023-10-06T11:10:20.544 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184 /etc/hosts
2023-10-06T11:10:20.598 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184
2023-10-06T11:10:20.598 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184
2023-10-06T11:10:20.705 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184/smithi184/g' /etc/hosts
2023-10-06T11:10:20.731 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts
2023-10-06T11:10:20.794 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184/smithi184/g' /etc/hostname
2023-10-06T11:10:20.856 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184
2023-10-06T11:10:20.918 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release
2023-10-06T11:10:20.974 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux"
2023-10-06T11:10:20.974 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.4 (Ootpa)"
2023-10-06T11:10:20.974 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel"
2023-10-06T11:10:20.975 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora"
2023-10-06T11:10:20.975 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.4"
2023-10-06T11:10:20.975 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8"
2023-10-06T11:10:20.975 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-10-06T11:10:20.975 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31"
2023-10-06T11:10:20.975 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-10-06T11:10:20.975 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/"
2023-10-06T11:10:20.975 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-06T11:10:20.975 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-06T11:10:20.975 INFO:teuthology.orchestra.run.smithi184.stdout:
2023-10-06T11:10:20.975 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-06T11:10:20.975 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-10-06T11:10:20.976 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-06T11:10:20.976 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-10-06T11:10:20.976 INFO:teuthology.provision.fog.smithi184:Deploy complete!
2023-10-06T11:10:20.977 DEBUG:teuthology.parallel:result is None
2023-10-06T11:10:23.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T11:10:24.353 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-06T11:10:24.353 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-06T11:10:24.646 INFO:teuthology.provision.fog.smithi081:Node is ready
2023-10-06T11:10:24.646 DEBUG:teuthology.orchestra.run.smithi081:> hostname
2023-10-06T11:10:24.662 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081
2023-10-06T11:10:24.663 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081 /etc/hosts
2023-10-06T11:10:24.718 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081
2023-10-06T11:10:24.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-10-06T11:10:24.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081/smithi081/g' /etc/hosts
2023-10-06T11:10:24.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts
2023-10-06T11:10:24.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081/smithi081/g' /etc/hostname
2023-10-06T11:10:24.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-10-06T11:10:25.044 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-10-06T11:10:25.099 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux"
2023-10-06T11:10:25.099 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.4 (Ootpa)"
2023-10-06T11:10:25.099 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel"
2023-10-06T11:10:25.099 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora"
2023-10-06T11:10:25.100 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.4"
2023-10-06T11:10:25.100 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2023-10-06T11:10:25.100 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-10-06T11:10:25.100 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-10-06T11:10:25.100 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-10-06T11:10:25.101 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/"
2023-10-06T11:10:25.101 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-06T11:10:25.101 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-06T11:10:25.101 INFO:teuthology.orchestra.run.smithi081.stdout:
2023-10-06T11:10:25.101 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-06T11:10:25.101 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-10-06T11:10:25.102 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-06T11:10:25.102 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-10-06T11:10:25.102 INFO:teuthology.provision.fog.smithi081:Deploy complete!
2023-10-06T11:10:25.103 DEBUG:teuthology.parallel:result is None
2023-10-06T11:10:25.265 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com
2023-10-06T11:10:25.265 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-06T11:10:25.291 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com
2023-10-06T11:10:25.291 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-06T11:10:25.308 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server
2023-10-06T11:10:25.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-10-06T11:10:25.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T11:10:25.376 DEBUG:teuthology.orchestra.run.smithi081:> true
2023-10-06T11:10:25.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-10-06T11:10:25.399 DEBUG:teuthology.orchestra.run.smithi081:> uname -m
2023-10-06T11:10:25.453 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64
2023-10-06T11:10:25.453 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-10-06T11:10:25.506 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux"
2023-10-06T11:10:25.506 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.4 (Ootpa)"
2023-10-06T11:10:25.506 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel"
2023-10-06T11:10:25.507 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora"
2023-10-06T11:10:25.507 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.4"
2023-10-06T11:10:25.507 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2023-10-06T11:10:25.507 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-10-06T11:10:25.507 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-10-06T11:10:25.507 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-10-06T11:10:25.508 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/"
2023-10-06T11:10:25.508 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-06T11:10:25.508 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-06T11:10:25.508 INFO:teuthology.orchestra.run.smithi081.stdout:
2023-10-06T11:10:25.508 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-06T11:10:25.508 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-10-06T11:10:25.509 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-06T11:10:25.509 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-10-06T11:10:25.510 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-10-06T11:10:25.533 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server
2023-10-06T11:10:25.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com'
2023-10-06T11:10:25.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T11:10:25.599 DEBUG:teuthology.orchestra.run.smithi184:> true
2023-10-06T11:10:25.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com'
2023-10-06T11:10:25.666 DEBUG:teuthology.orchestra.run.smithi184:> uname -m
2023-10-06T11:10:25.722 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64
2023-10-06T11:10:25.722 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release
2023-10-06T11:10:25.777 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux"
2023-10-06T11:10:25.777 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.4 (Ootpa)"
2023-10-06T11:10:25.777 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel"
2023-10-06T11:10:25.778 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora"
2023-10-06T11:10:25.778 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.4"
2023-10-06T11:10:25.778 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8"
2023-10-06T11:10:25.778 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-10-06T11:10:25.778 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31"
2023-10-06T11:10:25.778 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-10-06T11:10:25.778 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/"
2023-10-06T11:10:25.778 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-06T11:10:25.778 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-06T11:10:25.778 INFO:teuthology.orchestra.run.smithi184.stdout:
2023-10-06T11:10:25.779 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-06T11:10:25.779 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-10-06T11:10:25.779 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-06T11:10:25.779 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-10-06T11:10:25.779 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server
2023-10-06T11:10:25.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:10:25.886 INFO:teuthology.dispatcher.supervisor:Running job 7412400
2023-10-06T11:10:25.886 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412400 --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412400/orig.config.yaml
2023-10-06T11:10:25.889 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412400
2023-10-06T11:10:25.889 INFO:teuthology.dispatcher.supervisor:Job PID: 1361361
2023-10-06T11:10:25.890 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-06T11:12:25.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:14:26.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:16:26.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:18:26.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:20:26.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:22:26.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:24:26.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:26:27.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:28:27.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:30:27.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:32:27.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:34:27.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:36:27.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:38:28.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:40:28.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:42:28.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:44:28.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:46:28.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:48:28.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:50:29.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:52:29.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:54:29.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:56:29.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T11:58:29.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T12:00:29.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T12:02:30.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T12:04:30.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T12:06:30.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T12:08:30.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T12:08:30.734 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-10-06T12:08:30.928 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-06T12:08:30.928 INFO:teuthology.nuke:Checking targets against current locks
2023-10-06T12:08:30.980 DEBUG:teuthology.nuke:shortname: smithi081
2023-10-06T12:08:30.980 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-06T12:08:31.004 DEBUG:teuthology.nuke:shortname: smithi184
2023-10-06T12:08:31.005 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-06T12:08:31.008 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412400', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 11:05:30.260158', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBwJFS+///XQ5LueCgvlOao6o84LGfEeP6RNEDdRcCxUCTdWogitDkdcnngRIensJZ1Wt679xJGF2jBfYzXNJ38='}
2023-10-06T12:08:31.030 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412400', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 11:05:30.258110', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLb+NPqZGpKm59TRFrm3I+2BwHlOnCvH7ajiqpV7ZM2SeM/CibMzEqYG0ko/JJ1fs+4zFME4J2LlQSqJL6pLFX4='}
2023-10-06T12:08:31.062 INFO:teuthology.orchestra.console.smithi081:Power off
2023-10-06T12:08:31.063 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-06T12:08:31.084 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-10-06T12:08:31.084 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T12:08:31.096 INFO:teuthology.orchestra.console.smithi184:Power off
2023-10-06T12:08:31.097 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-06T12:08:31.105 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-10-06T12:08:31.119 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off
2023-10-06T12:08:31.119 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T12:08:31.142 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off
2023-10-06T12:08:31.206 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-10-06T12:08:31.243 INFO:teuthology.orchestra.console.smithi184:Power off completed
2023-10-06T12:08:31.358 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com
2023-10-06T12:08:31.394 INFO:teuthology.lock.ops:unlocked: smithi184.front.sepia.ceph.com