2023-09-29T15:58:25.114 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-29T15:58:25.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T15:58:25.262 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5598c3cb20>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f559973d670>, signals=[15])
2023-09-29T15:58:25.262 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging
2023-09-29T15:58:25.262 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server
2023-09-29T15:58:25.262 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2023-09-29T15:58:25.288 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging
2023-09-29T15:58:25.288 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server
2023-09-29T15:58:25.288 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2023-09-29T15:58:25.290 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /host {"name": "smithi136"}
2023-09-29T15:58:25.313 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /host {"name": "smithi153"}
2023-09-29T15:58:25.363 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-09-29T15:58:25.386 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-09-29T15:58:25.404 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_rhel_8.4 (ID 7)
2023-09-29T15:58:25.404 DEBUG:teuthology.provision.fog.smithi136:FOG request: PUT /host/241 {"imageID": 7}
2023-09-29T15:58:25.428 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_rhel_8.4 (ID 7)
2023-09-29T15:58:25.428 DEBUG:teuthology.provision.fog.smithi153:FOG request: PUT /host/258 {"imageID": 7}
2023-09-29T15:58:25.451 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of rhel 8.4
2023-09-29T15:58:25.452 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-09-29T15:58:25.481 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of rhel 8.4
2023-09-29T15:58:25.481 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-09-29T15:58:25.512 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /tasktype {"name": "deploy"}
2023-09-29T15:58:25.536 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /tasktype {"name": "deploy"}
2023-09-29T15:58:25.551 DEBUG:teuthology.provision.fog.smithi136:FOG request: POST /host/241/task {"taskTypeID": 1}
2023-09-29T15:58:25.573 DEBUG:teuthology.provision.fog.smithi153:FOG request: POST /host/258/task {"taskTypeID": 1}
2023-09-29T15:58:25.608 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-09-29T15:58:25.631 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-09-29T15:58:25.709 INFO:teuthology.orchestra.console.smithi136:Power off
2023-09-29T15:58:25.710 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-29T15:58:25.723 INFO:teuthology.orchestra.console.smithi153:Power off
2023-09-29T15:58:25.723 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-29T15:58:25.733 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off
2023-09-29T15:58:25.733 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T15:58:25.749 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off
2023-09-29T15:58:25.749 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T15:58:25.758 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2023-09-29T15:58:25.774 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2023-09-29T15:58:29.763 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T15:58:29.775 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T15:58:29.872 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2023-09-29T15:58:29.884 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2023-09-29T15:58:33.874 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T15:58:33.885 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T15:58:33.984 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2023-09-29T15:58:33.994 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2023-09-29T15:58:34.085 INFO:teuthology.orchestra.console.smithi136:Power off completed
2023-09-29T15:58:34.096 INFO:teuthology.orchestra.console.smithi153:Power off completed
2023-09-29T15:58:34.186 INFO:teuthology.orchestra.console.smithi136:Power on
2023-09-29T15:58:34.186 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-29T15:58:34.196 INFO:teuthology.orchestra.console.smithi153:Power on
2023-09-29T15:58:34.197 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-29T15:58:34.206 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On
2023-09-29T15:58:34.207 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T15:58:34.217 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On
2023-09-29T15:58:34.218 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T15:58:34.227 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2023-09-29T15:58:34.238 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2023-09-29T15:58:38.230 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T15:58:38.239 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T15:58:38.340 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2023-09-29T15:58:38.348 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2023-09-29T15:58:42.342 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T15:58:42.350 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T15:58:42.453 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2023-09-29T15:58:42.459 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2023-09-29T15:58:42.554 INFO:teuthology.orchestra.console.smithi136:Power on completed
2023-09-29T15:58:42.559 INFO:teuthology.orchestra.console.smithi153:Power on completed
2023-09-29T15:58:42.655 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2023-09-29T15:58:42.655 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-09-29T15:58:42.660 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish
2023-09-29T15:58:42.660 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-09-29T15:58:57.741 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-09-29T15:58:57.820 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-09-29T15:59:12.906 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-09-29T15:59:12.908 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-09-29T15:59:27.990 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-09-29T15:59:28.036 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-09-29T15:59:43.114 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-09-29T15:59:43.116 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-09-29T15:59:58.198 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-09-29T15:59:58.200 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-09-29T16:00:13.286 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-09-29T16:00:13.288 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-09-29T16:00:28.372 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-09-29T16:00:28.374 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-09-29T16:00:43.454 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-09-29T16:00:43.456 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-09-29T16:00:58.538 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-09-29T16:00:59.324 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-09-29T16:01:14.410 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-09-29T16:01:14.412 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-09-29T16:01:14.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:01:17.562 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-09-29T16:01:23.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:01:26.810 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-09-29T16:01:29.486 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-09-29T16:01:29.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:01:32.666 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-09-29T16:01:32.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:01:35.866 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-09-29T16:01:38.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:01:41.722 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-09-29T16:01:41.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:01:44.923 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-09-29T16:01:47.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:01:50.778 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-09-29T16:01:51.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:01:54.110 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-09-29T16:01:56.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:01:59.834 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-09-29T16:02:00.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:02:03.194 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-09-29T16:02:05.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:02:08.894 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-09-29T16:02:09.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:02:12.254 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-09-29T16:02:14.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:02:17.978 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-09-29T16:02:18.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:02:23.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:02:27.038 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-09-29T16:02:28.603 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-09-29T16:02:33.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:02:34.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:02:36.126 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-09-29T16:02:37.662 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-09-29T16:02:42.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:02:43.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:02:46.714 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-09-29T16:02:52.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:02:55.661 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-29T16:02:55.661 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-29T16:03:15.934 INFO:teuthology.provision.fog.smithi136:Node is ready
2023-09-29T16:03:15.935 DEBUG:teuthology.orchestra.run.smithi136:> hostname
2023-09-29T16:03:15.994 INFO:teuthology.orchestra.run.smithi136.stdout:smithi036
2023-09-29T16:03:15.994 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi036 /etc/hosts
2023-09-29T16:03:16.050 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036
2023-09-29T16:03:16.051 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2023-09-29T16:03:16.260 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi036/smithi136/g' /etc/hosts
2023-09-29T16:03:16.286 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.36/172.21.15.136/g' /etc/hosts
2023-09-29T16:03:16.352 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi036/smithi136/g' /etc/hostname
2023-09-29T16:03:16.416 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2023-09-29T16:03:16.480 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2023-09-29T16:03:16.534 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux"
2023-09-29T16:03:16.534 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.4 (Ootpa)"
2023-09-29T16:03:16.535 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel"
2023-09-29T16:03:16.535 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora"
2023-09-29T16:03:16.535 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.4"
2023-09-29T16:03:16.535 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8"
2023-09-29T16:03:16.536 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-09-29T16:03:16.536 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2023-09-29T16:03:16.536 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-09-29T16:03:16.536 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/"
2023-09-29T16:03:16.537 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-29T16:03:16.537 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-29T16:03:16.537 INFO:teuthology.orchestra.run.smithi136.stdout:
2023-09-29T16:03:16.537 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-29T16:03:16.538 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-09-29T16:03:16.538 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-29T16:03:16.539 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-09-29T16:03:16.540 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2023-09-29T16:03:16.541 DEBUG:teuthology.parallel:result is None
2023-09-29T16:03:42.329 WARNING:teuthology.provision.fog.smithi153:timed out
2023-09-29T16:03:48.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:03:48.644 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-29T16:03:48.644 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-29T16:03:48.925 INFO:teuthology.provision.fog.smithi153:Node is ready
2023-09-29T16:03:48.926 DEBUG:teuthology.orchestra.run.smithi153:> hostname
2023-09-29T16:03:48.940 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com
2023-09-29T16:03:48.940 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts
2023-09-29T16:03:48.999 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153
2023-09-29T16:03:49.031 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2023-09-29T16:03:49.133 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts
2023-09-29T16:03:49.159 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts
2023-09-29T16:03:49.226 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname
2023-09-29T16:03:49.294 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2023-09-29T16:03:49.360 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2023-09-29T16:03:49.417 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux"
2023-09-29T16:03:49.417 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.4 (Ootpa)"
2023-09-29T16:03:49.417 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel"
2023-09-29T16:03:49.417 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora"
2023-09-29T16:03:49.417 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.4"
2023-09-29T16:03:49.417 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8"
2023-09-29T16:03:49.417 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-09-29T16:03:49.417 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2023-09-29T16:03:49.418 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-09-29T16:03:49.418 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/"
2023-09-29T16:03:49.418 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-29T16:03:49.418 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-29T16:03:49.418 INFO:teuthology.orchestra.run.smithi153.stdout:
2023-09-29T16:03:49.418 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-29T16:03:49.418 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-09-29T16:03:49.418 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-29T16:03:49.418 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-09-29T16:03:49.418 INFO:teuthology.provision.fog.smithi153:Deploy complete!
2023-09-29T16:03:49.419 DEBUG:teuthology.parallel:result is None
2023-09-29T16:03:49.584 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2023-09-29T16:03:49.584 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-29T16:03:49.603 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com
2023-09-29T16:03:49.603 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-29T16:03:49.620 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2023-09-29T16:03:49.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-09-29T16:03:49.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:03:49.690 DEBUG:teuthology.orchestra.run.smithi136:> true
2023-09-29T16:03:49.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-09-29T16:03:49.716 DEBUG:teuthology.orchestra.run.smithi136:> uname -m
2023-09-29T16:03:49.771 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2023-09-29T16:03:49.772 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2023-09-29T16:03:49.827 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux"
2023-09-29T16:03:49.828 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.4 (Ootpa)"
2023-09-29T16:03:49.828 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel"
2023-09-29T16:03:49.828 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora"
2023-09-29T16:03:49.828 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.4"
2023-09-29T16:03:49.828 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8"
2023-09-29T16:03:49.828 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-09-29T16:03:49.828 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2023-09-29T16:03:49.828 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-09-29T16:03:49.828 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/"
2023-09-29T16:03:49.828 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-29T16:03:49.828 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-29T16:03:49.828 INFO:teuthology.orchestra.run.smithi136.stdout:
2023-09-29T16:03:49.829 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-29T16:03:49.829 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-09-29T16:03:49.829 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-29T16:03:49.829 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-09-29T16:03:49.829 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2023-09-29T16:03:49.853 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server
2023-09-29T16:03:49.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2023-09-29T16:03:49.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:03:49.917 DEBUG:teuthology.orchestra.run.smithi153:> true
2023-09-29T16:03:49.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com'
2023-09-29T16:03:49.937 DEBUG:teuthology.orchestra.run.smithi153:> uname -m
2023-09-29T16:03:49.990 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64
2023-09-29T16:03:49.991 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2023-09-29T16:03:50.045 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux"
2023-09-29T16:03:50.045 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.4 (Ootpa)"
2023-09-29T16:03:50.045 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel"
2023-09-29T16:03:50.045 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora"
2023-09-29T16:03:50.045 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.4"
2023-09-29T16:03:50.045 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8"
2023-09-29T16:03:50.045 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-09-29T16:03:50.046 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2023-09-29T16:03:50.046 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-09-29T16:03:50.046 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/"
2023-09-29T16:03:50.046 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-29T16:03:50.046 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-29T16:03:50.046 INFO:teuthology.orchestra.run.smithi153.stdout:
2023-09-29T16:03:50.046 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-29T16:03:50.046 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-09-29T16:03:50.046 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-29T16:03:50.046 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-09-29T16:03:50.047 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2023-09-29T16:03:50.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:03:50.167 INFO:teuthology.dispatcher.supervisor:Running job 7405434
2023-09-29T16:03:50.167 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405434 --name yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/lockdep} -- /home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405434/orig.config.yaml
2023-09-29T16:03:50.169 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405434
2023-09-29T16:03:50.170 INFO:teuthology.dispatcher.supervisor:Job PID: 1306323
2023-09-29T16:03:50.170 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-29T16:05:50.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:07:50.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:09:50.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:11:51.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:13:51.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:15:51.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:17:51.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:19:51.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:21:52.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:23:52.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:25:52.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:27:52.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:27:52.577 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-09-29T16:27:52.686 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-29T16:27:52.687 INFO:teuthology.nuke:Checking targets against current locks
2023-09-29T16:27:52.739 DEBUG:teuthology.nuke:shortname: smithi136
2023-09-29T16:27:52.740 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-29T16:27:52.760 DEBUG:teuthology.nuke:shortname: smithi153
2023-09-29T16:27:52.760 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-29T16:27:52.763 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405434', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 15:58:24.198452', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDcSayQdwqDjn9GRANcE0Xe+fq8HUHcxhnZjopMxI1Da6hfQDaxz6xTLE5abH8TCa5ry3EMQOKwsUlRMJ4rpVEw='}
2023-09-29T16:27:52.788 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405434', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 15:58:24.196498', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG8mODTwnx3YcZf7LO5Lo5VNWCiJZyrubt2qhKaUxhI+YjwsG39FS2DfscTSfvQS7fz1uqILFxEaZcd4WAxg3Ak='}
2023-09-29T16:27:52.815 INFO:teuthology.orchestra.console.smithi136:Power off
2023-09-29T16:27:52.815 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-29T16:27:52.837 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off
2023-09-29T16:27:52.837 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:27:52.856 INFO:teuthology.orchestra.console.smithi153:Power off
2023-09-29T16:27:52.856 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-29T16:27:52.865 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2023-09-29T16:27:52.879 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off
2023-09-29T16:27:52.879 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:27:52.905 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2023-09-29T16:27:52.967 INFO:teuthology.orchestra.console.smithi136:Power off completed
2023-09-29T16:27:53.006 INFO:teuthology.orchestra.console.smithi153:Power off completed
2023-09-29T16:27:53.327 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com
2023-09-29T16:27:53.360 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com