2023-08-23T18:01:47.505 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc
2023-08-23T18:01:47.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T18:01:47.651 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f60177d7850>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f6018cd3310>, signals=[15])
2023-08-23T18:01:47.653 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2023-08-23T18:01:47.653 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2023-08-23T18:01:47.653 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-08-23T18:01:47.673 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging
2023-08-23T18:01:47.673 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server
2023-08-23T18:01:47.674 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2023-08-23T18:01:47.675 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"}
2023-08-23T18:01:47.698 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /host {"name": "smithi178"}
2023-08-23T18:01:47.747 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-08-23T18:01:47.763 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-08-23T18:01:47.785 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_rhel_8.6 (ID 5)
2023-08-23T18:01:47.786 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 5}
2023-08-23T18:01:47.802 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_rhel_8.6 (ID 5)
2023-08-23T18:01:47.803 DEBUG:teuthology.provision.fog.smithi178:FOG request: PUT /host/283 {"imageID": 5}
2023-08-23T18:01:47.825 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of rhel 8.6
2023-08-23T18:01:47.826 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-08-23T18:01:47.847 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of rhel 8.6
2023-08-23T18:01:47.848 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-08-23T18:01:47.881 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"}
2023-08-23T18:01:47.887 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /tasktype {"name": "deploy"}
2023-08-23T18:01:47.915 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1}
2023-08-23T18:01:47.924 DEBUG:teuthology.provision.fog.smithi178:FOG request: POST /host/283/task {"taskTypeID": 1}
2023-08-23T18:01:47.968 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-08-23T18:01:47.990 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-08-23T18:01:48.048 INFO:teuthology.orchestra.console.smithi099:Power off
2023-08-23T18:01:48.049 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-23T18:01:48.069 INFO:teuthology.orchestra.console.smithi178:Power off
2023-08-23T18:01:48.070 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-23T18:01:48.080 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2023-08-23T18:01:48.081 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T18:01:48.092 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off
2023-08-23T18:01:48.093 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T18:01:48.103 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2023-08-23T18:01:48.114 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on
2023-08-23T18:01:52.108 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T18:01:52.117 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T18:01:52.219 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2023-08-23T18:01:52.229 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on
2023-08-23T18:01:56.224 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T18:01:56.234 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T18:01:56.336 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-08-23T18:01:56.345 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2023-08-23T18:01:56.437 INFO:teuthology.orchestra.console.smithi099:Power off completed
2023-08-23T18:01:56.446 INFO:teuthology.orchestra.console.smithi178:Power off completed
2023-08-23T18:01:56.539 INFO:teuthology.orchestra.console.smithi099:Power on
2023-08-23T18:01:56.539 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-23T18:01:56.547 INFO:teuthology.orchestra.console.smithi178:Power on
2023-08-23T18:01:56.548 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-23T18:01:56.559 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On
2023-08-23T18:01:56.560 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T18:01:56.570 DEBUG:teuthology.orchestra.console.smithi178:power on output: Chassis Power Control: Up/On
2023-08-23T18:01:56.571 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T18:01:56.582 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-08-23T18:01:56.590 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2023-08-23T18:02:00.584 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T18:02:00.591 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T18:02:00.693 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-08-23T18:02:00.701 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2023-08-23T18:02:04.697 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T18:02:04.706 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T18:02:04.808 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2023-08-23T18:02:04.817 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on
2023-08-23T18:02:04.909 INFO:teuthology.orchestra.console.smithi099:Power on completed
2023-08-23T18:02:04.919 INFO:teuthology.orchestra.console.smithi178:Power on completed
2023-08-23T18:02:05.010 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2023-08-23T18:02:05.011 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-08-23T18:02:05.020 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish
2023-08-23T18:02:05.020 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-08-23T18:02:20.093 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-08-23T18:02:20.094 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-08-23T18:02:35.166 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-08-23T18:02:35.167 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-08-23T18:02:50.240 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-08-23T18:02:50.242 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-08-23T18:03:05.320 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-08-23T18:03:05.321 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-08-23T18:03:20.420 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-08-23T18:03:20.422 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-08-23T18:03:35.500 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-08-23T18:03:35.502 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-08-23T18:03:50.584 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-08-23T18:03:50.585 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-08-23T18:04:05.674 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-08-23T18:04:05.675 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-08-23T18:04:20.748 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-08-23T18:04:20.749 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-08-23T18:04:35.836 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-08-23T18:04:35.838 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-08-23T18:04:35.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:04:38.960 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-08-23T18:04:44.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:04:48.020 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-08-23T18:04:50.907 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-08-23T18:04:54.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:04:57.104 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-08-23T18:05:03.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:05:05.964 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-08-23T18:05:06.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:05:06.160 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-08-23T18:05:09.076 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-08-23T18:05:12.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:05:15.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:05:15.216 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-08-23T18:05:18.128 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-08-23T18:05:21.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:05:24.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:05:24.272 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-08-23T18:05:27.184 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-08-23T18:05:30.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:05:33.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:05:33.328 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-08-23T18:05:36.240 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-08-23T18:05:39.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:05:42.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:05:45.296 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-08-23T18:05:51.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:05:54.352 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-08-23T18:06:00.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:06:03.408 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-08-23T18:06:09.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:06:12.468 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-08-23T18:06:18.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:06:39.352 WARNING:teuthology.provision.fog.smithi099:timed out
2023-08-23T18:06:45.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:06:45.611 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-23T18:06:45.612 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-23T18:06:45.923 INFO:teuthology.provision.fog.smithi099:Node is ready
2023-08-23T18:06:45.923 DEBUG:teuthology.orchestra.run.smithi099:> hostname
2023-08-23T18:06:45.940 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2023-08-23T18:06:45.940 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts
2023-08-23T18:06:46.001 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2023-08-23T18:06:46.001 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-08-23T18:06:46.121 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts
2023-08-23T18:06:46.148 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts
2023-08-23T18:06:46.218 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname
2023-08-23T18:06:46.288 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-08-23T18:06:46.357 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-08-23T18:06:46.418 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux"
2023-08-23T18:06:46.418 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)"
2023-08-23T18:06:46.418 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel"
2023-08-23T18:06:46.418 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora"
2023-08-23T18:06:46.418 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6"
2023-08-23T18:06:46.418 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2023-08-23T18:06:46.419 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-23T18:06:46.419 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2023-08-23T18:06:46.419 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-23T18:06:46.419 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/"
2023-08-23T18:06:46.419 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-23T18:06:46.419 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-23T18:06:46.419 INFO:teuthology.orchestra.run.smithi099.stdout:
2023-08-23T18:06:46.420 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-23T18:06:46.420 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-23T18:06:46.420 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-23T18:06:46.420 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-23T18:06:46.421 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2023-08-23T18:06:46.422 DEBUG:teuthology.parallel:result is None
2023-08-23T18:07:18.507 WARNING:teuthology.provision.fog.smithi178:timed out
2023-08-23T18:07:24.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:07:24.851 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-23T18:07:24.851 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-23T18:07:25.145 INFO:teuthology.provision.fog.smithi178:Node is ready
2023-08-23T18:07:25.145 DEBUG:teuthology.orchestra.run.smithi178:> hostname
2023-08-23T18:07:25.163 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com
2023-08-23T18:07:25.163 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts
2023-08-23T18:07:25.221 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178
2023-08-23T18:07:25.222 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178
2023-08-23T18:07:25.336 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts
2023-08-23T18:07:25.364 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts
2023-08-23T18:07:25.431 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname
2023-08-23T18:07:25.498 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178
2023-08-23T18:07:25.565 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release
2023-08-23T18:07:25.621 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux"
2023-08-23T18:07:25.622 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)"
2023-08-23T18:07:25.622 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel"
2023-08-23T18:07:25.622 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora"
2023-08-23T18:07:25.622 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6"
2023-08-23T18:07:25.622 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8"
2023-08-23T18:07:25.622 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-23T18:07:25.622 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2023-08-23T18:07:25.623 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-23T18:07:25.623 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/"
2023-08-23T18:07:25.623 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-23T18:07:25.623 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-23T18:07:25.623 INFO:teuthology.orchestra.run.smithi178.stdout:
2023-08-23T18:07:25.623 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-23T18:07:25.623 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-23T18:07:25.624 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-23T18:07:25.624 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-23T18:07:25.624 INFO:teuthology.provision.fog.smithi178:Deploy complete!
2023-08-23T18:07:25.625 DEBUG:teuthology.parallel:result is None
2023-08-23T18:07:25.803 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2023-08-23T18:07:25.804 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-23T18:07:25.832 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com
2023-08-23T18:07:25.832 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-23T18:07:25.850 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2023-08-23T18:07:25.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-08-23T18:07:25.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:07:25.916 DEBUG:teuthology.orchestra.run.smithi099:> true
2023-08-23T18:07:26.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-08-23T18:07:26.004 DEBUG:teuthology.orchestra.run.smithi099:> uname -m
2023-08-23T18:07:26.060 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2023-08-23T18:07:26.061 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-08-23T18:07:26.117 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Red Hat Enterprise Linux"
2023-08-23T18:07:26.117 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8.6 (Ootpa)"
2023-08-23T18:07:26.118 INFO:teuthology.orchestra.run.smithi099.stdout:ID="rhel"
2023-08-23T18:07:26.118 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="fedora"
2023-08-23T18:07:26.118 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8.6"
2023-08-23T18:07:26.118 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2023-08-23T18:07:26.118 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-23T18:07:26.119 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2023-08-23T18:07:26.119 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-23T18:07:26.119 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.redhat.com/"
2023-08-23T18:07:26.119 INFO:teuthology.orchestra.run.smithi099.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-23T18:07:26.119 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-23T18:07:26.119 INFO:teuthology.orchestra.run.smithi099.stdout:
2023-08-23T18:07:26.119 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-23T18:07:26.119 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-23T18:07:26.120 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-23T18:07:26.120 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-23T18:07:26.120 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-08-23T18:07:26.149 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server
2023-08-23T18:07:26.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com'
2023-08-23T18:07:26.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-23T18:07:26.213 DEBUG:teuthology.orchestra.run.smithi178:> true
2023-08-23T18:07:26.276 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com'
2023-08-23T18:07:26.277 DEBUG:teuthology.orchestra.run.smithi178:> uname -m
2023-08-23T18:07:26.332 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64
2023-08-23T18:07:26.333 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release
2023-08-23T18:07:26.388 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux"
2023-08-23T18:07:26.389 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)"
2023-08-23T18:07:26.389 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel"
2023-08-23T18:07:26.389 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora"
2023-08-23T18:07:26.389 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6"
2023-08-23T18:07:26.389 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8"
2023-08-23T18:07:26.389 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-23T18:07:26.390 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2023-08-23T18:07:26.390 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-23T18:07:26.390 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/"
2023-08-23T18:07:26.390 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-23T18:07:26.390 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-23T18:07:26.390 INFO:teuthology.orchestra.run.smithi178.stdout:
2023-08-23T18:07:26.390 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-23T18:07:26.391 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-23T18:07:26.391 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-23T18:07:26.391 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-23T18:07:26.391 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2023-08-23T18:07:26.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T18:07:26.488 INFO:teuthology.dispatcher.supervisor:Running job 7376068
2023-08-23T18:07:26.488 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7376068 --name vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} -- /home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7376068/orig.config.yaml
2023-08-23T18:07:26.492 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7376068
2023-08-23T18:07:26.493 INFO:teuthology.dispatcher.supervisor:Job PID: 16642
2023-08-23T18:07:26.493 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-23T18:09:26.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T18:11:26.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T18:13:26.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T18:15:27.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T18:17:27.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T18:19:27.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T18:21:27.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T18:23:27.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T18:25:28.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T18:27:28.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T18:29:28.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T18:31:28.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-23T18:31:28.593 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-23T18:31:28.876 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-23T18:31:28.876 INFO:teuthology.nuke:Checking targets against current locks
2023-08-23T18:31:28.920 DEBUG:teuthology.nuke:shortname: smithi099
2023-08-23T18:31:28.921 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-23T18:31:28.938 DEBUG:teuthology.nuke:shortname: smithi178
2023-08-23T18:31:28.939 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-23T18:31:28.942 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7376068', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 18:01:46.694179', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-08-23T18:31:28.963 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-22_10:22:57-fs-wip-vshankar-testing-20230822.061725-testing-default-smithi/7376068', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 18:01:46.692800', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-08-23T18:31:28.981 INFO:teuthology.orchestra.console.smithi099:Power off
2023-08-23T18:31:28.982 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-23T18:31:29.003 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2023-08-23T18:31:29.004 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T18:31:29.020 INFO:teuthology.orchestra.console.smithi178:Power off
2023-08-23T18:31:29.021 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-23T18:31:29.032 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-08-23T18:31:29.043 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off
2023-08-23T18:31:29.044 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-23T18:31:29.066 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2023-08-23T18:31:29.133 INFO:teuthology.orchestra.console.smithi099:Power off completed
2023-08-23T18:31:29.167 INFO:teuthology.orchestra.console.smithi178:Power off completed
2023-08-23T18:31:29.283 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com
2023-08-23T18:31:29.306 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com