2023-10-06T05:07:30.605 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-06T05:07:30.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:07:30.744 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f0784c4fb20>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f0785741670>, signals=[15])
2023-10-06T05:07:30.744 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging
2023-10-06T05:07:30.745 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server
2023-10-06T05:07:30.745 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2023-10-06T05:07:30.769 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging
2023-10-06T05:07:30.770 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server
2023-10-06T05:07:30.770 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2023-10-06T05:07:30.771 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /host {"name": "smithi057"}
2023-10-06T05:07:30.794 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /host {"name": "smithi115"}
2023-10-06T05:07:30.841 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-10-06T05:07:30.865 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-10-06T05:07:30.879 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_rhel_8.4 (ID 7)
2023-10-06T05:07:30.879 DEBUG:teuthology.provision.fog.smithi057:FOG request: PUT /host/162 {"imageID": 7}
2023-10-06T05:07:30.909 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_rhel_8.4 (ID 7)
2023-10-06T05:07:30.909 DEBUG:teuthology.provision.fog.smithi115:FOG request: PUT /host/220 {"imageID": 7}
2023-10-06T05:07:30.931 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of rhel 8.4
2023-10-06T05:07:30.931 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-06T05:07:30.957 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of rhel 8.4
2023-10-06T05:07:30.957 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-10-06T05:07:30.997 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /tasktype {"name": "deploy"}
2023-10-06T05:07:31.008 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /tasktype {"name": "deploy"}
2023-10-06T05:07:31.044 DEBUG:teuthology.provision.fog.smithi057:FOG request: POST /host/162/task {"taskTypeID": 1}
2023-10-06T05:07:31.052 DEBUG:teuthology.provision.fog.smithi115:FOG request: POST /host/220/task {"taskTypeID": 1}
2023-10-06T05:07:31.094 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-06T05:07:31.106 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-10-06T05:07:31.189 INFO:teuthology.orchestra.console.smithi057:Power off
2023-10-06T05:07:31.189 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-06T05:07:31.203 INFO:teuthology.orchestra.console.smithi115:Power off
2023-10-06T05:07:31.203 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-06T05:07:31.216 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off
2023-10-06T05:07:31.216 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T05:07:31.227 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off
2023-10-06T05:07:31.227 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T05:07:31.238 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on
2023-10-06T05:07:31.250 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-10-06T05:07:35.242 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T05:07:35.251 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T05:07:35.351 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on
2023-10-06T05:07:35.359 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-10-06T05:07:39.356 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T05:07:39.363 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T05:07:39.465 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on
2023-10-06T05:07:39.471 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-10-06T05:07:43.470 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T05:07:43.478 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T05:07:43.580 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off
2023-10-06T05:07:43.586 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2023-10-06T05:07:43.681 INFO:teuthology.orchestra.console.smithi057:Power off completed
2023-10-06T05:07:43.687 INFO:teuthology.orchestra.console.smithi115:Power off completed
2023-10-06T05:07:43.782 INFO:teuthology.orchestra.console.smithi057:Power on
2023-10-06T05:07:43.783 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-06T05:07:43.790 INFO:teuthology.orchestra.console.smithi115:Power on
2023-10-06T05:07:43.790 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-06T05:07:43.805 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On
2023-10-06T05:07:43.806 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T05:07:43.813 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On
2023-10-06T05:07:43.814 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T05:07:43.826 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off
2023-10-06T05:07:43.836 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2023-10-06T05:07:47.830 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T05:07:47.838 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T05:07:47.940 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off
2023-10-06T05:07:47.945 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-10-06T05:07:48.045 INFO:teuthology.orchestra.console.smithi115:Power on completed
2023-10-06T05:07:48.146 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish
2023-10-06T05:07:48.146 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-10-06T05:07:51.942 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T05:07:52.050 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on
2023-10-06T05:07:52.151 INFO:teuthology.orchestra.console.smithi057:Power on completed
2023-10-06T05:07:52.252 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish
2023-10-06T05:07:52.252 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-06T05:08:03.226 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-10-06T05:08:07.326 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-06T05:08:18.318 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-10-06T05:08:22.402 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-06T05:08:33.398 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-10-06T05:08:37.474 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-06T05:08:48.489 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-10-06T05:08:52.542 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-06T05:09:03.578 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-10-06T05:09:07.618 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-06T05:09:18.654 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-10-06T05:09:22.710 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-06T05:09:33.742 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-10-06T05:09:37.787 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-06T05:09:48.830 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-10-06T05:09:52.866 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-06T05:10:03.930 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-10-06T05:10:07.970 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-06T05:10:19.026 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-10-06T05:10:23.062 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-06T05:10:34.118 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-10-06T05:10:34.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:10:38.150 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-06T05:10:38.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:10:52.538 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-10-06T05:10:56.638 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57
2023-10-06T05:10:58.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:11:01.598 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-10-06T05:11:02.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:11:05.694 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57
2023-10-06T05:11:07.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:11:10.682 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-10-06T05:11:11.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:11:14.750 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57
2023-10-06T05:11:16.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:11:19.738 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-10-06T05:11:20.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:11:23.806 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57
2023-10-06T05:11:25.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:11:28.795 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-10-06T05:11:29.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:11:32.890 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57
2023-10-06T05:11:34.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:11:37.854 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-10-06T05:11:38.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:11:43.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:12:02.426 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-10-06T05:12:08.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:12:11.486 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-10-06T05:12:17.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:12:20.570 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-10-06T05:12:26.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:12:26.968 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-06T05:12:26.968 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-06T05:12:38.894 WARNING:teuthology.provision.fog.smithi057:timed out
2023-10-06T05:12:42.415 INFO:teuthology.provision.fog.smithi115:Node is ready
2023-10-06T05:12:42.415 DEBUG:teuthology.orchestra.run.smithi115:> hostname
2023-10-06T05:12:42.433 INFO:teuthology.orchestra.run.smithi115.stdout:smithi036
2023-10-06T05:12:42.433 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi036 /etc/hosts
2023-10-06T05:12:42.489 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036
2023-10-06T05:12:42.489 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2023-10-06T05:12:42.628 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi036/smithi115/g' /etc/hosts
2023-10-06T05:12:42.656 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.36/172.21.15.115/g' /etc/hosts
2023-10-06T05:12:42.722 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi036/smithi115/g' /etc/hostname
2023-10-06T05:12:42.788 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2023-10-06T05:12:42.852 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release
2023-10-06T05:12:42.906 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Red Hat Enterprise Linux"
2023-10-06T05:12:42.906 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8.4 (Ootpa)"
2023-10-06T05:12:42.907 INFO:teuthology.orchestra.run.smithi115.stdout:ID="rhel"
2023-10-06T05:12:42.907 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="fedora"
2023-10-06T05:12:42.907 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8.4"
2023-10-06T05:12:42.907 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8"
2023-10-06T05:12:42.907 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-10-06T05:12:42.907 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2023-10-06T05:12:42.907 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-10-06T05:12:42.907 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.redhat.com/"
2023-10-06T05:12:42.907 INFO:teuthology.orchestra.run.smithi115.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-06T05:12:42.907 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-06T05:12:42.907 INFO:teuthology.orchestra.run.smithi115.stdout:
2023-10-06T05:12:42.907 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-06T05:12:42.908 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-10-06T05:12:42.908 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-06T05:12:42.908 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-10-06T05:12:42.909 INFO:teuthology.provision.fog.smithi115:Deploy complete!
2023-10-06T05:12:42.911 DEBUG:teuthology.parallel:result is None
2023-10-06T05:12:44.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:12:45.184 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-06T05:12:45.184 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-06T05:12:45.443 INFO:teuthology.provision.fog.smithi057:Node is ready
2023-10-06T05:12:45.443 DEBUG:teuthology.orchestra.run.smithi057:> hostname
2023-10-06T05:12:45.499 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com
2023-10-06T05:12:45.499 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts
2023-10-06T05:12:45.556 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057
2023-10-06T05:12:45.556 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057
2023-10-06T05:12:45.670 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts
2023-10-06T05:12:45.697 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts
2023-10-06T05:12:45.764 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname
2023-10-06T05:12:45.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057
2023-10-06T05:12:45.896 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release
2023-10-06T05:12:45.951 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux"
2023-10-06T05:12:45.951 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.4 (Ootpa)"
2023-10-06T05:12:45.951 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel"
2023-10-06T05:12:45.951 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora"
2023-10-06T05:12:45.951 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.4"
2023-10-06T05:12:45.951 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8"
2023-10-06T05:12:45.951 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-10-06T05:12:45.952 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31"
2023-10-06T05:12:45.952 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-10-06T05:12:45.952 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/"
2023-10-06T05:12:45.952 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-06T05:12:45.952 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-06T05:12:45.952 INFO:teuthology.orchestra.run.smithi057.stdout:
2023-10-06T05:12:45.952 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-06T05:12:45.952 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-10-06T05:12:45.952 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-06T05:12:45.952 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-10-06T05:12:45.953 INFO:teuthology.provision.fog.smithi057:Deploy complete!
2023-10-06T05:12:45.953 DEBUG:teuthology.parallel:result is None
2023-10-06T05:12:46.099 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com
2023-10-06T05:12:46.099 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-06T05:12:46.124 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com
2023-10-06T05:12:46.124 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-06T05:12:46.142 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server
2023-10-06T05:12:46.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com'
2023-10-06T05:12:46.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:12:46.206 DEBUG:teuthology.orchestra.run.smithi057:> true
2023-10-06T05:12:46.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com'
2023-10-06T05:12:46.269 DEBUG:teuthology.orchestra.run.smithi057:> uname -m
2023-10-06T05:12:46.323 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64
2023-10-06T05:12:46.324 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release
2023-10-06T05:12:46.378 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux"
2023-10-06T05:12:46.379 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.4 (Ootpa)"
2023-10-06T05:12:46.379 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel"
2023-10-06T05:12:46.379 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora"
2023-10-06T05:12:46.379 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.4"
2023-10-06T05:12:46.379 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8"
2023-10-06T05:12:46.379 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-10-06T05:12:46.379 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31"
2023-10-06T05:12:46.379 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-10-06T05:12:46.379 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/"
2023-10-06T05:12:46.379 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-06T05:12:46.379 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-06T05:12:46.380 INFO:teuthology.orchestra.run.smithi057.stdout:
2023-10-06T05:12:46.380 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-06T05:12:46.380 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-10-06T05:12:46.380 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-06T05:12:46.380 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-10-06T05:12:46.380 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2023-10-06T05:12:46.399 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server
2023-10-06T05:12:46.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com'
2023-10-06T05:12:46.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T05:12:46.467 DEBUG:teuthology.orchestra.run.smithi115:> true
2023-10-06T05:12:46.533 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com'
2023-10-06T05:12:46.534 DEBUG:teuthology.orchestra.run.smithi115:> uname -m
2023-10-06T05:12:46.588 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64
2023-10-06T05:12:46.588 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release
2023-10-06T05:12:46.641 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Red Hat Enterprise Linux"
2023-10-06T05:12:46.641 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8.4 (Ootpa)"
2023-10-06T05:12:46.641 INFO:teuthology.orchestra.run.smithi115.stdout:ID="rhel"
2023-10-06T05:12:46.641 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="fedora"
2023-10-06T05:12:46.641 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8.4"
2023-10-06T05:12:46.642 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8"
2023-10-06T05:12:46.642 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-10-06T05:12:46.642 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2023-10-06T05:12:46.642 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-10-06T05:12:46.642 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.redhat.com/"
2023-10-06T05:12:46.642 INFO:teuthology.orchestra.run.smithi115.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-06T05:12:46.642 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-06T05:12:46.642 INFO:teuthology.orchestra.run.smithi115.stdout:
2023-10-06T05:12:46.642 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-06T05:12:46.642 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-10-06T05:12:46.642 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-06T05:12:46.642 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-10-06T05:12:46.643 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2023-10-06T05:12:46.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:12:46.765 INFO:teuthology.dispatcher.supervisor:Running job 7412337
2023-10-06T05:12:46.765 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412337 --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412337/orig.config.yaml
2023-10-06T05:12:46.769 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412337
2023-10-06T05:12:46.770 INFO:teuthology.dispatcher.supervisor:Job PID: 2173148
2023-10-06T05:12:46.770 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-06T05:14:46.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:16:47.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:18:47.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:20:47.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:22:47.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:24:47.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:26:47.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:28:48.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:30:48.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:32:48.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:34:48.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:36:48.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:38:48.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:40:48.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:42:49.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:44:49.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:46:49.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:48:49.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:50:49.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:52:49.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:54:50.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:56:50.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T05:58:50.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T06:00:50.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T06:02:50.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T06:04:50.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T06:06:51.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T06:06:51.152 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-10-06T06:06:51.310 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-06T06:06:51.310 INFO:teuthology.nuke:Checking targets against current locks
2023-10-06T06:06:51.362 DEBUG:teuthology.nuke:shortname: smithi057
2023-10-06T06:06:51.363 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-06T06:06:51.385 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412337', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 05:07:29.767261', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHTSG8NDONLEqc62jJe6o+A7Gyl9eWDt2Y31QIoYTcwTkle/PzXvpX7zFt2jVHrYo6qp+hear1BMBM+oRCmYMi4='}
2023-10-06T06:06:51.388 DEBUG:teuthology.nuke:shortname: smithi115
2023-10-06T06:06:51.388 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-06T06:06:51.412 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412337', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 05:07:29.765276', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTcIIdBBiL/YURZqjGm9y9UMor4y892Zw/9U0GZfbPzSjD7W2ABmcJqtV6OU9edHcQqxQA8hCHpGbczyeKhMl0='}
2023-10-06T06:06:51.429 INFO:teuthology.orchestra.console.smithi057:Power off
2023-10-06T06:06:51.429 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-06T06:06:51.451 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off
2023-10-06T06:06:51.452 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T06:06:51.466 INFO:teuthology.orchestra.console.smithi115:Power off
2023-10-06T06:06:51.466 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-06T06:06:51.473 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off
2023-10-06T06:06:51.486 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off
2023-10-06T06:06:51.486 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T06:06:51.517 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2023-10-06T06:06:51.574 INFO:teuthology.orchestra.console.smithi057:Power off completed
2023-10-06T06:06:51.618 INFO:teuthology.orchestra.console.smithi115:Power off completed
2023-10-06T06:06:51.729 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com
2023-10-06T06:06:51.768 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com