2023-08-10T09:51:57.183 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-10T09:51:57.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T09:51:57.313 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f223f3ecee0>, signals=[15]) 2023-08-10T09:51:57.315 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2023-08-10T09:51:57.316 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2023-08-10T09:51:57.316 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-08-10T09:51:57.336 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging 2023-08-10T09:51:57.336 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server 2023-08-10T09:51:57.336 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-08-10T09:51:57.337 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /host {"name": "smithi022"} 2023-08-10T09:51:57.352 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /host {"name": "smithi037"} 2023-08-10T09:51:57.418 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-10T09:51:57.421 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-10T09:51:57.458 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-10T09:51:57.458 DEBUG:teuthology.provision.fog.smithi022:FOG request: PUT /host/128 {"imageID": 5} 2023-08-10T09:51:57.461 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-10T09:51:57.461 DEBUG:teuthology.provision.fog.smithi037:FOG request: PUT /host/142 {"imageID": 5} 2023-08-10T09:51:57.503 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of rhel 8.6 2023-08-10T09:51:57.503 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:51:57.506 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of rhel 8.6 2023-08-10T09:51:57.506 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-10T09:51:57.587 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /tasktype {"name": "deploy"} 2023-08-10T09:51:57.591 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /tasktype {"name": "deploy"} 2023-08-10T09:51:57.620 DEBUG:teuthology.provision.fog.smithi037:FOG request: POST /host/142/task {"taskTypeID": 1} 2023-08-10T09:51:57.624 DEBUG:teuthology.provision.fog.smithi022:FOG request: POST /host/128/task {"taskTypeID": 1} 2023-08-10T09:51:57.672 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-10T09:51:57.677 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:51:57.789 INFO:teuthology.orchestra.console.smithi022:Power off 2023-08-10T09:51:57.790 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T09:51:57.808 INFO:teuthology.orchestra.console.smithi037:Power off 2023-08-10T09:51:57.811 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T09:51:57.822 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-08-10T09:51:57.823 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T09:51:57.838 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-08-10T09:51:57.839 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T09:51:57.850 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-08-10T09:51:57.868 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-08-10T09:52:01.852 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T09:52:01.869 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T09:52:01.962 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-08-10T09:52:01.979 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-08-10T09:52:05.968 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T09:52:05.980 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T09:52:06.079 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-08-10T09:52:06.089 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-08-10T09:52:06.180 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-08-10T09:52:06.281 INFO:teuthology.orchestra.console.smithi022:Power on 2023-08-10T09:52:06.281 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-10T09:52:06.300 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On 2023-08-10T09:52:06.301 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T09:52:06.320 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-08-10T09:52:10.094 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T09:52:10.203 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-08-10T09:52:10.304 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-08-10T09:52:10.321 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T09:52:10.405 INFO:teuthology.orchestra.console.smithi037:Power on 2023-08-10T09:52:10.406 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-10T09:52:10.426 DEBUG:teuthology.orchestra.console.smithi037:power on output: Chassis Power Control: Up/On 2023-08-10T09:52:10.427 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T09:52:10.435 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-08-10T09:52:10.445 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-08-10T09:52:14.440 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T09:52:14.448 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T09:52:14.557 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-08-10T09:52:14.622 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-08-10T09:52:14.658 INFO:teuthology.orchestra.console.smithi037:Power on completed 2023-08-10T09:52:14.723 INFO:teuthology.orchestra.console.smithi022:Power on completed 2023-08-10T09:52:14.759 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2023-08-10T09:52:14.760 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-10T09:52:14.824 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2023-08-10T09:52:14.824 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:52:29.943 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-10T09:52:29.982 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:52:45.121 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-10T09:52:45.144 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:53:00.298 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:53:00.300 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-10T09:53:15.472 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:53:15.473 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-10T09:53:30.689 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-10T09:53:30.690 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:53:45.908 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:53:45.909 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-10T09:54:01.088 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-10T09:54:01.090 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:54:16.424 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:54:16.425 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-10T09:54:31.672 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:54:31.673 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-10T09:54:46.940 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:54:46.941 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-08-10T09:54:47.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T09:54:50.256 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-08-10T09:54:56.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T09:54:59.312 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-08-10T09:55:02.188 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:55:05.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T09:55:08.368 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-08-10T09:55:14.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T09:55:17.420 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:55:17.424 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-08-10T09:55:23.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T09:55:26.480 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-08-10T09:55:32.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T09:55:32.667 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:55:47.909 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:56:03.176 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:56:04.425 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T09:56:04.426 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T09:56:04.892 INFO:teuthology.provision.fog.smithi037:Node is ready 2023-08-10T09:56:04.893 DEBUG:teuthology.orchestra.run.smithi037:> hostname 2023-08-10T09:56:04.908 INFO:teuthology.orchestra.run.smithi037.stdout:smithi022 2023-08-10T09:56:04.909 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi022 /etc/hosts 2023-08-10T09:56:04.966 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-08-10T09:56:04.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-08-10T09:56:05.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi022/smithi037/g' /etc/hosts 2023-08-10T09:56:05.258 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.22/172.21.15.37/g' /etc/hosts 2023-08-10T09:56:05.328 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi022/smithi037/g' /etc/hostname 2023-08-10T09:56:05.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-08-10T09:56:05.461 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-08-10T09:56:05.518 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T09:56:05.518 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T09:56:05.518 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel" 2023-08-10T09:56:05.518 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora" 2023-08-10T09:56:05.519 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.6" 2023-08-10T09:56:05.519 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-08-10T09:56:05.519 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T09:56:05.519 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-08-10T09:56:05.519 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T09:56:05.519 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T09:56:05.519 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T09:56:05.520 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T09:56:05.520 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-08-10T09:56:05.520 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T09:56:05.520 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T09:56:05.520 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T09:56:05.520 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T09:56:05.521 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2023-08-10T09:56:05.523 DEBUG:teuthology.parallel:result is None 2023-08-10T09:56:18.380 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:56:33.540 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:56:48.732 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:57:03.905 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:57:19.082 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:57:34.264 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:57:49.436 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:58:04.592 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:58:19.753 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:58:34.888 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:58:50.060 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-10T09:58:50.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T09:58:53.232 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-10T09:58:59.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T09:59:02.288 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-10T09:59:08.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T09:59:11.344 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-10T09:59:17.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T09:59:20.400 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-10T09:59:26.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T09:59:29.456 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-10T09:59:35.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:00:35.520 WARNING:teuthology.provision.fog.smithi022:timed out 2023-08-10T10:00:41.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:00:41.752 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T10:00:41.753 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T10:00:42.051 INFO:teuthology.provision.fog.smithi022:Node is ready 2023-08-10T10:00:42.052 DEBUG:teuthology.orchestra.run.smithi022:> hostname 2023-08-10T10:00:42.071 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2023-08-10T10:00:42.072 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2023-08-10T10:00:42.130 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-08-10T10:00:42.131 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-08-10T10:00:42.257 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2023-08-10T10:00:42.287 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2023-08-10T10:00:42.356 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2023-08-10T10:00:42.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-08-10T10:00:42.492 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-08-10T10:00:42.549 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T10:00:42.549 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T10:00:42.549 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2023-08-10T10:00:42.550 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2023-08-10T10:00:42.550 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.6" 2023-08-10T10:00:42.550 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-08-10T10:00:42.550 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T10:00:42.550 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-08-10T10:00:42.550 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T10:00:42.550 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T10:00:42.551 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T10:00:42.551 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:00:42.551 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-08-10T10:00:42.551 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T10:00:42.551 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T10:00:42.551 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T10:00:42.551 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T10:00:42.552 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2023-08-10T10:00:42.552 DEBUG:teuthology.parallel:result is None 2023-08-10T10:00:42.720 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2023-08-10T10:00:42.721 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-10T10:00:42.742 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2023-08-10T10:00:42.743 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-10T10:00:42.760 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2023-08-10T10:00:42.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-08-10T10:00:42.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:00:42.826 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-08-10T10:00:42.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-08-10T10:00:42.897 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2023-08-10T10:00:42.954 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2023-08-10T10:00:42.954 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-08-10T10:00:43.010 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T10:00:43.011 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T10:00:43.011 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2023-08-10T10:00:43.011 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2023-08-10T10:00:43.011 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.6" 2023-08-10T10:00:43.011 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-08-10T10:00:43.012 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T10:00:43.012 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-08-10T10:00:43.012 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T10:00:43.012 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T10:00:43.012 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T10:00:43.012 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:00:43.013 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-08-10T10:00:43.013 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T10:00:43.013 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T10:00:43.013 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T10:00:43.013 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T10:00:43.014 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-08-10T10:00:43.034 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2023-08-10T10:00:43.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-08-10T10:00:43.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:00:43.101 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-08-10T10:00:43.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-08-10T10:00:43.239 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-08-10T10:00:43.296 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-08-10T10:00:43.297 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-08-10T10:00:43.354 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux" 2023-08-10T10:00:43.355 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.6 (Ootpa)" 2023-08-10T10:00:43.355 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel" 2023-08-10T10:00:43.355 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora" 2023-08-10T10:00:43.355 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.6" 2023-08-10T10:00:43.355 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-08-10T10:00:43.355 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-10T10:00:43.356 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-08-10T10:00:43.356 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-10T10:00:43.356 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/" 2023-08-10T10:00:43.356 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-10T10:00:43.356 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:00:43.356 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-08-10T10:00:43.357 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T10:00:43.357 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-10T10:00:43.357 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-10T10:00:43.357 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-10T10:00:43.357 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-08-10T10:00:43.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:00:43.461 INFO:teuthology.dispatcher.supervisor:Running job 7364537 2023-08-10T10:00:43.461 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364537 --name rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} -- /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364537/orig.config.yaml 2023-08-10T10:00:43.465 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364537 2023-08-10T10:00:43.466 INFO:teuthology.dispatcher.supervisor:Job PID: 29234 2023-08-10T10:00:43.466 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-10T10:02:43.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:04:43.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:06:43.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:08:44.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:10:44.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:12:44.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:14:44.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:16:44.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:18:44.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:20:45.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:22:45.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:24:45.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:26:45.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:28:45.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:30:45.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:32:46.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:34:46.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:36:46.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:38:46.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:40:46.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:40:46.755 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-10T10:40:46.873 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-10T10:40:46.875 INFO:teuthology.nuke:Checking targets against current locks 2023-08-10T10:40:46.924 DEBUG:teuthology.nuke:shortname: smithi022 2023-08-10T10:40:46.925 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T10:40:46.945 DEBUG:teuthology.nuke:shortname: smithi037 2023-08-10T10:40:46.946 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T10:40:46.949 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364537', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:51:56.440681', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-10T10:40:46.965 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364537', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:51:56.442386', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-10T10:40:46.995 INFO:teuthology.orchestra.console.smithi022:Power off 2023-08-10T10:40:46.996 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T10:40:47.018 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-08-10T10:40:47.018 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:40:47.035 INFO:teuthology.orchestra.console.smithi037:Power off 2023-08-10T10:40:47.035 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T10:40:47.044 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-08-10T10:40:47.055 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-08-10T10:40:47.056 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:40:47.083 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-08-10T10:40:47.146 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-08-10T10:40:47.185 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-08-10T10:40:47.305 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com 2023-08-10T10:40:47.328 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com