2023-08-11T11:34:07.175 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-11T11:34:07.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:34:07.331 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2a7dd75ee0>, signals=[15]) 2023-08-11T11:34:07.334 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2023-08-11T11:34:07.334 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2023-08-11T11:34:07.334 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-08-11T11:34:07.357 INFO:teuthology.lock.ops:Start node 'smithi082.front.sepia.ceph.com' reimaging 2023-08-11T11:34:07.358 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: reset os type and version on server 2023-08-11T11:34:07.358 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-08-11T11:34:07.359 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"} 2023-08-11T11:34:07.383 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /host {"name": "smithi082"} 2023-08-11T11:34:07.429 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-11T11:34:07.450 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-11T11:34:07.481 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-11T11:34:07.482 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 5} 2023-08-11T11:34:07.488 DEBUG:teuthology.provision.fog.smithi082:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-11T11:34:07.489 DEBUG:teuthology.provision.fog.smithi082:FOG request: PUT /host/187 {"imageID": 5} 2023-08-11T11:34:07.528 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of rhel 8.6 2023-08-11T11:34:07.528 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:34:07.533 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of rhel 8.6 2023-08-11T11:34:07.533 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-11T11:34:07.582 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"} 2023-08-11T11:34:07.590 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /tasktype {"name": "deploy"} 2023-08-11T11:34:07.627 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1} 2023-08-11T11:34:07.629 DEBUG:teuthology.provision.fog.smithi082:FOG request: POST /host/187/task {"taskTypeID": 1} 2023-08-11T11:34:07.689 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-11T11:34:07.714 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:34:07.793 INFO:teuthology.orchestra.console.smithi082:Power off 2023-08-11T11:34:07.798 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T11:34:07.817 INFO:teuthology.orchestra.console.smithi079:Power off 2023-08-11T11:34:07.818 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T11:34:07.829 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2023-08-11T11:34:07.829 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:34:07.842 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-08-11T11:34:07.843 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:34:07.854 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2023-08-11T11:34:07.866 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-08-11T11:34:07.956 INFO:teuthology.orchestra.console.smithi082:Power off completed 2023-08-11T11:34:07.968 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-08-11T11:34:08.058 INFO:teuthology.orchestra.console.smithi082:Power on 2023-08-11T11:34:08.058 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-11T11:34:08.069 INFO:teuthology.orchestra.console.smithi079:Power on 2023-08-11T11:34:08.070 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-11T11:34:08.080 DEBUG:teuthology.orchestra.console.smithi082:power on output: Chassis Power Control: Up/On 2023-08-11T11:34:08.081 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:34:08.092 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On 2023-08-11T11:34:08.093 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:34:08.104 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2023-08-11T11:34:08.116 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-08-11T11:34:12.108 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:34:12.117 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:34:12.218 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2023-08-11T11:34:12.228 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-08-11T11:34:12.320 INFO:teuthology.orchestra.console.smithi082:Power on completed 2023-08-11T11:34:12.420 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2023-08-11T11:34:12.421 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-11T11:34:16.232 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:34:16.343 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on 2023-08-11T11:34:16.445 INFO:teuthology.orchestra.console.smithi079:Power on completed 2023-08-11T11:34:16.546 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2023-08-11T11:34:16.546 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:34:27.492 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-11T11:34:31.612 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:34:42.568 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-11T11:34:46.678 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:34:57.652 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-11T11:35:01.748 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:35:12.740 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-11T11:35:16.812 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:35:27.824 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-11T11:35:31.876 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:35:42.903 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-11T11:35:46.944 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:35:57.972 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-11T11:36:02.008 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:36:13.056 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-11T11:36:17.082 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:36:28.134 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-11T11:36:32.148 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:36:43.216 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-11T11:36:47.216 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:36:58.296 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-08-11T11:36:58.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:37:01.424 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-08-11T11:37:02.275 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:37:07.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:37:10.512 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-08-11T11:37:16.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:37:17.339 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:37:19.568 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-08-11T11:37:25.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:37:28.656 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-08-11T11:37:32.400 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:37:34.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:37:37.712 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-08-11T11:37:43.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:37:46.768 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-08-11T11:37:47.458 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:37:52.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:38:02.516 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-08-11T11:38:02.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:38:05.648 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-11T11:38:11.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:38:14.704 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-11T11:38:20.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:38:23.760 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-11T11:38:24.590 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-11T11:38:24.591 DEBUG:teuthology.orchestra.run.smithi082:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-11T11:38:24.850 INFO:teuthology.provision.fog.smithi082:Node is ready 2023-08-11T11:38:24.851 DEBUG:teuthology.orchestra.run.smithi082:> hostname 2023-08-11T11:38:24.906 INFO:teuthology.orchestra.run.smithi082.stdout:smithi022 2023-08-11T11:38:24.906 DEBUG:teuthology.orchestra.run.smithi082:> grep smithi022 /etc/hosts 2023-08-11T11:38:24.963 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-08-11T11:38:24.963 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2023-08-11T11:38:25.079 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi022/smithi082/g' /etc/hosts 2023-08-11T11:38:25.105 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/172.21.15.22/172.21.15.82/g' /etc/hosts 2023-08-11T11:38:25.171 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i -e 's/smithi022/smithi082/g' /etc/hostname 2023-08-11T11:38:25.237 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname smithi082 2023-08-11T11:38:25.306 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-08-11T11:38:25.364 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Red Hat Enterprise Linux" 2023-08-11T11:38:25.365 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8.6 (Ootpa)" 2023-08-11T11:38:25.365 INFO:teuthology.orchestra.run.smithi082.stdout:ID="rhel" 2023-08-11T11:38:25.365 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="fedora" 2023-08-11T11:38:25.365 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8.6" 2023-08-11T11:38:25.365 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2023-08-11T11:38:25.365 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-11T11:38:25.366 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2023-08-11T11:38:25.366 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-11T11:38:25.366 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.redhat.com/" 2023-08-11T11:38:25.366 INFO:teuthology.orchestra.run.smithi082.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-11T11:38:25.366 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T11:38:25.366 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-08-11T11:38:25.366 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-11T11:38:25.367 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-11T11:38:25.367 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-11T11:38:25.367 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-11T11:38:25.368 INFO:teuthology.provision.fog.smithi082:Deploy complete! 2023-08-11T11:38:25.369 DEBUG:teuthology.parallel:result is None 2023-08-11T11:38:29.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:38:32.820 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-11T11:38:38.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:38:41.904 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-11T11:38:47.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:38:50.973 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-08-11T11:38:56.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:39:29.032 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-11T11:39:29.033 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-11T11:39:29.376 INFO:teuthology.provision.fog.smithi079:Node is ready 2023-08-11T11:39:29.377 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2023-08-11T11:39:29.392 INFO:teuthology.orchestra.run.smithi079.stdout:smithi022 2023-08-11T11:39:29.393 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi022 /etc/hosts 2023-08-11T11:39:29.449 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-08-11T11:39:29.450 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-08-11T11:39:29.601 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi022/smithi079/g' /etc/hosts 2023-08-11T11:39:29.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.22/172.21.15.79/g' /etc/hosts 2023-08-11T11:39:29.703 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi022/smithi079/g' /etc/hostname 2023-08-11T11:39:29.769 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-08-11T11:39:29.836 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-08-11T11:39:29.892 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2023-08-11T11:39:29.893 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)" 2023-08-11T11:39:29.893 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2023-08-11T11:39:29.893 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2023-08-11T11:39:29.893 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6" 2023-08-11T11:39:29.893 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-08-11T11:39:29.893 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-11T11:39:29.893 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-08-11T11:39:29.894 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-11T11:39:29.894 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2023-08-11T11:39:29.894 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-11T11:39:29.894 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T11:39:29.894 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-08-11T11:39:29.894 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-11T11:39:29.894 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-11T11:39:29.895 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-11T11:39:29.895 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-11T11:39:29.895 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2023-08-11T11:39:29.896 DEBUG:teuthology.parallel:result is None 2023-08-11T11:39:30.037 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2023-08-11T11:39:30.039 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com 2023-08-11T11:39:30.039 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-11T11:39:30.061 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2023-08-11T11:39:30.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-08-11T11:39:30.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:39:30.129 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-08-11T11:39:30.151 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-08-11T11:39:30.152 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-08-11T11:39:30.208 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-08-11T11:39:30.209 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-08-11T11:39:30.266 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2023-08-11T11:39:30.266 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)" 2023-08-11T11:39:30.267 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2023-08-11T11:39:30.267 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2023-08-11T11:39:30.267 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6" 2023-08-11T11:39:30.268 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-08-11T11:39:30.268 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-11T11:39:30.268 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-08-11T11:39:30.268 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-11T11:39:30.269 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2023-08-11T11:39:30.269 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-11T11:39:30.269 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T11:39:30.269 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-08-11T11:39:30.270 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-11T11:39:30.270 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-11T11:39:30.270 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-11T11:39:30.270 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-11T11:39:30.271 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-08-11T11:39:30.293 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server 2023-08-11T11:39:30.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-08-11T11:39:30.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T11:39:30.361 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-08-11T11:39:30.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-08-11T11:39:30.498 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2023-08-11T11:39:30.555 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2023-08-11T11:39:30.555 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-08-11T11:39:30.612 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Red Hat Enterprise Linux" 2023-08-11T11:39:30.613 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8.6 (Ootpa)" 2023-08-11T11:39:30.613 INFO:teuthology.orchestra.run.smithi082.stdout:ID="rhel" 2023-08-11T11:39:30.613 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="fedora" 2023-08-11T11:39:30.613 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8.6" 2023-08-11T11:39:30.613 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2023-08-11T11:39:30.613 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-11T11:39:30.614 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2023-08-11T11:39:30.614 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-11T11:39:30.614 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.redhat.com/" 2023-08-11T11:39:30.614 INFO:teuthology.orchestra.run.smithi082.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-11T11:39:30.614 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T11:39:30.614 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-08-11T11:39:30.614 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-11T11:39:30.614 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-11T11:39:30.615 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-11T11:39:30.615 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-11T11:39:30.615 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-08-11T11:39:30.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:39:30.739 INFO:teuthology.dispatcher.supervisor:Running job 7365693 2023-08-11T11:39:30.740 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365693 --name rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} -- /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365693/orig.config.yaml 2023-08-11T11:39:30.743 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365693 2023-08-11T11:39:30.744 INFO:teuthology.dispatcher.supervisor:Job PID: 27356 2023-08-11T11:39:30.744 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-11T11:41:30.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:43:31.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:45:31.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:47:31.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:49:31.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:51:31.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:53:31.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:55:31.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:57:32.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:59:32.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:01:32.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:03:32.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:03:32.723 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-11T12:03:32.829 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-11T12:03:32.830 INFO:teuthology.nuke:Checking targets against current locks 2023-08-11T12:03:32.875 DEBUG:teuthology.nuke:shortname: smithi079 2023-08-11T12:03:32.876 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-11T12:03:32.896 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365693', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 11:34:06.261280', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-11T12:03:32.899 DEBUG:teuthology.nuke:shortname: smithi082 2023-08-11T12:03:32.900 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-11T12:03:32.922 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365693', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 11:34:06.263135', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-11T12:03:32.945 INFO:teuthology.orchestra.console.smithi079:Power off 2023-08-11T12:03:32.946 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T12:03:32.969 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off 2023-08-11T12:03:32.970 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T12:03:32.989 INFO:teuthology.orchestra.console.smithi082:Power off 2023-08-11T12:03:32.990 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T12:03:33.001 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off 2023-08-11T12:03:33.013 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2023-08-11T12:03:33.014 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T12:03:33.038 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2023-08-11T12:03:33.102 INFO:teuthology.orchestra.console.smithi079:Power off completed 2023-08-11T12:03:33.140 INFO:teuthology.orchestra.console.smithi082:Power off completed 2023-08-11T12:03:33.264 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2023-08-11T12:03:33.289 INFO:teuthology.lock.ops:unlocked: smithi082.front.sepia.ceph.com