2023-10-19T07:36:44.228 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-19T07:36:44.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T07:36:44.363 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd985b37ca0>, signals=[15]) 2023-10-19T07:36:44.364 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging 2023-10-19T07:36:44.365 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T07:36:44.365 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-10-19T07:36:44.389 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging 2023-10-19T07:36:44.390 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T07:36:44.390 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-10-19T07:36:44.392 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /host {"name": "smithi114"} 2023-10-19T07:36:44.413 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /host {"name": "smithi151"} 2023-10-19T07:36:44.468 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-19T07:36:44.479 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-19T07:36:44.508 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-19T07:36:44.508 DEBUG:teuthology.provision.fog.smithi114:FOG request: PUT /host/219 {"imageID": 5} 2023-10-19T07:36:44.524 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-19T07:36:44.525 DEBUG:teuthology.provision.fog.smithi151:FOG request: PUT /host/256 {"imageID": 5} 2023-10-19T07:36:44.561 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of rhel 8.6 2023-10-19T07:36:44.562 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-19T07:36:44.565 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of rhel 8.6 2023-10-19T07:36:44.565 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-19T07:36:44.607 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T07:36:44.611 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T07:36:44.643 DEBUG:teuthology.provision.fog.smithi151:FOG request: POST /host/256/task {"taskTypeID": 1} 2023-10-19T07:36:44.644 DEBUG:teuthology.provision.fog.smithi114:FOG request: POST /host/219/task {"taskTypeID": 1} 2023-10-19T07:36:44.704 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-19T07:36:44.710 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-19T07:36:44.793 INFO:teuthology.orchestra.console.smithi114:Power off 2023-10-19T07:36:44.794 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T07:36:44.808 INFO:teuthology.orchestra.console.smithi151:Power off 2023-10-19T07:36:44.809 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T07:36:44.817 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-10-19T07:36:44.817 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T07:36:44.830 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-10-19T07:36:44.831 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T07:36:44.841 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-10-19T07:36:44.856 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-19T07:36:48.846 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T07:36:48.856 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T07:36:48.957 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-10-19T07:36:48.965 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-19T07:36:52.958 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T07:36:52.966 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T07:36:53.067 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-10-19T07:36:53.075 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-19T07:36:53.176 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-10-19T07:36:53.277 INFO:teuthology.orchestra.console.smithi151:Power on 2023-10-19T07:36:53.277 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T07:36:53.299 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On 2023-10-19T07:36:53.300 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T07:36:53.323 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-19T07:36:57.070 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T07:36:57.179 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-10-19T07:36:57.280 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-10-19T07:36:57.325 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T07:36:57.381 INFO:teuthology.orchestra.console.smithi114:Power on 2023-10-19T07:36:57.382 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T07:36:57.404 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On 2023-10-19T07:36:57.404 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T07:36:57.426 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-10-19T07:36:57.433 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-19T07:37:01.430 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T07:37:01.437 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T07:37:01.540 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-10-19T07:37:01.546 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-19T07:37:01.641 INFO:teuthology.orchestra.console.smithi114:Power on completed 2023-10-19T07:37:01.647 INFO:teuthology.orchestra.console.smithi151:Power on completed 2023-10-19T07:37:01.742 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2023-10-19T07:37:01.743 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-19T07:37:01.749 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2023-10-19T07:37:01.749 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-19T07:37:16.826 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-19T07:37:16.827 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-19T07:37:31.916 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-19T07:37:31.917 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-19T07:37:46.990 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-19T07:37:46.993 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-19T07:38:02.066 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-19T07:38:02.068 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-19T07:38:17.135 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-19T07:38:17.136 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-19T07:38:32.214 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-19T07:38:32.216 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-19T07:38:47.299 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-19T07:38:47.301 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-19T07:39:02.374 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-19T07:39:02.375 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-19T07:39:17.456 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-19T07:39:17.457 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-19T07:39:32.534 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-19T07:39:32.536 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-19T07:39:47.627 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-19T07:39:47.628 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-19T07:39:47.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T07:39:47.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T07:40:06.143 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-19T07:40:06.144 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-19T07:40:12.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T07:40:12.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T07:40:15.226 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-19T07:40:15.227 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-19T07:40:21.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T07:40:21.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T07:40:24.318 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-19T07:40:24.319 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-19T07:40:30.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T07:40:30.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T07:40:33.406 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-19T07:40:33.407 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-19T07:40:39.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T07:40:39.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T07:40:42.490 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-19T07:40:48.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T07:41:11.236 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T07:41:11.238 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T07:41:11.539 INFO:teuthology.provision.fog.smithi114:Node is ready 2023-10-19T07:41:11.539 DEBUG:teuthology.orchestra.run.smithi114:> hostname 2023-10-19T07:41:11.573 INFO:teuthology.orchestra.run.smithi114.stdout:smithi022 2023-10-19T07:41:11.573 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi022 /etc/hosts 2023-10-19T07:41:11.629 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-10-19T07:41:11.630 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-10-19T07:41:11.795 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi022/smithi114/g' /etc/hosts 2023-10-19T07:41:11.822 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.22/172.21.15.114/g' /etc/hosts 2023-10-19T07:41:11.889 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi022/smithi114/g' /etc/hostname 2023-10-19T07:41:11.956 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-10-19T07:41:12.022 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-10-19T07:41:12.079 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T07:41:12.079 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T07:41:12.079 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel" 2023-10-19T07:41:12.080 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora" 2023-10-19T07:41:12.080 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6" 2023-10-19T07:41:12.080 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2023-10-19T07:41:12.080 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T07:41:12.080 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-10-19T07:41:12.081 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T07:41:12.081 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T07:41:12.081 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T07:41:12.081 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T07:41:12.081 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-19T07:41:12.082 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T07:41:12.082 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T07:41:12.082 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T07:41:12.082 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T07:41:12.083 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2023-10-19T07:41:12.084 DEBUG:teuthology.parallel:result is None 2023-10-19T07:41:48.533 WARNING:teuthology.provision.fog.smithi151:timed out 2023-10-19T07:41:54.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T07:41:54.881 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T07:41:54.881 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T07:41:55.192 INFO:teuthology.provision.fog.smithi151:Node is ready 2023-10-19T07:41:55.193 DEBUG:teuthology.orchestra.run.smithi151:> hostname 2023-10-19T07:41:55.212 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com 2023-10-19T07:41:55.213 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts 2023-10-19T07:41:55.271 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2023-10-19T07:41:55.272 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-10-19T07:41:55.394 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts 2023-10-19T07:41:55.424 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts 2023-10-19T07:41:55.494 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname 2023-10-19T07:41:55.563 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-10-19T07:41:55.629 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-10-19T07:41:55.686 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T07:41:55.687 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T07:41:55.687 INFO:teuthology.orchestra.run.smithi151.stdout:ID="rhel" 2023-10-19T07:41:55.687 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="fedora" 2023-10-19T07:41:55.687 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8.6" 2023-10-19T07:41:55.687 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8" 2023-10-19T07:41:55.688 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T07:41:55.688 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-10-19T07:41:55.688 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T07:41:55.688 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T07:41:55.688 INFO:teuthology.orchestra.run.smithi151.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T07:41:55.689 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T07:41:55.689 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-19T07:41:55.689 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T07:41:55.689 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T07:41:55.689 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T07:41:55.690 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T07:41:55.690 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2023-10-19T07:41:55.691 DEBUG:teuthology.parallel:result is None 2023-10-19T07:41:55.844 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2023-10-19T07:41:55.845 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com 2023-10-19T07:41:55.846 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2023-10-19T07:41:55.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-10-19T07:41:55.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T07:41:55.915 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-10-19T07:41:56.047 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-10-19T07:41:56.048 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2023-10-19T07:41:56.105 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2023-10-19T07:41:56.105 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-10-19T07:41:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T07:41:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T07:41:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:ID="rhel" 2023-10-19T07:41:56.162 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="fedora" 2023-10-19T07:41:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8.6" 2023-10-19T07:41:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2023-10-19T07:41:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T07:41:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-10-19T07:41:56.163 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T07:41:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T07:41:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T07:41:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T07:41:56.164 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-19T07:41:56.164 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T07:41:56.165 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T07:41:56.165 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T07:41:56.165 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T07:41:56.166 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-10-19T07:41:56.203 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server 2023-10-19T07:41:56.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-19T07:41:56.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T07:41:56.273 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-10-19T07:41:56.345 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-19T07:41:56.346 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-10-19T07:41:56.403 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-10-19T07:41:56.404 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-10-19T07:41:56.461 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T07:41:56.461 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T07:41:56.461 INFO:teuthology.orchestra.run.smithi151.stdout:ID="rhel" 2023-10-19T07:41:56.461 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="fedora" 2023-10-19T07:41:56.462 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8.6" 2023-10-19T07:41:56.462 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8" 2023-10-19T07:41:56.462 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T07:41:56.462 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-10-19T07:41:56.462 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T07:41:56.463 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T07:41:56.463 INFO:teuthology.orchestra.run.smithi151.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T07:41:56.463 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T07:41:56.463 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-19T07:41:56.463 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T07:41:56.464 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T07:41:56.464 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T07:41:56.464 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T07:41:56.465 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-10-19T07:41:56.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T07:41:56.578 INFO:teuthology.dispatcher.supervisor:Running job 7432249 2023-10-19T07:41:56.578 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_dparmar@teuthology --archive /home/teuthworker/archive/dparmar-2023-10-19_07:29:49-fs:functional-wip-63105-distro-default-smithi/7432249 --name dparmar-2023-10-19_07:29:49-fs:functional-wip-63105-distro-default-smithi --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} -- /home/teuthworker/archive/dparmar-2023-10-19_07:29:49-fs:functional-wip-63105-distro-default-smithi/7432249/orig.config.yaml 2023-10-19T07:41:56.581 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dparmar-2023-10-19_07:29:49-fs:functional-wip-63105-distro-default-smithi/7432249 2023-10-19T07:41:56.582 INFO:teuthology.dispatcher.supervisor:Job PID: 425173 2023-10-19T07:41:56.582 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-19T07:43:56.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T07:45:56.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T07:47:56.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T07:49:57.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T07:51:57.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T07:53:57.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T07:55:57.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T07:57:57.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T07:59:57.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T08:01:58.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T08:03:58.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T08:05:58.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T08:07:58.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T08:09:58.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T08:11:58.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T08:11:59.057 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-19T08:11:59.625 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-19T08:11:59.625 INFO:teuthology.nuke:Checking targets against current locks 2023-10-19T08:11:59.674 DEBUG:teuthology.nuke:shortname: smithi114 2023-10-19T08:11:59.674 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T08:11:59.698 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-19_07:29:49-fs:functional-wip-63105-distro-default-smithi/7432249', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 07:36:43.307301', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-19T08:11:59.702 DEBUG:teuthology.nuke:shortname: smithi151 2023-10-19T08:11:59.702 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T08:11:59.723 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-19_07:29:49-fs:functional-wip-63105-distro-default-smithi/7432249', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 07:36:43.308891', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-19T08:11:59.756 INFO:teuthology.orchestra.console.smithi114:Power off 2023-10-19T08:11:59.756 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T08:11:59.777 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-10-19T08:11:59.778 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T08:11:59.790 INFO:teuthology.orchestra.console.smithi151:Power off 2023-10-19T08:11:59.791 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T08:11:59.801 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-10-19T08:11:59.815 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-10-19T08:11:59.815 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T08:11:59.836 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-19T08:11:59.902 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-10-19T08:11:59.938 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-10-19T08:12:00.047 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com 2023-10-19T08:12:00.080 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com