2023-09-11T15:39:43.962 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-11T15:39:43.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:39:44.099 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7ef3035ca0>, signals=[15]) 2023-09-11T15:39:44.100 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging 2023-09-11T15:39:44.101 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server 2023-09-11T15:39:44.101 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-09-11T15:39:44.117 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2023-09-11T15:39:44.117 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2023-09-11T15:39:44.117 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-09-11T15:39:44.119 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /host {"name": "smithi096"} 2023-09-11T15:39:44.142 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /host {"name": "smithi156"} 2023-09-11T15:39:44.187 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-11T15:39:44.212 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-11T15:39:44.236 DEBUG:teuthology.provision.fog.smithi096:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-11T15:39:44.236 DEBUG:teuthology.provision.fog.smithi096:FOG request: PUT /host/201 {"imageID": 5} 2023-09-11T15:39:44.252 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-11T15:39:44.253 DEBUG:teuthology.provision.fog.smithi156:FOG request: PUT /host/261 {"imageID": 5} 2023-09-11T15:39:44.280 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of rhel 8.6 2023-09-11T15:39:44.281 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-11T15:39:44.297 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of rhel 8.6 2023-09-11T15:39:44.297 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-11T15:39:44.334 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /tasktype {"name": "deploy"} 2023-09-11T15:39:44.337 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /tasktype {"name": "deploy"} 2023-09-11T15:39:44.373 DEBUG:teuthology.provision.fog.smithi156:FOG request: POST /host/261/task {"taskTypeID": 1} 2023-09-11T15:39:44.376 DEBUG:teuthology.provision.fog.smithi096:FOG request: POST /host/201/task {"taskTypeID": 1} 2023-09-11T15:39:44.428 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-11T15:39:44.438 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-11T15:39:44.504 INFO:teuthology.orchestra.console.smithi096:Power off 2023-09-11T15:39:44.505 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T15:39:44.518 INFO:teuthology.orchestra.console.smithi156:Power off 2023-09-11T15:39:44.519 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T15:39:44.528 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2023-09-11T15:39:44.529 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T15:39:44.541 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-09-11T15:39:44.543 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T15:39:44.551 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-11T15:39:44.569 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-11T15:39:44.652 INFO:teuthology.orchestra.console.smithi096:Power off completed 2023-09-11T15:39:44.753 INFO:teuthology.orchestra.console.smithi096:Power on 2023-09-11T15:39:44.753 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-11T15:39:44.776 DEBUG:teuthology.orchestra.console.smithi096:power on output: Chassis Power Control: Up/On 2023-09-11T15:39:44.777 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T15:39:44.799 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-11T15:39:48.574 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T15:39:48.683 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-11T15:39:48.801 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T15:39:48.910 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-11T15:39:52.688 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T15:39:52.796 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-11T15:39:52.912 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T15:39:53.021 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-09-11T15:39:53.122 INFO:teuthology.orchestra.console.smithi096:Power on completed 2023-09-11T15:39:53.223 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish 2023-09-11T15:39:53.223 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-11T15:39:56.801 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T15:39:56.910 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-09-11T15:39:57.011 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-09-11T15:39:57.112 INFO:teuthology.orchestra.console.smithi156:Power on 2023-09-11T15:39:57.113 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-11T15:39:57.135 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2023-09-11T15:39:57.135 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T15:39:57.156 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-09-11T15:40:01.160 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T15:40:01.269 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-09-11T15:40:05.274 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T15:40:05.459 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-11T15:40:05.559 INFO:teuthology.orchestra.console.smithi156:Power on completed 2023-09-11T15:40:05.660 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2023-09-11T15:40:05.661 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-11T15:40:08.286 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-11T15:40:20.730 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-11T15:40:23.348 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-11T15:40:35.792 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-11T15:40:38.407 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-11T15:40:50.870 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-11T15:40:53.470 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-11T15:41:05.946 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-11T15:41:08.544 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-11T15:41:21.023 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-11T15:41:23.615 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-11T15:41:36.095 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-11T15:41:38.690 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-11T15:41:51.166 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-11T15:41:53.762 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-11T15:42:06.251 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-11T15:42:08.830 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-11T15:42:21.322 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-11T15:42:23.894 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-11T15:42:36.398 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-11T15:42:38.958 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-11T15:42:39.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:42:42.109 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-11T15:42:48.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:42:51.194 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-11T15:42:51.465 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-09-11T15:42:51.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:42:54.586 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-11T15:42:57.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:43:00.254 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-11T15:43:00.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:43:03.646 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-11T15:43:06.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:43:09.342 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-11T15:43:09.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:43:12.734 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-11T15:43:15.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:43:18.430 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-11T15:43:18.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:43:21.786 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-11T15:43:24.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:43:27.518 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-11T15:43:27.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:43:30.842 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-11T15:43:33.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:43:36.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:43:39.898 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-09-11T15:43:45.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:44:33.570 WARNING:teuthology.provision.fog.smithi096:timed out 2023-09-11T15:44:39.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:44:39.920 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-11T15:44:39.921 DEBUG:teuthology.orchestra.run.smithi096:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-11T15:44:40.195 INFO:teuthology.provision.fog.smithi096:Node is ready 2023-09-11T15:44:40.195 DEBUG:teuthology.orchestra.run.smithi096:> hostname 2023-09-11T15:44:40.214 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096 2023-09-11T15:44:40.214 DEBUG:teuthology.orchestra.run.smithi096:> grep smithi096 /etc/hosts 2023-09-11T15:44:40.272 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096 2023-09-11T15:44:40.273 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2023-09-11T15:44:40.398 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096/smithi096/g' /etc/hosts 2023-09-11T15:44:40.427 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/172.21.15.96/172.21.15.96/g' /etc/hosts 2023-09-11T15:44:40.495 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096/smithi096/g' /etc/hostname 2023-09-11T15:44:40.563 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2023-09-11T15:44:40.630 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-09-11T15:44:40.687 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Red Hat Enterprise Linux" 2023-09-11T15:44:40.687 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8.6 (Ootpa)" 2023-09-11T15:44:40.688 INFO:teuthology.orchestra.run.smithi096.stdout:ID="rhel" 2023-09-11T15:44:40.688 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="fedora" 2023-09-11T15:44:40.688 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8.6" 2023-09-11T15:44:40.688 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2023-09-11T15:44:40.688 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-11T15:44:40.689 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-09-11T15:44:40.689 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-11T15:44:40.689 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.redhat.com/" 2023-09-11T15:44:40.689 INFO:teuthology.orchestra.run.smithi096.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-11T15:44:40.689 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T15:44:40.690 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-09-11T15:44:40.690 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-11T15:44:40.690 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-11T15:44:40.690 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-11T15:44:40.691 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-11T15:44:40.691 INFO:teuthology.provision.fog.smithi096:Deploy complete! 2023-09-11T15:44:40.693 DEBUG:teuthology.parallel:result is None 2023-09-11T15:44:45.906 WARNING:teuthology.provision.fog.smithi156:timed out 2023-09-11T15:44:51.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:44:52.240 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-11T15:44:52.240 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-11T15:44:52.542 INFO:teuthology.provision.fog.smithi156:Node is ready 2023-09-11T15:44:52.543 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2023-09-11T15:44:52.560 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2023-09-11T15:44:52.561 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2023-09-11T15:44:52.618 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2023-09-11T15:44:52.619 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-09-11T15:44:52.736 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2023-09-11T15:44:52.764 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2023-09-11T15:44:52.832 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2023-09-11T15:44:52.898 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-09-11T15:44:52.963 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-09-11T15:44:53.019 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-09-11T15:44:53.019 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-09-11T15:44:53.019 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-09-11T15:44:53.020 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-09-11T15:44:53.020 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-09-11T15:44:53.020 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-09-11T15:44:53.020 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-11T15:44:53.020 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-09-11T15:44:53.021 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-11T15:44:53.021 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-09-11T15:44:53.021 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-11T15:44:53.021 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T15:44:53.022 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-11T15:44:53.022 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-11T15:44:53.022 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-11T15:44:53.022 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-11T15:44:53.022 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-11T15:44:53.023 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2023-09-11T15:44:53.024 DEBUG:teuthology.parallel:result is None 2023-09-11T15:44:53.173 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com 2023-09-11T15:44:53.174 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-11T15:44:53.198 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2023-09-11T15:44:53.198 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-11T15:44:53.216 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server 2023-09-11T15:44:53.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-09-11T15:44:53.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:44:53.284 DEBUG:teuthology.orchestra.run.smithi096:> true 2023-09-11T15:44:53.411 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-09-11T15:44:53.411 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2023-09-11T15:44:53.468 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2023-09-11T15:44:53.469 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-09-11T15:44:53.527 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Red Hat Enterprise Linux" 2023-09-11T15:44:53.527 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8.6 (Ootpa)" 2023-09-11T15:44:53.527 INFO:teuthology.orchestra.run.smithi096.stdout:ID="rhel" 2023-09-11T15:44:53.528 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="fedora" 2023-09-11T15:44:53.528 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8.6" 2023-09-11T15:44:53.528 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2023-09-11T15:44:53.528 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-11T15:44:53.529 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-09-11T15:44:53.529 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-11T15:44:53.530 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.redhat.com/" 2023-09-11T15:44:53.530 INFO:teuthology.orchestra.run.smithi096.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-11T15:44:53.530 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T15:44:53.531 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-09-11T15:44:53.531 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-11T15:44:53.531 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-11T15:44:53.532 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-11T15:44:53.532 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-11T15:44:53.533 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-09-11T15:44:53.556 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2023-09-11T15:44:53.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-11T15:44:53.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T15:44:53.623 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-09-11T15:44:53.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-11T15:44:53.695 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-09-11T15:44:53.752 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-09-11T15:44:53.752 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-09-11T15:44:53.808 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-09-11T15:44:53.809 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-09-11T15:44:53.809 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-09-11T15:44:53.809 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-09-11T15:44:53.809 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-09-11T15:44:53.809 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-09-11T15:44:53.810 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-11T15:44:53.810 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-09-11T15:44:53.810 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-11T15:44:53.810 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-09-11T15:44:53.811 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-11T15:44:53.811 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T15:44:53.811 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-11T15:44:53.811 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-11T15:44:53.811 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-11T15:44:53.812 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-11T15:44:53.812 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-11T15:44:53.812 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-09-11T15:44:53.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:44:53.919 INFO:teuthology.dispatcher.supervisor:Running job 7393221 2023-09-11T15:44:53.919 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-09-11_07:38:19-rados-wip-matanb-mon-44069-commits-distro-default-smithi/7393221 --name matan-2023-09-11_07:38:19-rados-wip-matanb-mon-44069-commits-distro-default-smithi --description rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_python} -- /home/teuthworker/archive/matan-2023-09-11_07:38:19-rados-wip-matanb-mon-44069-commits-distro-default-smithi/7393221/orig.config.yaml 2023-09-11T15:44:53.923 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-09-11_07:38:19-rados-wip-matanb-mon-44069-commits-distro-default-smithi/7393221 2023-09-11T15:44:53.924 INFO:teuthology.dispatcher.supervisor:Job PID: 371610 2023-09-11T15:44:53.924 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-11T15:46:54.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:48:54.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:50:54.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:52:54.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:54:54.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:56:54.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:58:55.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:00:55.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:02:55.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:04:55.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:04:55.638 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-11T16:04:55.735 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-11T16:04:55.736 INFO:teuthology.nuke:Checking targets against current locks 2023-09-11T16:04:55.784 DEBUG:teuthology.nuke:shortname: smithi096 2023-09-11T16:04:55.785 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-11T16:04:55.807 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-09-11_07:38:19-rados-wip-matanb-mon-44069-commits-distro-default-smithi/7393221', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-11 15:39:43.153997', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-11T16:04:55.810 DEBUG:teuthology.nuke:shortname: smithi156 2023-09-11T16:04:55.811 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-11T16:04:55.836 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-09-11_07:38:19-rados-wip-matanb-mon-44069-commits-distro-default-smithi/7393221', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-11 15:39:43.155640', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-11T16:04:55.867 INFO:teuthology.orchestra.console.smithi096:Power off 2023-09-11T16:04:55.867 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T16:04:55.889 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2023-09-11T16:04:55.890 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T16:04:55.907 INFO:teuthology.orchestra.console.smithi156:Power off 2023-09-11T16:04:55.908 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T16:04:55.917 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-11T16:04:55.929 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-09-11T16:04:55.929 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T16:04:55.953 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-09-11T16:04:56.018 INFO:teuthology.orchestra.console.smithi096:Power off completed 2023-09-11T16:04:56.057 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-09-11T16:04:56.193 INFO:teuthology.lock.ops:unlocked: smithi096.front.sepia.ceph.com 2023-09-11T16:04:56.201 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com