2023-11-15T07:08:53.626 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-15T07:08:53.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:08:53.776 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2980608670>, signals=[15]) 2023-11-15T07:08:53.778 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging 2023-11-15T07:08:53.778 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server 2023-11-15T07:08:53.778 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-11-15T07:08:53.803 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2023-11-15T07:08:53.803 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2023-11-15T07:08:53.803 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-11-15T07:08:53.805 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /host {"name": "smithi043"} 2023-11-15T07:08:53.828 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"} 2023-11-15T07:08:53.875 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-15T07:08:53.895 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-15T07:08:53.920 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-15T07:08:53.920 DEBUG:teuthology.provision.fog.smithi043:FOG request: PUT /host/148 {"imageID": 5} 2023-11-15T07:08:53.935 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-15T07:08:53.935 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 5} 2023-11-15T07:08:53.966 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of rhel 8.6 2023-11-15T07:08:53.966 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-11-15T07:08:53.973 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of rhel 8.6 2023-11-15T07:08:53.973 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-11-15T07:08:54.021 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /tasktype {"name": "deploy"} 2023-11-15T07:08:54.026 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"} 2023-11-15T07:08:54.057 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1} 2023-11-15T07:08:54.061 DEBUG:teuthology.provision.fog.smithi043:FOG request: POST /host/148/task {"taskTypeID": 1} 2023-11-15T07:08:54.115 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-11-15T07:08:54.118 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-11-15T07:08:54.212 INFO:teuthology.orchestra.console.smithi043:Power off 2023-11-15T07:08:54.213 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T07:08:54.227 INFO:teuthology.orchestra.console.smithi107:Power off 2023-11-15T07:08:54.228 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T07:08:54.236 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2023-11-15T07:08:54.237 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:08:54.249 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-11-15T07:08:54.250 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:08:54.260 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-11-15T07:08:54.272 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-11-15T07:08:54.362 INFO:teuthology.orchestra.console.smithi043:Power off completed 2023-11-15T07:08:54.374 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-11-15T07:08:54.463 INFO:teuthology.orchestra.console.smithi043:Power on 2023-11-15T07:08:54.464 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-15T07:08:54.475 INFO:teuthology.orchestra.console.smithi107:Power on 2023-11-15T07:08:54.476 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-15T07:08:54.485 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On 2023-11-15T07:08:54.485 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:08:54.498 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2023-11-15T07:08:54.498 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:08:54.512 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-11-15T07:08:54.525 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-11-15T07:08:58.515 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:08:58.526 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:08:58.625 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-11-15T07:08:58.636 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-11-15T07:09:02.630 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:09:02.641 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:09:02.745 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2023-11-15T07:09:02.760 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-11-15T07:09:02.846 INFO:teuthology.orchestra.console.smithi043:Power on completed 2023-11-15T07:09:02.862 INFO:teuthology.orchestra.console.smithi107:Power on completed 2023-11-15T07:09:02.948 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish 2023-11-15T07:09:02.948 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-11-15T07:09:02.964 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2023-11-15T07:09:02.964 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-11-15T07:09:18.030 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-11-15T07:09:18.032 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-11-15T07:09:33.098 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-11-15T07:09:33.100 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-11-15T07:09:48.176 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-11-15T07:09:48.178 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-11-15T07:10:03.254 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-11-15T07:10:03.255 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-11-15T07:10:18.338 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-11-15T07:10:18.340 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-11-15T07:10:33.430 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-11-15T07:10:33.432 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-11-15T07:10:48.526 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-11-15T07:10:48.527 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-11-15T07:11:03.626 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-11-15T07:11:03.629 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-11-15T07:11:18.730 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-11-15T07:11:18.732 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-11-15T07:11:33.844 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-11-15T07:11:33.845 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-11-15T07:11:33.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:11:36.990 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-11-15T07:11:42.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:11:46.074 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-11-15T07:11:48.922 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-11-15T07:11:48.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:11:52.058 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-15T07:11:52.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:11:55.130 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-11-15T07:11:58.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:12:01.118 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-15T07:12:01.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:12:04.186 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-11-15T07:12:07.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:12:10.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:12:10.202 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-15T07:12:13.242 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-11-15T07:12:16.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:12:19.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:12:19.262 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-15T07:12:22.298 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-11-15T07:12:25.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:12:28.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:12:28.350 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-15T07:12:34.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:12:37.438 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-15T07:12:43.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:12:46.522 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-15T07:12:52.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:13:11.038 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-15T07:13:17.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:13:20.122 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-15T07:13:26.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:13:28.306 WARNING:teuthology.provision.fog.smithi043:timed out 2023-11-15T07:13:29.499 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-15T07:13:29.500 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-15T07:13:29.946 INFO:teuthology.provision.fog.smithi107:Node is ready 2023-11-15T07:13:29.946 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2023-11-15T07:13:29.962 INFO:teuthology.orchestra.run.smithi107.stdout:smithi022 2023-11-15T07:13:29.962 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi022 /etc/hosts 2023-11-15T07:13:30.018 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-11-15T07:13:30.019 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-11-15T07:13:30.322 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi022/smithi107/g' /etc/hosts 2023-11-15T07:13:30.349 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.22/172.21.15.107/g' /etc/hosts 2023-11-15T07:13:30.416 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi022/smithi107/g' /etc/hostname 2023-11-15T07:13:30.486 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-11-15T07:13:30.554 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-11-15T07:13:30.610 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2023-11-15T07:13:30.610 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.6 (Ootpa)" 2023-11-15T07:13:30.611 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2023-11-15T07:13:30.611 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2023-11-15T07:13:30.611 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.6" 2023-11-15T07:13:30.611 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2023-11-15T07:13:30.611 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-15T07:13:30.612 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-11-15T07:13:30.612 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-15T07:13:30.612 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2023-11-15T07:13:30.612 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-15T07:13:30.612 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T07:13:30.613 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-11-15T07:13:30.613 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T07:13:30.613 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-15T07:13:30.613 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-15T07:13:30.613 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-15T07:13:30.614 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2023-11-15T07:13:30.616 DEBUG:teuthology.parallel:result is None 2023-11-15T07:13:34.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:13:34.542 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-15T07:13:34.543 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-15T07:13:34.895 INFO:teuthology.provision.fog.smithi043:Node is ready 2023-11-15T07:13:34.895 DEBUG:teuthology.orchestra.run.smithi043:> hostname 2023-11-15T07:13:34.915 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com 2023-11-15T07:13:34.915 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts 2023-11-15T07:13:34.975 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043 2023-11-15T07:13:34.975 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-11-15T07:13:35.106 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts 2023-11-15T07:13:35.138 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts 2023-11-15T07:13:35.209 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname 2023-11-15T07:13:35.280 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-11-15T07:13:35.351 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-11-15T07:13:35.410 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux" 2023-11-15T07:13:35.411 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.6 (Ootpa)" 2023-11-15T07:13:35.411 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel" 2023-11-15T07:13:35.411 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora" 2023-11-15T07:13:35.411 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.6" 2023-11-15T07:13:35.411 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2023-11-15T07:13:35.412 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-15T07:13:35.412 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-11-15T07:13:35.412 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-15T07:13:35.412 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/" 2023-11-15T07:13:35.412 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-15T07:13:35.413 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T07:13:35.413 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-11-15T07:13:35.413 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T07:13:35.413 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-15T07:13:35.413 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-15T07:13:35.414 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-15T07:13:35.414 INFO:teuthology.provision.fog.smithi043:Deploy complete! 2023-11-15T07:13:35.415 DEBUG:teuthology.parallel:result is None 2023-11-15T07:13:35.574 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com 2023-11-15T07:13:35.575 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2023-11-15T07:13:35.576 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server 2023-11-15T07:13:35.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-11-15T07:13:35.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:13:35.646 DEBUG:teuthology.orchestra.run.smithi043:> true 2023-11-15T07:13:35.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-11-15T07:13:35.719 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2023-11-15T07:13:35.778 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2023-11-15T07:13:35.779 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-11-15T07:13:35.839 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Red Hat Enterprise Linux" 2023-11-15T07:13:35.839 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8.6 (Ootpa)" 2023-11-15T07:13:35.840 INFO:teuthology.orchestra.run.smithi043.stdout:ID="rhel" 2023-11-15T07:13:35.840 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="fedora" 2023-11-15T07:13:35.840 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8.6" 2023-11-15T07:13:35.840 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2023-11-15T07:13:35.840 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-15T07:13:35.841 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-11-15T07:13:35.841 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-15T07:13:35.841 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.redhat.com/" 2023-11-15T07:13:35.841 INFO:teuthology.orchestra.run.smithi043.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-15T07:13:35.842 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T07:13:35.842 INFO:teuthology.orchestra.run.smithi043.stdout: 2023-11-15T07:13:35.842 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T07:13:35.842 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-15T07:13:35.843 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-15T07:13:35.843 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-15T07:13:35.844 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-11-15T07:13:35.866 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2023-11-15T07:13:35.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-11-15T07:13:35.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:13:35.933 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-11-15T07:13:36.008 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-11-15T07:13:36.008 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-11-15T07:13:36.065 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-11-15T07:13:36.065 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-11-15T07:13:36.122 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux" 2023-11-15T07:13:36.122 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.6 (Ootpa)" 2023-11-15T07:13:36.122 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel" 2023-11-15T07:13:36.122 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora" 2023-11-15T07:13:36.123 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.6" 2023-11-15T07:13:36.123 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2023-11-15T07:13:36.123 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-15T07:13:36.123 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-11-15T07:13:36.123 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-15T07:13:36.124 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/" 2023-11-15T07:13:36.124 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-15T07:13:36.124 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T07:13:36.124 INFO:teuthology.orchestra.run.smithi107.stdout: 2023-11-15T07:13:36.124 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T07:13:36.125 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-15T07:13:36.125 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-15T07:13:36.125 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-15T07:13:36.126 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-11-15T07:13:36.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:13:36.241 INFO:teuthology.dispatcher.supervisor:Running job 7458735 2023-11-15T07:13:36.241 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-11-15_03:42:13-orch:cephadm-wip-adk-testing-2023-11-14-1702-distro-default-smithi/7458735 --name adking-2023-11-15_03:42:13-orch:cephadm-wip-adk-testing-2023-11-14-1702-distro-default-smithi --description orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} -- /home/teuthworker/archive/adking-2023-11-15_03:42:13-orch:cephadm-wip-adk-testing-2023-11-14-1702-distro-default-smithi/7458735/orig.config.yaml 2023-11-15T07:13:36.245 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-11-15_03:42:13-orch:cephadm-wip-adk-testing-2023-11-14-1702-distro-default-smithi/7458735 2023-11-15T07:13:36.246 INFO:teuthology.dispatcher.supervisor:Job PID: 2085318 2023-11-15T07:13:36.246 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-15T07:15:36.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:17:36.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:19:36.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:21:36.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:23:37.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:25:37.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:27:37.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:29:37.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:31:37.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:33:37.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:33:37.985 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-15T07:33:38.141 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-15T07:33:38.142 INFO:teuthology.nuke:Checking targets against current locks 2023-11-15T07:33:38.193 DEBUG:teuthology.nuke:shortname: smithi043 2023-11-15T07:33:38.194 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T07:33:38.222 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-11-15_03:42:13-orch:cephadm-wip-adk-testing-2023-11-14-1702-distro-default-smithi/7458735', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 07:08:52.829218', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-15T07:33:38.223 DEBUG:teuthology.nuke:shortname: smithi107 2023-11-15T07:33:38.223 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T07:33:38.250 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-11-15_03:42:13-orch:cephadm-wip-adk-testing-2023-11-14-1702-distro-default-smithi/7458735', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 07:08:52.831164', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-15T07:33:38.281 INFO:teuthology.orchestra.console.smithi043:Power off 2023-11-15T07:33:38.282 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T07:33:38.305 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2023-11-15T07:33:38.306 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:33:38.324 INFO:teuthology.orchestra.console.smithi107:Power off 2023-11-15T07:33:38.325 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T07:33:38.334 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-11-15T07:33:38.348 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-11-15T07:33:38.348 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:33:38.375 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-11-15T07:33:38.435 INFO:teuthology.orchestra.console.smithi043:Power off completed 2023-11-15T07:33:38.477 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-11-15T07:33:38.583 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com 2023-11-15T07:33:38.625 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com