2023-09-30T01:59:34.497 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T01:59:34.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T01:59:34.640 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f45a132a670>, signals=[15]) 2023-09-30T01:59:34.640 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging 2023-09-30T01:59:34.640 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server 2023-09-30T01:59:34.640 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-09-30T01:59:34.664 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging 2023-09-30T01:59:34.664 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server 2023-09-30T01:59:34.665 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-09-30T01:59:34.666 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /host {"name": "smithi146"} 2023-09-30T01:59:34.689 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /host {"name": "smithi155"} 2023-09-30T01:59:34.749 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-09-30T01:59:34.774 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-09-30T01:59:34.794 DEBUG:teuthology.provision.fog.smithi146:Requesting image smithi_rhel_8.4 (ID 7) 2023-09-30T01:59:34.794 DEBUG:teuthology.provision.fog.smithi146:FOG request: PUT /host/251 {"imageID": 7} 2023-09-30T01:59:34.820 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_rhel_8.4 (ID 7) 2023-09-30T01:59:34.821 DEBUG:teuthology.provision.fog.smithi155:FOG request: PUT /host/260 {"imageID": 7} 2023-09-30T01:59:34.847 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of rhel 8.4 2023-09-30T01:59:34.847 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-09-30T01:59:34.869 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of rhel 8.4 2023-09-30T01:59:34.869 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-30T01:59:34.916 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /tasktype {"name": "deploy"} 2023-09-30T01:59:34.925 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /tasktype {"name": "deploy"} 2023-09-30T01:59:34.953 DEBUG:teuthology.provision.fog.smithi146:FOG request: POST /host/251/task {"taskTypeID": 1} 2023-09-30T01:59:34.976 DEBUG:teuthology.provision.fog.smithi155:FOG request: POST /host/260/task {"taskTypeID": 1} 2023-09-30T01:59:35.017 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-09-30T01:59:35.040 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-30T01:59:35.114 INFO:teuthology.orchestra.console.smithi146:Power off 2023-09-30T01:59:35.115 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T01:59:35.133 INFO:teuthology.orchestra.console.smithi155:Power off 2023-09-30T01:59:35.133 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T01:59:35.141 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-09-30T01:59:35.141 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T01:59:35.155 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-09-30T01:59:35.156 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T01:59:35.165 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-09-30T01:59:35.180 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-09-30T01:59:35.266 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-09-30T01:59:35.281 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-09-30T01:59:35.367 INFO:teuthology.orchestra.console.smithi146:Power on 2023-09-30T01:59:35.368 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-30T01:59:35.382 INFO:teuthology.orchestra.console.smithi155:Power on 2023-09-30T01:59:35.382 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-30T01:59:35.391 DEBUG:teuthology.orchestra.console.smithi146:power on output: Chassis Power Control: Up/On 2023-09-30T01:59:35.392 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T01:59:35.404 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On 2023-09-30T01:59:35.405 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T01:59:35.414 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-09-30T01:59:35.427 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-09-30T01:59:39.418 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T01:59:39.428 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T01:59:39.527 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-09-30T01:59:39.536 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-09-30T01:59:39.636 INFO:teuthology.orchestra.console.smithi155:Power on completed 2023-09-30T01:59:39.737 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2023-09-30T01:59:39.737 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-30T01:59:43.531 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T01:59:43.640 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-09-30T01:59:43.741 INFO:teuthology.orchestra.console.smithi146:Power on completed 2023-09-30T01:59:43.841 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2023-09-30T01:59:43.842 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-09-30T01:59:54.834 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-30T01:59:58.922 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-09-30T02:00:09.922 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-30T02:00:14.010 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-09-30T02:00:25.022 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-30T02:00:29.090 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-09-30T02:00:40.094 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-30T02:00:44.170 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-09-30T02:00:55.179 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-30T02:00:59.238 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-09-30T02:01:10.272 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-30T02:01:14.318 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-09-30T02:01:25.362 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-30T02:01:29.390 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-09-30T02:01:40.434 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-30T02:01:44.477 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-09-30T02:01:55.514 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-30T02:01:59.546 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-09-30T02:02:10.586 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-30T02:02:14.626 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-09-30T02:02:25.670 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-30T02:02:29.704 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-09-30T02:02:29.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:02:40.756 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-30T02:02:40.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:02:48.319 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-09-30T02:02:54.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:02:57.402 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-09-30T02:02:59.326 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-09-30T02:03:03.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:03:05.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:03:06.458 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-09-30T02:03:08.410 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-09-30T02:03:12.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:03:14.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:03:15.514 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-09-30T02:03:17.470 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-09-30T02:03:21.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:03:23.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:03:24.574 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-09-30T02:03:26.554 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-09-30T02:03:30.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:03:32.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:03:35.610 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-09-30T02:03:41.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:04:30.627 WARNING:teuthology.provision.fog.smithi146:timed out 2023-09-30T02:04:36.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:04:36.860 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-30T02:04:36.860 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-30T02:04:37.106 INFO:teuthology.provision.fog.smithi146:Node is ready 2023-09-30T02:04:37.106 DEBUG:teuthology.orchestra.run.smithi146:> hostname 2023-09-30T02:04:37.161 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2023-09-30T02:04:37.161 DEBUG:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts 2023-09-30T02:04:37.216 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2023-09-30T02:04:37.217 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-09-30T02:04:37.326 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts 2023-09-30T02:04:37.351 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts 2023-09-30T02:04:37.415 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname 2023-09-30T02:04:37.479 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-09-30T02:04:37.542 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-09-30T02:04:37.596 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Red Hat Enterprise Linux" 2023-09-30T02:04:37.597 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8.4 (Ootpa)" 2023-09-30T02:04:37.597 INFO:teuthology.orchestra.run.smithi146.stdout:ID="rhel" 2023-09-30T02:04:37.597 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="fedora" 2023-09-30T02:04:37.597 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8.4" 2023-09-30T02:04:37.597 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2023-09-30T02:04:37.597 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-30T02:04:37.597 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-09-30T02:04:37.597 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-30T02:04:37.597 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.redhat.com/" 2023-09-30T02:04:37.597 INFO:teuthology.orchestra.run.smithi146.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-30T02:04:37.598 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T02:04:37.598 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-09-30T02:04:37.598 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T02:04:37.598 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-30T02:04:37.598 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-30T02:04:37.598 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-30T02:04:37.599 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2023-09-30T02:04:37.600 DEBUG:teuthology.parallel:result is None 2023-09-30T02:04:41.619 WARNING:teuthology.provision.fog.smithi155:timed out 2023-09-30T02:04:47.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:04:47.930 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-30T02:04:47.931 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-30T02:04:48.183 INFO:teuthology.provision.fog.smithi155:Node is ready 2023-09-30T02:04:48.183 DEBUG:teuthology.orchestra.run.smithi155:> hostname 2023-09-30T02:04:48.198 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2023-09-30T02:04:48.198 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts 2023-09-30T02:04:48.253 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2023-09-30T02:04:48.253 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-09-30T02:04:48.372 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts 2023-09-30T02:04:48.397 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts 2023-09-30T02:04:48.461 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname 2023-09-30T02:04:48.525 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-09-30T02:04:48.588 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-09-30T02:04:48.642 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Red Hat Enterprise Linux" 2023-09-30T02:04:48.642 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8.4 (Ootpa)" 2023-09-30T02:04:48.642 INFO:teuthology.orchestra.run.smithi155.stdout:ID="rhel" 2023-09-30T02:04:48.642 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="fedora" 2023-09-30T02:04:48.642 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8.4" 2023-09-30T02:04:48.642 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2023-09-30T02:04:48.643 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-30T02:04:48.643 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-09-30T02:04:48.643 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-30T02:04:48.643 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.redhat.com/" 2023-09-30T02:04:48.643 INFO:teuthology.orchestra.run.smithi155.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-30T02:04:48.643 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T02:04:48.643 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-09-30T02:04:48.643 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T02:04:48.643 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-30T02:04:48.643 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-30T02:04:48.643 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-30T02:04:48.644 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2023-09-30T02:04:48.644 DEBUG:teuthology.parallel:result is None 2023-09-30T02:04:48.816 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2023-09-30T02:04:48.817 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-30T02:04:48.835 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2023-09-30T02:04:48.835 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-30T02:04:48.853 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2023-09-30T02:04:48.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-09-30T02:04:48.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:04:48.919 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-09-30T02:04:49.037 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-09-30T02:04:49.037 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-09-30T02:04:49.092 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-09-30T02:04:49.093 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-09-30T02:04:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Red Hat Enterprise Linux" 2023-09-30T02:04:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8.4 (Ootpa)" 2023-09-30T02:04:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ID="rhel" 2023-09-30T02:04:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="fedora" 2023-09-30T02:04:49.147 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8.4" 2023-09-30T02:04:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2023-09-30T02:04:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-30T02:04:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-09-30T02:04:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-30T02:04:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.redhat.com/" 2023-09-30T02:04:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-30T02:04:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T02:04:49.148 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-09-30T02:04:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T02:04:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-30T02:04:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-30T02:04:49.148 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-30T02:04:49.149 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-09-30T02:04:49.185 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2023-09-30T02:04:49.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-09-30T02:04:49.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T02:04:49.250 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-09-30T02:04:49.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-09-30T02:04:49.312 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-09-30T02:04:49.366 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-09-30T02:04:49.366 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-09-30T02:04:49.419 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Red Hat Enterprise Linux" 2023-09-30T02:04:49.420 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8.4 (Ootpa)" 2023-09-30T02:04:49.420 INFO:teuthology.orchestra.run.smithi155.stdout:ID="rhel" 2023-09-30T02:04:49.420 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="fedora" 2023-09-30T02:04:49.420 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8.4" 2023-09-30T02:04:49.420 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2023-09-30T02:04:49.420 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-30T02:04:49.420 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-09-30T02:04:49.420 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-30T02:04:49.420 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.redhat.com/" 2023-09-30T02:04:49.420 INFO:teuthology.orchestra.run.smithi155.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-30T02:04:49.420 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T02:04:49.420 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-09-30T02:04:49.421 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T02:04:49.421 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-30T02:04:49.421 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-30T02:04:49.421 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-30T02:04:49.421 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-09-30T02:04:49.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T02:04:49.529 INFO:teuthology.dispatcher.supervisor:Running job 7407231 2023-09-30T02:04:49.530 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407231 --name yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} -- /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407231/orig.config.yaml 2023-09-30T02:04:49.533 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407231 2023-09-30T02:04:49.533 INFO:teuthology.dispatcher.supervisor:Job PID: 227459 2023-09-30T02:04:49.533 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-30T02:06:49.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T02:08:49.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T02:10:49.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T02:12:50.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T02:14:50.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T02:16:50.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T02:18:50.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T02:20:50.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T02:22:50.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T02:24:51.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T02:26:51.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T02:28:51.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T02:30:51.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T02:30:51.710 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-30T02:30:51.813 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-30T02:30:51.814 INFO:teuthology.nuke:Checking targets against current locks 2023-09-30T02:30:51.861 DEBUG:teuthology.nuke:shortname: smithi146 2023-09-30T02:30:51.861 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T02:30:51.882 DEBUG:teuthology.nuke:shortname: smithi155 2023-09-30T02:30:51.883 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T02:30:51.887 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407231', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 01:59:33.638122', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCDVxpQENV1NYiVth/uMSPrdwYHekCtvoN4vuh+fM/nssTXBryKGeA1qGMgG5gGaSpSWqGTal+E0CnkJ0s4/sYE='} 2023-09-30T02:30:51.904 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407231', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 01:59:33.639650', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH4ebRVQclsRiOFw4Qpb1OiRv89lo61HGA7kk1yRyM/cXHo6D0vKIExa/lywedoA2Wl+jtU0HMnZX513wLj24As='} 2023-09-30T02:30:51.934 INFO:teuthology.orchestra.console.smithi146:Power off 2023-09-30T02:30:51.935 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T02:30:51.951 INFO:teuthology.orchestra.console.smithi155:Power off 2023-09-30T02:30:51.951 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T02:30:51.960 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-09-30T02:30:51.960 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T02:30:51.973 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-09-30T02:30:51.973 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T02:30:51.982 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-09-30T02:30:51.996 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-09-30T02:30:52.083 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-09-30T02:30:52.097 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-09-30T02:30:52.229 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com 2023-09-30T02:30:52.252 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com