2023-08-21T20:00:17.582 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-21T20:00:17.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:00:17.740 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc40d525310>, signals=[15]) 2023-08-21T20:00:17.741 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2023-08-21T20:00:17.742 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2023-08-21T20:00:17.742 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-08-21T20:00:17.760 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2023-08-21T20:00:17.761 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2023-08-21T20:00:17.761 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-08-21T20:00:17.762 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /host {"name": "smithi073"} 2023-08-21T20:00:17.785 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /host {"name": "smithi142"} 2023-08-21T20:00:17.836 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-21T20:00:17.843 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-21T20:00:17.883 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-21T20:00:17.883 DEBUG:teuthology.provision.fog.smithi073:FOG request: PUT /host/178 {"imageID": 5} 2023-08-21T20:00:17.886 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-21T20:00:17.886 DEBUG:teuthology.provision.fog.smithi142:FOG request: PUT /host/247 {"imageID": 5} 2023-08-21T20:00:17.931 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of rhel 8.6 2023-08-21T20:00:17.931 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:00:17.935 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of rhel 8.6 2023-08-21T20:00:17.936 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:00:18.083 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /tasktype {"name": "deploy"} 2023-08-21T20:00:18.090 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /tasktype {"name": "deploy"} 2023-08-21T20:00:18.122 DEBUG:teuthology.provision.fog.smithi142:FOG request: POST /host/247/task {"taskTypeID": 1} 2023-08-21T20:00:18.125 DEBUG:teuthology.provision.fog.smithi073:FOG request: POST /host/178/task {"taskTypeID": 1} 2023-08-21T20:00:18.176 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:00:18.181 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:00:18.364 INFO:teuthology.orchestra.console.smithi073:Power off 2023-08-21T20:00:18.365 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T20:00:18.384 INFO:teuthology.orchestra.console.smithi142:Power off 2023-08-21T20:00:18.385 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T20:00:18.395 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-08-21T20:00:18.396 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T20:00:18.408 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-08-21T20:00:18.409 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T20:00:18.419 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-08-21T20:00:18.431 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-08-21T20:00:22.424 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T20:00:22.435 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T20:00:22.537 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-08-21T20:00:22.546 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-08-21T20:00:26.542 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T20:00:26.551 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T20:00:26.653 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-08-21T20:00:26.663 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-08-21T20:00:26.754 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-08-21T20:00:26.764 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-08-21T20:00:26.856 INFO:teuthology.orchestra.console.smithi073:Power on 2023-08-21T20:00:26.856 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-21T20:00:26.867 INFO:teuthology.orchestra.console.smithi142:Power on 2023-08-21T20:00:26.868 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-21T20:00:26.880 DEBUG:teuthology.orchestra.console.smithi073:power on output: Chassis Power Control: Up/On 2023-08-21T20:00:26.881 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T20:00:26.893 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On 2023-08-21T20:00:26.893 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T20:00:26.904 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-08-21T20:00:26.918 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-08-21T20:00:30.908 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T20:00:30.919 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T20:00:31.019 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-08-21T20:00:31.030 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-08-21T20:00:35.026 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T20:00:35.036 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T20:00:35.142 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-08-21T20:00:35.146 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-08-21T20:00:35.243 INFO:teuthology.orchestra.console.smithi073:Power on completed 2023-08-21T20:00:35.248 INFO:teuthology.orchestra.console.smithi142:Power on completed 2023-08-21T20:00:35.345 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2023-08-21T20:00:35.346 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:00:35.350 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2023-08-21T20:00:35.350 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:00:50.484 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:00:50.487 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:01:05.640 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:01:05.641 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:01:20.780 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:01:20.782 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:01:35.940 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:01:35.942 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:01:51.144 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:01:51.146 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:02:06.380 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:02:06.381 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:02:21.572 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:02:21.573 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:02:36.761 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:02:36.763 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:02:51.956 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:02:51.957 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:03:07.140 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:03:07.142 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:03:22.320 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:03:22.321 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:03:37.508 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:03:37.509 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:03:52.664 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:03:52.666 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-08-21T20:03:52.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:03:55.856 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-08-21T20:04:01.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:04:04.916 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-08-21T20:04:07.808 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:04:10.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:04:14.000 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-08-21T20:04:20.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:04:22.939 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-08-21T20:04:23.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:04:23.056 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-08-21T20:04:26.096 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-08-21T20:04:29.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:04:32.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:04:32.112 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-08-21T20:04:35.152 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-08-21T20:04:38.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:04:41.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:04:41.168 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-08-21T20:04:44.208 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-08-21T20:04:47.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:04:50.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:04:53.264 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-08-21T20:04:59.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:05:02.324 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-08-21T20:05:05.521 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-08-21T20:05:08.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:05:11.408 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-08-21T20:05:11.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:05:14.576 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-08-21T20:05:17.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:05:20.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:05:23.146 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-21T20:05:23.147 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-21T20:05:23.559 INFO:teuthology.provision.fog.smithi073:Node is ready 2023-08-21T20:05:23.562 DEBUG:teuthology.orchestra.run.smithi073:> hostname 2023-08-21T20:05:23.584 INFO:teuthology.orchestra.run.smithi073.stdout:smithi022 2023-08-21T20:05:23.585 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi022 /etc/hosts 2023-08-21T20:05:23.644 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-08-21T20:05:23.645 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-08-21T20:05:23.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi022/smithi073/g' /etc/hosts 2023-08-21T20:05:23.774 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.22/172.21.15.73/g' /etc/hosts 2023-08-21T20:05:23.842 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi022/smithi073/g' /etc/hostname 2023-08-21T20:05:23.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-08-21T20:05:23.976 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-08-21T20:05:24.035 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux" 2023-08-21T20:05:24.035 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.6 (Ootpa)" 2023-08-21T20:05:24.035 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel" 2023-08-21T20:05:24.035 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora" 2023-08-21T20:05:24.035 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.6" 2023-08-21T20:05:24.035 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-08-21T20:05:24.036 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-21T20:05:24.036 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-08-21T20:05:24.036 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-21T20:05:24.036 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/" 2023-08-21T20:05:24.036 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-21T20:05:24.036 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T20:05:24.037 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-21T20:05:24.037 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T20:05:24.037 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-21T20:05:24.037 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-21T20:05:24.037 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-21T20:05:24.038 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2023-08-21T20:05:24.039 DEBUG:teuthology.parallel:result is None 2023-08-21T20:06:17.472 WARNING:teuthology.provision.fog.smithi142:timed out 2023-08-21T20:06:23.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:06:23.804 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-21T20:06:23.804 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-21T20:06:24.151 INFO:teuthology.provision.fog.smithi142:Node is ready 2023-08-21T20:06:24.152 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2023-08-21T20:06:24.173 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142 2023-08-21T20:06:24.173 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142 /etc/hosts 2023-08-21T20:06:24.229 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2023-08-21T20:06:24.230 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-08-21T20:06:24.360 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142/smithi142/g' /etc/hosts 2023-08-21T20:06:24.390 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2023-08-21T20:06:24.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142/smithi142/g' /etc/hostname 2023-08-21T20:06:24.526 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-08-21T20:06:24.597 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-08-21T20:06:24.662 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2023-08-21T20:06:24.663 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)" 2023-08-21T20:06:24.663 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2023-08-21T20:06:24.663 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2023-08-21T20:06:24.663 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6" 2023-08-21T20:06:24.664 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-08-21T20:06:24.664 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-21T20:06:24.669 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-08-21T20:06:24.669 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-21T20:06:24.669 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2023-08-21T20:06:24.670 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-21T20:06:24.670 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T20:06:24.670 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-21T20:06:24.670 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T20:06:24.670 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-21T20:06:24.670 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-21T20:06:24.670 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-21T20:06:24.671 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2023-08-21T20:06:24.672 DEBUG:teuthology.parallel:result is None 2023-08-21T20:06:24.893 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2023-08-21T20:06:24.894 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-21T20:06:24.926 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2023-08-21T20:06:24.927 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-21T20:06:24.958 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2023-08-21T20:06:24.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-08-21T20:06:24.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:06:25.034 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-08-21T20:06:25.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-08-21T20:06:25.126 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-08-21T20:06:25.184 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-08-21T20:06:25.185 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-08-21T20:06:25.243 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux" 2023-08-21T20:06:25.244 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.6 (Ootpa)" 2023-08-21T20:06:25.244 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel" 2023-08-21T20:06:25.244 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora" 2023-08-21T20:06:25.244 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.6" 2023-08-21T20:06:25.244 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-08-21T20:06:25.245 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-21T20:06:25.245 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-08-21T20:06:25.246 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-21T20:06:25.246 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/" 2023-08-21T20:06:25.246 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-21T20:06:25.246 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T20:06:25.246 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-08-21T20:06:25.246 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T20:06:25.246 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-21T20:06:25.247 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-21T20:06:25.247 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-21T20:06:25.248 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-08-21T20:06:25.273 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2023-08-21T20:06:25.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-08-21T20:06:25.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T20:06:25.349 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-08-21T20:06:25.425 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-08-21T20:06:25.425 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-08-21T20:06:25.483 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-08-21T20:06:25.484 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-08-21T20:06:25.544 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2023-08-21T20:06:25.544 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)" 2023-08-21T20:06:25.544 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2023-08-21T20:06:25.545 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2023-08-21T20:06:25.545 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6" 2023-08-21T20:06:25.545 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-08-21T20:06:25.545 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-21T20:06:25.545 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-08-21T20:06:25.545 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-21T20:06:25.545 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2023-08-21T20:06:25.546 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-21T20:06:25.546 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-21T20:06:25.546 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-08-21T20:06:25.546 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-21T20:06:25.546 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-21T20:06:25.546 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-21T20:06:25.546 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-21T20:06:25.547 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-08-21T20:06:25.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:06:25.667 INFO:teuthology.dispatcher.supervisor:Running job 7374226 2023-08-21T20:06:25.667 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-08-21_19:58:11-rgw-main-distro-default-smithi/7374226 --name cbodley-2023-08-21_19:58:11-rgw-main-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rhel_8} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} -- /home/teuthworker/archive/cbodley-2023-08-21_19:58:11-rgw-main-distro-default-smithi/7374226/orig.config.yaml 2023-08-21T20:06:25.672 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-08-21_19:58:11-rgw-main-distro-default-smithi/7374226 2023-08-21T20:06:25.673 INFO:teuthology.dispatcher.supervisor:Job PID: 6814 2023-08-21T20:06:25.673 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-21T20:08:25.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:10:25.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:12:26.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:14:26.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:16:26.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:18:27.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:20:27.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:22:27.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:24:27.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:26:27.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:28:27.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:30:28.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:32:28.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:34:28.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:36:28.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:38:28.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:40:29.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:42:29.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:44:29.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:46:29.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T20:46:29.578 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-21T20:46:29.736 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-21T20:46:29.736 INFO:teuthology.nuke:Checking targets against current locks 2023-08-21T20:46:29.785 DEBUG:teuthology.nuke:shortname: smithi073 2023-08-21T20:46:29.786 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-21T20:46:29.804 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-08-21_19:58:11-rgw-main-distro-default-smithi/7374226', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 20:00:16.725052', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-21T20:46:29.810 DEBUG:teuthology.nuke:shortname: smithi142 2023-08-21T20:46:29.810 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-21T20:46:29.831 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-08-21_19:58:11-rgw-main-distro-default-smithi/7374226', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 20:00:16.722403', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-21T20:46:29.851 INFO:teuthology.orchestra.console.smithi073:Power off 2023-08-21T20:46:29.852 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T20:46:29.873 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-08-21T20:46:29.874 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T20:46:29.892 INFO:teuthology.orchestra.console.smithi142:Power off 2023-08-21T20:46:29.893 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T20:46:29.903 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-08-21T20:46:29.914 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-08-21T20:46:29.915 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T20:46:29.935 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-08-21T20:46:30.004 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-08-21T20:46:30.037 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-08-21T20:46:30.152 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com 2023-08-21T20:46:30.185 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com