2023-08-22T06:38:09.952 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-22T06:38:09.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T06:38:10.094 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f83462bef70>, signals=[15]) 2023-08-22T06:38:10.096 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging 2023-08-22T06:38:10.096 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server 2023-08-22T06:38:10.097 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-08-22T06:38:10.121 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2023-08-22T06:38:10.121 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2023-08-22T06:38:10.122 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-08-22T06:38:10.124 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /host {"name": "smithi078"} 2023-08-22T06:38:10.146 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"} 2023-08-22T06:38:10.196 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-08-22T06:38:10.232 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_rhel_8.4 (ID 7) 2023-08-22T06:38:10.233 DEBUG:teuthology.provision.fog.smithi078:FOG request: PUT /host/183 {"imageID": 7} 2023-08-22T06:38:10.466 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of rhel 8.4 2023-08-22T06:38:10.466 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-08-22T06:38:10.469 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-08-22T06:38:10.530 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_rhel_8.4 (ID 7) 2023-08-22T06:38:10.530 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 7} 2023-08-22T06:38:10.552 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /tasktype {"name": "deploy"} 2023-08-22T06:38:10.575 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of rhel 8.4 2023-08-22T06:38:10.576 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-22T06:38:10.584 DEBUG:teuthology.provision.fog.smithi078:FOG request: POST /host/183/task {"taskTypeID": 1} 2023-08-22T06:38:10.639 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"} 2023-08-22T06:38:10.648 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-08-22T06:38:10.672 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1} 2023-08-22T06:38:10.737 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-22T06:38:10.750 INFO:teuthology.orchestra.console.smithi078:Power off 2023-08-22T06:38:10.751 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-22T06:38:10.778 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-08-22T06:38:10.778 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T06:38:10.804 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-08-22T06:38:10.846 INFO:teuthology.orchestra.console.smithi112:Power off 2023-08-22T06:38:10.847 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-22T06:38:10.871 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-08-22T06:38:10.871 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T06:38:10.894 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-22T06:38:10.905 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-08-22T06:38:10.996 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-08-22T06:38:11.007 INFO:teuthology.orchestra.console.smithi078:Power on 2023-08-22T06:38:11.007 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-22T06:38:11.029 DEBUG:teuthology.orchestra.console.smithi078:power on output: Chassis Power Control: Up/On 2023-08-22T06:38:11.030 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T06:38:11.053 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-08-22T06:38:11.097 INFO:teuthology.orchestra.console.smithi112:Power on 2023-08-22T06:38:11.098 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-22T06:38:11.121 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2023-08-22T06:38:11.122 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T06:38:11.146 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-22T06:38:15.056 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T06:38:15.147 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T06:38:15.167 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-08-22T06:38:15.259 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-22T06:38:15.268 INFO:teuthology.orchestra.console.smithi078:Power on completed 2023-08-22T06:38:15.369 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2023-08-22T06:38:15.370 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-08-22T06:38:19.264 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T06:38:19.375 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-08-22T06:38:19.476 INFO:teuthology.orchestra.console.smithi112:Power on completed 2023-08-22T06:38:19.577 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2023-08-22T06:38:19.578 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-22T06:38:30.463 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-08-22T06:38:34.656 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-22T06:38:45.544 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-08-22T06:38:49.748 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-22T06:39:00.640 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-08-22T06:39:04.836 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-22T06:39:15.732 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-08-22T06:39:19.912 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-22T06:39:30.820 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-08-22T06:39:34.988 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-22T06:39:45.920 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-08-22T06:39:50.064 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-22T06:40:01.024 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-08-22T06:40:05.136 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-22T06:40:16.104 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-08-22T06:40:20.221 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-22T06:40:31.200 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-08-22T06:40:35.300 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-22T06:40:46.292 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-08-22T06:40:50.372 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-22T06:41:01.392 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-08-22T06:41:01.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:41:04.560 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-08-22T06:41:05.450 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-22T06:41:05.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:41:08.592 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-22T06:41:10.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:41:13.619 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-08-22T06:41:14.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:41:17.652 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-22T06:41:19.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:41:22.704 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-08-22T06:41:23.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:41:26.704 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-22T06:41:28.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:41:31.760 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-08-22T06:41:32.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:41:35.760 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-22T06:41:37.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:41:40.820 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-08-22T06:41:41.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:41:44.816 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-22T06:41:46.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:41:49.908 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-08-22T06:41:50.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:41:55.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:42:14.260 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-08-22T06:42:20.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:42:23.344 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-08-22T06:42:29.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:42:32.400 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-08-22T06:42:38.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:42:39.095 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-22T06:42:39.096 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-22T06:42:50.821 WARNING:teuthology.provision.fog.smithi112:timed out 2023-08-22T06:42:55.162 INFO:teuthology.provision.fog.smithi078:Node is ready 2023-08-22T06:42:55.162 DEBUG:teuthology.orchestra.run.smithi078:> hostname 2023-08-22T06:42:55.177 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com 2023-08-22T06:42:55.178 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi078.front.sepia.ceph.com /etc/hosts 2023-08-22T06:42:55.232 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2023-08-22T06:42:55.233 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-08-22T06:42:55.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hosts 2023-08-22T06:42:55.454 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts 2023-08-22T06:42:55.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hostname 2023-08-22T06:42:55.585 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-08-22T06:42:55.655 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-08-22T06:42:55.712 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2023-08-22T06:42:55.712 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.4 (Ootpa)" 2023-08-22T06:42:55.713 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2023-08-22T06:42:55.713 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2023-08-22T06:42:55.713 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.4" 2023-08-22T06:42:55.713 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2023-08-22T06:42:55.714 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-22T06:42:55.714 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-08-22T06:42:55.714 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-22T06:42:55.714 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2023-08-22T06:42:55.715 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-22T06:42:55.715 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-22T06:42:55.715 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-22T06:42:55.716 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-22T06:42:55.716 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-22T06:42:55.716 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-22T06:42:55.717 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-22T06:42:55.718 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2023-08-22T06:42:55.721 DEBUG:teuthology.parallel:result is None 2023-08-22T06:42:56.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:42:57.093 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-22T06:42:57.093 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-22T06:42:57.371 INFO:teuthology.provision.fog.smithi112:Node is ready 2023-08-22T06:42:57.371 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2023-08-22T06:42:57.389 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112 2023-08-22T06:42:57.390 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112 /etc/hosts 2023-08-22T06:42:57.443 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2023-08-22T06:42:57.444 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-08-22T06:42:57.550 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112/smithi112/g' /etc/hosts 2023-08-22T06:42:57.574 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2023-08-22T06:42:57.643 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112/smithi112/g' /etc/hostname 2023-08-22T06:42:57.710 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-08-22T06:42:57.777 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-08-22T06:42:57.835 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux" 2023-08-22T06:42:57.835 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.4 (Ootpa)" 2023-08-22T06:42:57.835 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel" 2023-08-22T06:42:57.835 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora" 2023-08-22T06:42:57.836 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.4" 2023-08-22T06:42:57.836 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2023-08-22T06:42:57.836 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-22T06:42:57.836 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-08-22T06:42:57.836 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-22T06:42:57.836 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/" 2023-08-22T06:42:57.836 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-22T06:42:57.837 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-22T06:42:57.837 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-08-22T06:42:57.837 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-22T06:42:57.837 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-22T06:42:57.837 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-22T06:42:57.838 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-22T06:42:57.838 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2023-08-22T06:42:57.839 DEBUG:teuthology.parallel:result is None 2023-08-22T06:42:57.987 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2023-08-22T06:42:57.988 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-22T06:42:58.005 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2023-08-22T06:42:58.005 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-22T06:42:58.023 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2023-08-22T06:42:58.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-08-22T06:42:58.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:42:58.089 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-08-22T06:42:58.111 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-08-22T06:42:58.112 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-08-22T06:42:58.165 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-08-22T06:42:58.165 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-08-22T06:42:58.219 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2023-08-22T06:42:58.219 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.4 (Ootpa)" 2023-08-22T06:42:58.220 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2023-08-22T06:42:58.221 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2023-08-22T06:42:58.221 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.4" 2023-08-22T06:42:58.221 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2023-08-22T06:42:58.221 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-22T06:42:58.222 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-08-22T06:42:58.222 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-22T06:42:58.222 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2023-08-22T06:42:58.222 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-22T06:42:58.222 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-22T06:42:58.222 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-08-22T06:42:58.222 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-22T06:42:58.223 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-22T06:42:58.223 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-22T06:42:58.223 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-22T06:42:58.224 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-08-22T06:42:58.247 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2023-08-22T06:42:58.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-08-22T06:42:58.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-22T06:42:58.318 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-08-22T06:42:58.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-08-22T06:42:58.338 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-08-22T06:42:58.395 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-08-22T06:42:58.395 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-08-22T06:42:58.454 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux" 2023-08-22T06:42:58.454 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.4 (Ootpa)" 2023-08-22T06:42:58.454 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel" 2023-08-22T06:42:58.454 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora" 2023-08-22T06:42:58.455 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.4" 2023-08-22T06:42:58.455 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2023-08-22T06:42:58.455 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-22T06:42:58.455 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-08-22T06:42:58.455 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-22T06:42:58.455 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/" 2023-08-22T06:42:58.455 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-22T06:42:58.455 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-22T06:42:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: 2023-08-22T06:42:58.456 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-22T06:42:58.456 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-22T06:42:58.456 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-22T06:42:58.456 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-22T06:42:58.457 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-08-22T06:42:58.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T06:42:58.575 INFO:teuthology.dispatcher.supervisor:Running job 7375326 2023-08-22T06:42:58.575 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-21_23:13:17-rgw-pacific-release-distro-default-smithi/7375326 --name yuriw-2023-08-21_23:13:17-rgw-pacific-release-distro-default-smithi --description rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/three-zones supported-random-distro$/{rhel_8} tasks/test_multi} -- /home/teuthworker/archive/yuriw-2023-08-21_23:13:17-rgw-pacific-release-distro-default-smithi/7375326/orig.config.yaml 2023-08-22T06:42:58.580 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-21_23:13:17-rgw-pacific-release-distro-default-smithi/7375326 2023-08-22T06:42:58.581 INFO:teuthology.dispatcher.supervisor:Job PID: 13366 2023-08-22T06:42:58.581 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-22T06:44:58.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T06:46:58.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T06:48:58.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T06:50:59.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T06:52:59.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T06:54:59.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T06:56:59.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T06:58:59.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T07:00:59.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T07:03:00.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-22T07:03:00.208 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-22T07:03:00.347 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-22T07:03:00.348 INFO:teuthology.nuke:Checking targets against current locks 2023-08-22T07:03:00.389 DEBUG:teuthology.nuke:shortname: smithi078 2023-08-22T07:03:00.389 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-22T07:03:00.408 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-21_23:13:17-rgw-pacific-release-distro-default-smithi/7375326', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-22 06:38:09.115200', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKgWKonnSw+VI0TWqd9bA3/knyylqjo9L76nC2a4TiQV201LwSjDdqkzZNK8Jd4ai8rx9GoeosSmLXyru1nwE1k='} 2023-08-22T07:03:00.415 DEBUG:teuthology.nuke:shortname: smithi112 2023-08-22T07:03:00.415 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-22T07:03:00.436 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-21_23:13:17-rgw-pacific-release-distro-default-smithi/7375326', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-22 06:38:09.113266', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDv1QQrMaB2Wm5WIbtA+qGrPS6AnKPg3WLDOMDSO6Znm9xLW7pEOJ6gX6F0hLt0e+GTKx0JYL16ibujfat0OvGU4L/IGarv4XPy2y+V4WMn0nLZhiMNAz9dU64F3lEXN501DN64bOQeGtxeri020peAZ1GICooY7dUtQD19cnsbaakRy8kaR//sBvqgPxGh+xaf9xILN5V7BDhHNpQtGo7/oMg9+tReHVKliMrbBoGKt7au4f4t8bSWijDFBOw8gi0lRqnO1dQIb7fhzxEAgjZ+XaEvheAqfAURYuQOhLvRmUpat6Bj4irvWp9q4bdN+/25Bbr250Shm5SQVU7yimhXTUsnE/vWE8KMrXPT2zchDBO0xZloi48GiWO/LbmpI8F0pR51fLs9VmjhkjtOZ7QgBIrgxDNHZ8Zfz/O/l97VtAZuFWx/IUNOyJeiRf18a2PqX3lq4UWqHeiWlyTov95/Mb8kvuoFelKxpsXJmJTixAywIIGV1opCUAtI1Z6nSA0='} 2023-08-22T07:03:00.463 INFO:teuthology.orchestra.console.smithi078:Power off 2023-08-22T07:03:00.464 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-22T07:03:00.486 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-08-22T07:03:00.487 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T07:03:00.508 INFO:teuthology.orchestra.console.smithi112:Power off 2023-08-22T07:03:00.509 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-22T07:03:00.520 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-08-22T07:03:00.533 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-08-22T07:03:00.534 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-22T07:03:00.562 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-22T07:03:00.622 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-08-22T07:03:00.664 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-08-22T07:03:00.800 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com 2023-08-22T07:03:00.806 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com