2023-09-22T18:55:01.307 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-22T18:55:01.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-22T18:55:01.441 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fedd9b22670>, signals=[15]) 2023-09-22T18:55:01.441 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2023-09-22T18:55:01.442 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2023-09-22T18:55:01.442 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-09-22T18:55:01.466 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging 2023-09-22T18:55:01.466 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server 2023-09-22T18:55:01.466 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-09-22T18:55:01.468 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /host {"name": "smithi138"} 2023-09-22T18:55:01.491 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /host {"name": "smithi164"} 2023-09-22T18:55:01.544 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-22T18:55:01.559 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-22T18:55:01.583 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_centos_8.stream (ID 3) 2023-09-22T18:55:01.583 DEBUG:teuthology.provision.fog.smithi138:FOG request: PUT /host/243 {"imageID": 3} 2023-09-22T18:55:01.602 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_centos_8.stream (ID 3) 2023-09-22T18:55:01.603 DEBUG:teuthology.provision.fog.smithi164:FOG request: PUT /host/269 {"imageID": 3} 2023-09-22T18:55:01.629 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of centos 8.stream 2023-09-22T18:55:01.629 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-09-22T18:55:01.652 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of centos 8.stream 2023-09-22T18:55:01.652 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-22T18:55:01.680 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /tasktype {"name": "deploy"} 2023-09-22T18:55:01.701 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /tasktype {"name": "deploy"} 2023-09-22T18:55:01.716 DEBUG:teuthology.provision.fog.smithi138:FOG request: POST /host/243/task {"taskTypeID": 1} 2023-09-22T18:55:01.739 DEBUG:teuthology.provision.fog.smithi164:FOG request: POST /host/269/task {"taskTypeID": 1} 2023-09-22T18:55:01.771 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-09-22T18:55:01.821 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-22T18:55:01.865 INFO:teuthology.orchestra.console.smithi138:Power off 2023-09-22T18:55:01.865 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-22T18:55:01.889 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2023-09-22T18:55:01.889 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-22T18:55:01.904 INFO:teuthology.orchestra.console.smithi164:Power off 2023-09-22T18:55:01.904 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-22T18:55:01.912 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-09-22T18:55:01.926 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2023-09-22T18:55:01.926 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-22T18:55:01.949 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-09-22T18:55:05.914 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-22T18:55:05.950 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-22T18:55:06.022 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-09-22T18:55:06.057 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-09-22T18:55:10.028 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-22T18:55:10.226 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-22T18:55:10.328 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-09-22T18:55:10.334 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-09-22T18:55:10.430 INFO:teuthology.orchestra.console.smithi138:Power off completed 2023-09-22T18:55:10.435 INFO:teuthology.orchestra.console.smithi164:Power off completed 2023-09-22T18:55:10.531 INFO:teuthology.orchestra.console.smithi138:Power on 2023-09-22T18:55:10.531 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-22T18:55:10.537 INFO:teuthology.orchestra.console.smithi164:Power on 2023-09-22T18:55:10.537 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-22T18:55:10.551 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On 2023-09-22T18:55:10.552 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-22T18:55:10.559 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On 2023-09-22T18:55:10.559 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-22T18:55:10.571 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-09-22T18:55:10.577 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-09-22T18:55:14.574 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-22T18:55:14.581 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-22T18:55:14.683 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-09-22T18:55:14.688 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-09-22T18:55:18.686 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-22T18:55:18.806 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-22T18:55:18.909 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-09-22T18:55:19.010 INFO:teuthology.orchestra.console.smithi138:Power on completed 2023-09-22T18:55:19.017 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-09-22T18:55:19.111 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2023-09-22T18:55:19.111 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-09-22T18:55:19.119 INFO:teuthology.orchestra.console.smithi164:Power on completed 2023-09-22T18:55:19.220 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2023-09-22T18:55:19.220 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-22T18:55:34.182 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-09-22T18:55:34.276 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-22T18:55:49.250 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-09-22T18:55:49.332 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-22T18:56:04.321 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-09-22T18:56:04.391 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-22T18:56:19.389 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-09-22T18:56:19.441 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-22T18:56:34.462 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-09-22T18:56:34.490 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-22T18:56:49.524 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-09-22T18:56:49.538 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-22T18:57:04.594 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-09-22T18:57:04.595 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-22T18:57:19.662 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-22T18:57:19.665 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-09-22T18:57:34.731 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-22T18:57:34.754 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-09-22T18:57:49.824 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-09-22T18:57:49.826 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-22T18:58:04.908 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-09-22T18:58:04.909 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-22T18:58:04.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-22T18:58:04.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-22T18:58:23.487 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-09-22T18:58:23.487 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-09-22T18:58:29.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-22T18:58:29.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-22T18:58:32.666 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-09-22T18:58:32.667 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-09-22T18:58:38.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-22T18:58:38.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-22T18:58:41.726 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-09-22T18:58:41.726 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-09-22T18:58:47.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-22T18:58:47.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-22T18:58:50.814 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-09-22T18:58:50.959 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-09-22T18:58:56.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-22T18:58:56.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-22T18:59:00.030 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-09-22T18:59:06.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-22T18:59:09.118 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-09-22T18:59:15.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-22T18:59:28.758 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-22T18:59:28.759 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-22T18:59:53.780 INFO:teuthology.provision.fog.smithi138:Node is ready 2023-09-22T18:59:53.780 DEBUG:teuthology.orchestra.run.smithi138:> hostname 2023-09-22T18:59:53.805 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2023-09-22T18:59:53.805 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts 2023-09-22T18:59:53.866 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2023-09-22T18:59:53.867 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-09-22T18:59:53.989 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts 2023-09-22T18:59:54.020 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts 2023-09-22T18:59:54.090 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname 2023-09-22T18:59:54.160 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-09-22T18:59:54.229 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-09-22T18:59:54.288 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2023-09-22T18:59:54.288 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8" 2023-09-22T18:59:54.288 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2023-09-22T18:59:54.288 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2023-09-22T18:59:54.288 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8" 2023-09-22T18:59:54.289 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2023-09-22T18:59:54.289 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-22T18:59:54.289 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2023-09-22T18:59:54.289 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-22T18:59:54.289 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2023-09-22T18:59:54.289 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-22T18:59:54.289 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-22T18:59:54.289 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-22T18:59:54.290 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2023-09-22T18:59:54.291 DEBUG:teuthology.parallel:result is None 2023-09-22T19:00:15.142 WARNING:teuthology.provision.fog.smithi164:timed out 2023-09-22T19:00:21.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-22T19:00:21.340 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-22T19:00:21.340 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-22T19:00:21.627 INFO:teuthology.provision.fog.smithi164:Node is ready 2023-09-22T19:00:21.627 DEBUG:teuthology.orchestra.run.smithi164:> hostname 2023-09-22T19:00:21.646 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2023-09-22T19:00:21.647 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts 2023-09-22T19:00:21.706 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2023-09-22T19:00:21.706 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-09-22T19:00:21.816 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts 2023-09-22T19:00:21.845 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts 2023-09-22T19:00:21.914 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname 2023-09-22T19:00:21.983 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-09-22T19:00:22.529 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-09-22T19:00:22.588 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2023-09-22T19:00:22.589 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8" 2023-09-22T19:00:22.589 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2023-09-22T19:00:22.589 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2023-09-22T19:00:22.589 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8" 2023-09-22T19:00:22.589 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2023-09-22T19:00:22.589 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-22T19:00:22.589 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2023-09-22T19:00:22.589 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-22T19:00:22.589 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2023-09-22T19:00:22.589 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-22T19:00:22.590 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-22T19:00:22.590 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-22T19:00:22.590 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2023-09-22T19:00:22.590 DEBUG:teuthology.parallel:result is None 2023-09-22T19:00:22.736 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2023-09-22T19:00:22.736 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-22T19:00:22.757 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2023-09-22T19:00:22.757 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-22T19:00:22.774 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2023-09-22T19:00:22.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-09-22T19:00:22.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-22T19:00:22.841 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-09-22T19:00:22.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-09-22T19:00:22.973 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2023-09-22T19:00:23.032 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2023-09-22T19:00:23.032 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-09-22T19:00:23.091 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2023-09-22T19:00:23.091 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8" 2023-09-22T19:00:23.091 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2023-09-22T19:00:23.091 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2023-09-22T19:00:23.091 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8" 2023-09-22T19:00:23.091 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2023-09-22T19:00:23.091 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-22T19:00:23.092 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2023-09-22T19:00:23.092 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-22T19:00:23.092 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2023-09-22T19:00:23.092 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-22T19:00:23.092 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-22T19:00:23.092 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-22T19:00:23.092 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-09-22T19:00:23.115 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2023-09-22T19:00:23.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-09-22T19:00:23.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-22T19:00:23.184 DEBUG:teuthology.orchestra.run.smithi164:> true 2023-09-22T19:00:23.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-09-22T19:00:23.258 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2023-09-22T19:00:23.318 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2023-09-22T19:00:23.318 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-09-22T19:00:23.378 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2023-09-22T19:00:23.378 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8" 2023-09-22T19:00:23.378 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2023-09-22T19:00:23.378 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2023-09-22T19:00:23.378 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8" 2023-09-22T19:00:23.379 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2023-09-22T19:00:23.379 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-22T19:00:23.379 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2023-09-22T19:00:23.379 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-22T19:00:23.379 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2023-09-22T19:00:23.379 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-22T19:00:23.379 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-22T19:00:23.379 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-22T19:00:23.379 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-09-22T19:00:23.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-22T19:00:23.477 INFO:teuthology.dispatcher.supervisor:Running job 7401210 2023-09-22T19:00:23.477 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-09-22_18:26:40-rgw-main-distro-default-smithi/7401210 --name cbodley-2023-09-22_18:26:40-rgw-main-distro-default-smithi --description rgw/upgrade/{1-install/pacific/{distro$/{centos_8.stream} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} -- /home/teuthworker/archive/cbodley-2023-09-22_18:26:40-rgw-main-distro-default-smithi/7401210/orig.config.yaml 2023-09-22T19:00:23.480 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-09-22_18:26:40-rgw-main-distro-default-smithi/7401210 2023-09-22T19:00:23.481 INFO:teuthology.dispatcher.supervisor:Job PID: 1898616 2023-09-22T19:00:23.481 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-22T19:02:23.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-22T19:04:23.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-22T19:06:23.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-22T19:08:24.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-22T19:10:24.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-22T19:12:24.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-22T19:14:24.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-22T19:16:24.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-22T19:18:24.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-22T19:20:24.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-22T19:22:25.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-22T19:24:25.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-22T19:26:25.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-22T19:26:25.520 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-22T19:26:25.701 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-22T19:26:25.702 INFO:teuthology.nuke:Checking targets against current locks 2023-09-22T19:26:25.744 DEBUG:teuthology.nuke:shortname: smithi138 2023-09-22T19:26:25.744 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-22T19:26:25.761 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-09-22_18:26:40-rgw-main-distro-default-smithi/7401210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-22 18:55:00.473642', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAN9kgb7G/jg/2o4DzDHrY+ef9fwaKgJbjy6HVMkyvD4WNFP5jdMQeGyjVARKUXRuBUyGfPufyJ02uaWNa3klcU='} 2023-09-22T19:26:25.768 DEBUG:teuthology.nuke:shortname: smithi164 2023-09-22T19:26:25.768 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-22T19:26:25.788 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-09-22_18:26:40-rgw-main-distro-default-smithi/7401210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-22 18:55:00.471690', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAU4ZfVXiOJkRtAE5ohhoZjqw/mxxMmxPHmu1UaG3HXs9RVPsbFSDNKr9X94vYKcnUNel9WWlv+OKzXEQ3vtweQ='} 2023-09-22T19:26:25.806 INFO:teuthology.orchestra.console.smithi138:Power off 2023-09-22T19:26:25.806 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-22T19:26:25.826 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2023-09-22T19:26:25.826 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-22T19:26:25.841 INFO:teuthology.orchestra.console.smithi164:Power off 2023-09-22T19:26:25.842 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-22T19:26:25.849 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-09-22T19:26:25.861 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2023-09-22T19:26:25.861 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-22T19:26:25.882 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-09-22T19:26:25.950 INFO:teuthology.orchestra.console.smithi138:Power off completed 2023-09-22T19:26:25.983 INFO:teuthology.orchestra.console.smithi164:Power off completed 2023-09-22T19:26:26.102 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com 2023-09-22T19:26:26.126 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com