2023-09-02T01:33:23.965 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-02T01:33:23.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:33:24.150 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7d526c5ee0>, signals=[15]) 2023-09-02T01:33:24.151 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging 2023-09-02T01:33:24.152 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server 2023-09-02T01:33:24.152 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-09-02T01:33:24.171 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2023-09-02T01:33:24.172 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2023-09-02T01:33:24.172 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-09-02T01:33:24.173 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /host {"name": "smithi121"} 2023-09-02T01:33:24.195 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /host {"name": "smithi129"} 2023-09-02T01:33:24.255 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-02T01:33:24.265 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-02T01:33:24.296 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_centos_9.stream (ID 10) 2023-09-02T01:33:24.297 DEBUG:teuthology.provision.fog.smithi121:FOG request: PUT /host/226 {"imageID": 10} 2023-09-02T01:33:24.303 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_9.stream (ID 10) 2023-09-02T01:33:24.303 DEBUG:teuthology.provision.fog.smithi129:FOG request: PUT /host/234 {"imageID": 10} 2023-09-02T01:33:24.343 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 9.stream 2023-09-02T01:33:24.343 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-02T01:33:24.350 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of centos 9.stream 2023-09-02T01:33:24.351 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-09-02T01:33:24.438 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /tasktype {"name": "deploy"} 2023-09-02T01:33:24.443 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /tasktype {"name": "deploy"} 2023-09-02T01:33:24.485 DEBUG:teuthology.provision.fog.smithi129:FOG request: POST /host/234/task {"taskTypeID": 1} 2023-09-02T01:33:24.489 DEBUG:teuthology.provision.fog.smithi121:FOG request: POST /host/226/task {"taskTypeID": 1} 2023-09-02T01:33:24.539 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-02T01:33:24.552 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-09-02T01:33:24.657 INFO:teuthology.orchestra.console.smithi129:Power off 2023-09-02T01:33:24.658 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T01:33:24.671 INFO:teuthology.orchestra.console.smithi121:Power off 2023-09-02T01:33:24.672 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T01:33:24.679 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-09-02T01:33:24.679 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:33:24.691 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2023-09-02T01:33:24.692 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:33:24.700 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-09-02T01:33:24.712 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-09-02T01:33:24.801 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-09-02T01:33:24.813 INFO:teuthology.orchestra.console.smithi121:Power off completed 2023-09-02T01:33:24.903 INFO:teuthology.orchestra.console.smithi129:Power on 2023-09-02T01:33:24.903 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-02T01:33:24.914 INFO:teuthology.orchestra.console.smithi121:Power on 2023-09-02T01:33:24.915 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-02T01:33:24.922 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2023-09-02T01:33:24.923 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:33:24.934 DEBUG:teuthology.orchestra.console.smithi121:power on output: Chassis Power Control: Up/On 2023-09-02T01:33:24.935 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:33:24.942 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-09-02T01:33:24.954 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-09-02T01:33:28.948 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:33:28.957 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:33:29.060 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-09-02T01:33:29.068 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-09-02T01:33:33.062 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:33:33.069 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:33:33.172 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-09-02T01:33:33.180 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2023-09-02T01:33:33.273 INFO:teuthology.orchestra.console.smithi129:Power on completed 2023-09-02T01:33:33.281 INFO:teuthology.orchestra.console.smithi121:Power on completed 2023-09-02T01:33:33.375 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2023-09-02T01:33:33.375 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-02T01:33:33.382 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2023-09-02T01:33:33.382 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-09-02T01:33:48.474 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-02T01:33:48.475 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-09-02T01:34:03.583 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-02T01:34:03.584 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-09-02T01:34:18.682 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-09-02T01:34:18.683 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-02T01:34:33.771 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-02T01:34:33.772 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-09-02T01:34:48.854 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-09-02T01:34:48.855 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-02T01:35:03.938 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-02T01:35:03.939 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-09-02T01:35:19.018 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-02T01:35:19.019 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-09-02T01:35:34.114 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-09-02T01:35:34.115 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-02T01:35:49.180 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-09-02T01:35:49.184 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-02T01:36:04.254 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-09-02T01:36:04.256 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-02T01:36:04.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:36:04.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:36:07.386 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-09-02T01:36:07.387 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-09-02T01:36:13.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:36:13.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:36:16.478 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-09-02T01:36:16.478 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-09-02T01:36:22.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:36:22.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:36:25.562 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-09-02T01:36:25.563 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-09-02T01:36:31.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:36:31.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:36:34.618 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-09-02T01:36:34.619 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-09-02T01:36:40.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:36:40.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:36:43.678 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-09-02T01:36:43.710 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-09-02T01:36:49.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:36:49.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:36:52.762 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-09-02T01:36:52.762 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-09-02T01:36:58.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:36:58.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:37:58.826 WARNING:teuthology.provision.fog.smithi129:timed out 2023-09-02T01:37:58.828 WARNING:teuthology.provision.fog.smithi121:timed out 2023-09-02T01:38:04.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:38:04.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:38:05.040 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-02T01:38:05.041 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-02T01:38:05.057 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-02T01:38:05.058 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-02T01:38:05.352 INFO:teuthology.provision.fog.smithi129:Node is ready 2023-09-02T01:38:05.353 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2023-09-02T01:38:05.367 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2023-09-02T01:38:05.367 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2023-09-02T01:38:05.386 INFO:teuthology.provision.fog.smithi121:Node is ready 2023-09-02T01:38:05.387 DEBUG:teuthology.orchestra.run.smithi121:> hostname 2023-09-02T01:38:05.402 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com 2023-09-02T01:38:05.402 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121.front.sepia.ceph.com /etc/hosts 2023-09-02T01:38:05.422 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2023-09-02T01:38:05.423 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-09-02T01:38:05.457 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2023-09-02T01:38:05.458 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2023-09-02T01:38:05.538 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2023-09-02T01:38:05.567 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2023-09-02T01:38:05.567 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hosts 2023-09-02T01:38:05.597 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts 2023-09-02T01:38:05.634 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2023-09-02T01:38:05.665 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hostname 2023-09-02T01:38:05.700 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-09-02T01:38:05.732 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121 2023-09-02T01:38:05.767 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-09-02T01:38:05.798 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2023-09-02T01:38:05.821 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2023-09-02T01:38:05.821 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2023-09-02T01:38:05.821 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2023-09-02T01:38:05.821 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:38:05.822 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2023-09-02T01:38:05.822 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2023-09-02T01:38:05.822 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-02T01:38:05.822 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-09-02T01:38:05.822 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2023-09-02T01:38:05.823 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-02T01:38:05.823 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:38:05.823 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:38:05.823 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-02T01:38:05.824 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:38:05.824 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2023-09-02T01:38:05.826 DEBUG:teuthology.parallel:result is None 2023-09-02T01:38:05.852 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2023-09-02T01:38:05.852 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2023-09-02T01:38:05.853 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2023-09-02T01:38:05.853 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:38:05.853 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2023-09-02T01:38:05.853 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2023-09-02T01:38:05.854 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-02T01:38:05.854 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2023-09-02T01:38:05.854 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2023-09-02T01:38:05.854 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-02T01:38:05.854 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:38:05.855 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:38:05.855 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-02T01:38:05.855 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:38:05.856 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2023-09-02T01:38:05.857 DEBUG:teuthology.parallel:result is None 2023-09-02T01:38:06.029 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com 2023-09-02T01:38:06.029 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-02T01:38:06.089 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2023-09-02T01:38:06.089 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-02T01:38:06.115 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server 2023-09-02T01:38:06.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-09-02T01:38:06.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:38:06.197 DEBUG:teuthology.orchestra.run.smithi121:> true 2023-09-02T01:38:06.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-09-02T01:38:06.264 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2023-09-02T01:38:06.318 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2023-09-02T01:38:06.318 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2023-09-02T01:38:06.372 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2023-09-02T01:38:06.372 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2023-09-02T01:38:06.372 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2023-09-02T01:38:06.372 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:38:06.373 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2023-09-02T01:38:06.373 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2023-09-02T01:38:06.373 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-02T01:38:06.373 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2023-09-02T01:38:06.374 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2023-09-02T01:38:06.374 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-02T01:38:06.374 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:38:06.374 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:38:06.374 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-02T01:38:06.375 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:38:06.375 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-09-02T01:38:06.406 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2023-09-02T01:38:06.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-09-02T01:38:06.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:38:06.487 DEBUG:teuthology.orchestra.run.smithi129:> true 2023-09-02T01:38:06.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-09-02T01:38:06.511 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2023-09-02T01:38:06.565 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2023-09-02T01:38:06.565 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-09-02T01:38:06.618 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2023-09-02T01:38:06.619 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2023-09-02T01:38:06.619 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2023-09-02T01:38:06.619 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:38:06.619 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2023-09-02T01:38:06.620 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2023-09-02T01:38:06.620 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-02T01:38:06.620 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-09-02T01:38:06.620 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2023-09-02T01:38:06.620 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-02T01:38:06.621 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:38:06.621 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:38:06.621 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-02T01:38:06.621 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:38:06.622 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-09-02T01:38:06.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:38:06.738 INFO:teuthology.dispatcher.supervisor:Running job 7386784 2023-09-02T01:38:06.738 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386784 --name pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} -- /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386784/orig.config.yaml 2023-09-02T01:38:06.742 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386784 2023-09-02T01:38:06.743 INFO:teuthology.dispatcher.supervisor:Job PID: 957137 2023-09-02T01:38:06.743 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-02T01:40:06.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:42:07.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:44:07.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:46:07.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:48:07.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:50:07.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:52:07.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:54:08.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:56:08.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:58:08.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:00:08.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:02:08.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:04:08.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:06:09.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:08:09.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:10:09.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T02:10:10.008 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-02T02:10:10.172 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-02T02:10:10.172 INFO:teuthology.nuke:Checking targets against current locks 2023-09-02T02:10:10.220 DEBUG:teuthology.nuke:shortname: smithi121 2023-09-02T02:10:10.220 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-02T02:10:10.239 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-02 01:33:23.117080', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXSOFmlP4FOLULgdA/G29seeQZeN6DMeyaGEZ3C3sLYcNGGkY9mKPbvPrh5kqCKH4Bt81EbMVkMdhviRdMCMOUFSjuJVMnQpBQpvH0xoPNFfoKjIWkM+kvNUBiHwE/vxjmhEUj/L+0aBvEntU9yGA4WYL2ft8vnij9aU5LJ4bdKOcupOaF6jBVF51LjLEKGgaIl9XJaJwcsR44xEDm+WmaAHaQNHtZ7rlrnR8mdS0Hi50ZYXz++Ds/8JL7MWQSTxWHbGr2NhOmXFAdxY1UCNk2Rlgsb04bkzEAZtbC4cmji4Y8DP0hurpnGTgjJwvQJa42cmnFJrgWpPZj8iV8cCbhwGyZw4NAw0egE2PX4fnQf6YepvBYsy7s0nZi1FcSDhVk75a+oAhO0Rqg9eyKtO7TR/dXY3luRo1kD46dk4WSa1IbZH8PeTuTU59MMhY3lmJ4UBzSnyDx72/dl95jh1j/D+JGjVEulqnngrmsH5nlXw/LKtIw98K1Mkykzq8p4w8='} 2023-09-02T02:10:10.242 DEBUG:teuthology.nuke:shortname: smithi129 2023-09-02T02:10:10.242 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-02T02:10:10.266 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-02 01:33:23.118932', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI5HaLVPWb54HA2n3oWzhSVRAvlYmWwQxxHCfBg/fKGLvTY2PLrDDi+sWwXZm/gDE2cYlEr46ofEZ9fUSx9mfoA='} 2023-09-02T02:10:10.285 INFO:teuthology.orchestra.console.smithi121:Power off 2023-09-02T02:10:10.286 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T02:10:10.306 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2023-09-02T02:10:10.306 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T02:10:10.320 INFO:teuthology.orchestra.console.smithi129:Power off 2023-09-02T02:10:10.321 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T02:10:10.329 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-09-02T02:10:10.340 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-09-02T02:10:10.340 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T02:10:10.360 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-09-02T02:10:10.430 INFO:teuthology.orchestra.console.smithi121:Power off completed 2023-09-02T02:10:10.461 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-09-02T02:10:10.583 INFO:teuthology.lock.ops:unlocked: smithi121.front.sepia.ceph.com 2023-09-02T02:10:10.608 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com