2023-09-05T12:14:24.269 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-05T12:14:24.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:14:24.426 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd64bf0cee0>, signals=[15]) 2023-09-05T12:14:24.434 INFO:teuthology.lock.ops:Start node 'smithi087.front.sepia.ceph.com' reimaging 2023-09-05T12:14:24.435 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: reset os type and version on server 2023-09-05T12:14:24.435 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2023-09-05T12:14:24.458 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2023-09-05T12:14:24.458 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2023-09-05T12:14:24.458 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-09-05T12:14:24.460 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /host {"name": "smithi087"} 2023-09-05T12:14:24.483 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /host {"name": "smithi129"} 2023-09-05T12:14:24.531 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-05T12:14:24.564 DEBUG:teuthology.provision.fog.smithi087:Requesting image smithi_centos_9.stream (ID 10) 2023-09-05T12:14:24.565 DEBUG:teuthology.provision.fog.smithi087:FOG request: PUT /host/192 {"imageID": 10} 2023-09-05T12:14:24.573 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-05T12:14:24.614 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_9.stream (ID 10) 2023-09-05T12:14:24.614 DEBUG:teuthology.provision.fog.smithi129:FOG request: PUT /host/234 {"imageID": 10} 2023-09-05T12:14:24.622 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of centos 9.stream 2023-09-05T12:14:24.623 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-09-05T12:14:24.650 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 9.stream 2023-09-05T12:14:24.651 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-05T12:14:24.681 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /tasktype {"name": "deploy"} 2023-09-05T12:14:24.713 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /tasktype {"name": "deploy"} 2023-09-05T12:14:24.721 DEBUG:teuthology.provision.fog.smithi087:FOG request: POST /host/192/task {"taskTypeID": 1} 2023-09-05T12:14:24.749 DEBUG:teuthology.provision.fog.smithi129:FOG request: POST /host/234/task {"taskTypeID": 1} 2023-09-05T12:14:24.765 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-09-05T12:14:24.800 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-05T12:14:24.859 INFO:teuthology.orchestra.console.smithi087:Power off 2023-09-05T12:14:24.860 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T12:14:24.880 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2023-09-05T12:14:24.882 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T12:14:24.896 INFO:teuthology.orchestra.console.smithi129:Power off 2023-09-05T12:14:24.897 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T12:14:24.905 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-09-05T12:14:24.916 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-09-05T12:14:24.917 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T12:14:24.937 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-09-05T12:14:25.007 INFO:teuthology.orchestra.console.smithi087:Power off completed 2023-09-05T12:14:25.038 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-09-05T12:14:25.108 INFO:teuthology.orchestra.console.smithi087:Power on 2023-09-05T12:14:25.108 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-05T12:14:25.131 DEBUG:teuthology.orchestra.console.smithi087:power on output: Chassis Power Control: Up/On 2023-09-05T12:14:25.132 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T12:14:25.139 INFO:teuthology.orchestra.console.smithi129:Power on 2023-09-05T12:14:25.140 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-05T12:14:25.152 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-09-05T12:14:25.160 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2023-09-05T12:14:25.160 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T12:14:25.181 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-09-05T12:14:29.155 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T12:14:29.182 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T12:14:29.267 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-09-05T12:14:29.294 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-09-05T12:14:33.270 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T12:14:33.295 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T12:14:33.379 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-09-05T12:14:33.405 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-09-05T12:14:33.481 INFO:teuthology.orchestra.console.smithi087:Power on completed 2023-09-05T12:14:33.506 INFO:teuthology.orchestra.console.smithi129:Power on completed 2023-09-05T12:14:33.582 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish 2023-09-05T12:14:33.583 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-09-05T12:14:33.607 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2023-09-05T12:14:33.607 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-05T12:14:48.658 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-09-05T12:14:48.664 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-05T12:15:03.734 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-05T12:15:03.736 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-09-05T12:15:18.806 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-05T12:15:18.808 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-09-05T12:15:33.878 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-09-05T12:15:33.879 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-05T12:15:48.955 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-09-05T12:15:48.957 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-05T12:16:04.026 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-09-05T12:16:04.027 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-05T12:16:19.114 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-05T12:16:19.115 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-09-05T12:16:34.202 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-09-05T12:16:34.205 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-05T12:16:49.286 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-09-05T12:16:49.288 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-05T12:17:04.366 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-09-05T12:17:04.367 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-09-05T12:17:04.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:17:04.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:17:07.482 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-09-05T12:17:07.483 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-09-05T12:17:13.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:17:13.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:17:16.538 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-09-05T12:17:16.539 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-09-05T12:17:22.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:17:22.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:17:25.626 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-09-05T12:17:25.627 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-09-05T12:17:31.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:17:31.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:17:34.682 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-09-05T12:17:34.682 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-09-05T12:17:40.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:17:40.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:17:43.738 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-09-05T12:17:43.770 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-09-05T12:17:49.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:17:49.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:17:52.798 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-09-05T12:17:52.826 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-09-05T12:17:58.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:17:58.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:18:01.882 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-09-05T12:18:07.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:18:58.859 WARNING:teuthology.provision.fog.smithi087:timed out 2023-09-05T12:19:04.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:19:05.125 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-05T12:19:05.126 DEBUG:teuthology.orchestra.run.smithi087:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-05T12:19:05.437 INFO:teuthology.provision.fog.smithi087:Node is ready 2023-09-05T12:19:05.437 DEBUG:teuthology.orchestra.run.smithi087:> hostname 2023-09-05T12:19:05.452 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087.front.sepia.ceph.com 2023-09-05T12:19:05.453 DEBUG:teuthology.orchestra.run.smithi087:> grep smithi087.front.sepia.ceph.com /etc/hosts 2023-09-05T12:19:05.507 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087 2023-09-05T12:19:05.508 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2023-09-05T12:19:05.615 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hosts 2023-09-05T12:19:05.644 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/172.21.15.87/172.21.15.87/g' /etc/hosts 2023-09-05T12:19:05.712 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hostname 2023-09-05T12:19:05.780 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2023-09-05T12:19:05.846 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2023-09-05T12:19:05.901 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2023-09-05T12:19:05.901 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2023-09-05T12:19:05.901 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2023-09-05T12:19:05.901 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2023-09-05T12:19:05.902 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2023-09-05T12:19:05.902 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2023-09-05T12:19:05.902 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-05T12:19:05.902 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2023-09-05T12:19:05.903 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2023-09-05T12:19:05.903 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-05T12:19:05.903 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2023-09-05T12:19:05.903 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-05T12:19:05.903 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-05T12:19:05.904 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-05T12:19:05.904 INFO:teuthology.provision.fog.smithi087:Deploy complete! 2023-09-05T12:19:05.906 DEBUG:teuthology.parallel:result is None 2023-09-05T12:19:07.890 WARNING:teuthology.provision.fog.smithi129:timed out 2023-09-05T12:19:13.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:19:14.142 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-05T12:19:14.143 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-05T12:19:14.450 INFO:teuthology.provision.fog.smithi129:Node is ready 2023-09-05T12:19:14.450 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2023-09-05T12:19:14.464 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2023-09-05T12:19:14.465 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2023-09-05T12:19:14.520 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2023-09-05T12:19:14.521 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-09-05T12:19:14.624 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2023-09-05T12:19:14.652 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2023-09-05T12:19:14.719 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2023-09-05T12:19:14.786 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-09-05T12:19:14.854 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-09-05T12:19:14.909 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2023-09-05T12:19:14.910 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2023-09-05T12:19:14.910 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2023-09-05T12:19:14.910 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2023-09-05T12:19:14.910 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2023-09-05T12:19:14.911 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2023-09-05T12:19:14.911 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-05T12:19:14.911 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-09-05T12:19:14.911 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2023-09-05T12:19:14.911 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-05T12:19:14.911 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2023-09-05T12:19:14.912 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-05T12:19:14.912 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-05T12:19:14.912 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-05T12:19:14.912 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2023-09-05T12:19:14.913 DEBUG:teuthology.parallel:result is None 2023-09-05T12:19:15.075 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com 2023-09-05T12:19:15.076 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-05T12:19:15.094 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2023-09-05T12:19:15.095 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-05T12:19:15.112 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server 2023-09-05T12:19:15.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-09-05T12:19:15.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:19:15.197 DEBUG:teuthology.orchestra.run.smithi087:> true 2023-09-05T12:19:15.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-09-05T12:19:15.269 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2023-09-05T12:19:15.324 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2023-09-05T12:19:15.324 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2023-09-05T12:19:15.378 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2023-09-05T12:19:15.378 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2023-09-05T12:19:15.379 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2023-09-05T12:19:15.379 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2023-09-05T12:19:15.379 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2023-09-05T12:19:15.379 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2023-09-05T12:19:15.379 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-05T12:19:15.380 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2023-09-05T12:19:15.380 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2023-09-05T12:19:15.380 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-05T12:19:15.380 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2023-09-05T12:19:15.380 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-05T12:19:15.381 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-05T12:19:15.381 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-05T12:19:15.381 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2023-09-05T12:19:15.403 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2023-09-05T12:19:15.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-09-05T12:19:15.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T12:19:15.528 DEBUG:teuthology.orchestra.run.smithi129:> true 2023-09-05T12:19:15.592 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-09-05T12:19:15.592 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2023-09-05T12:19:15.646 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2023-09-05T12:19:15.647 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-09-05T12:19:15.701 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2023-09-05T12:19:15.701 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2023-09-05T12:19:15.701 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2023-09-05T12:19:15.703 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2023-09-05T12:19:15.703 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2023-09-05T12:19:15.703 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2023-09-05T12:19:15.704 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-05T12:19:15.704 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-09-05T12:19:15.704 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2023-09-05T12:19:15.704 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-05T12:19:15.705 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2023-09-05T12:19:15.705 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-05T12:19:15.705 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-05T12:19:15.705 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-05T12:19:15.706 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-09-05T12:19:15.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:19:15.828 INFO:teuthology.dispatcher.supervisor:Running job 7388301 2023-09-05T12:19:15.828 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388301 --name mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} -- /home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388301/orig.config.yaml 2023-09-05T12:19:15.833 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388301 2023-09-05T12:19:15.834 INFO:teuthology.dispatcher.supervisor:Job PID: 4149443 2023-09-05T12:19:15.834 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-05T12:21:15.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:23:16.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:25:16.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:27:16.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:29:16.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:31:16.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:33:16.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:35:17.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:37:17.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:39:17.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:41:17.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:43:17.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:45:17.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:47:18.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:49:18.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:51:18.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:53:18.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:55:18.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T12:55:18.932 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-05T12:55:19.135 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-05T12:55:19.136 INFO:teuthology.nuke:Checking targets against current locks 2023-09-05T12:55:19.183 DEBUG:teuthology.nuke:shortname: smithi087 2023-09-05T12:55:19.184 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-05T12:55:19.212 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388301', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-05 12:14:23.409777', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzpOWeH21z2NmWATC4s2E6VKqoHS2gmwyliV/m8dCmRBCB6UaKggSfJwwLKYwJcSTo2bkffpNrPOJVojCMmhrtuAV2alrNN63GbTZoEoucfss3Mg1hfw1xUsn3h25ixEkurk6VShZhyvQVpnwTFh4ixijZt/MJ0Ovh24x0ED6MlDf1bviogpAANGOWWHGwOm0QabFdCP2o7ZgYYPSa0eYIqAKQg8LQMwIZoni/09hpa7sBikWs/CXSFq9E/zZzEYvJqDD544xHuquqTEf5xbsnLFklgQ6PEjm2Viof/GXSGOPr4MsdkrTLcMIMb2ur+sLRCZJr7paZJ2Eo54eEBrb6wiB74JygIyzidZzwHi8eT2KE5nwHqWwcwjMgoo9N0L+8Nfzs5I09K0jxYzE7qgmsWAjdA2T4khpwqvMEX3Bve8NjUmBNxTC1RKupf6kI24BLWFZcwFAdgPpCwSiKORM1hmnKi+5R7boonZIwkVUROkpQn/Pj8VkJhae+aGkpXaE='} 2023-09-05T12:55:19.215 DEBUG:teuthology.nuke:shortname: smithi129 2023-09-05T12:55:19.216 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-05T12:55:19.240 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388301', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-05 12:14:23.411397', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/WdtkjmWTKuTIQ4lRu5IEhuQdrZZJSzfTdnHX/U5HBGXGY+OTW/jaGtNrH6WnOhF7SW/tfEHpbdxLCKWDtu1/VhLsKlG7KRNCm91Wq9he/8B7iPL8M4LyazllIRjrK2TILkHgLfqc0MGEhOXOxN32Tp0Qi27C7MArN8AUYY++oqCy5eqkB9WY54MoiMRNNzLI8BGj0vLe9f97BGhJpwQKBxhip3mj2QQM92XX1mU1kZ802J0W6d/ZJbSPnAVF2pqHUvwWE6VDkRZg6KipdAgPGtSLtr6LJfCMpfplbkcp1ozWQh3Cdg2Tr9n3yp4DL/vngLOhfVSgbFRycHzcxJTkza35l6XvQfYYALIT1uLXMObNu6WNhldT1Pw2OGI662ojOt/K7oArw0rfrpA+eNCGxi+4jjV0ygzFcTrVvpy4ElJgdEnkgqismPjqLgsdTDtWdK5Eqo55zih55UB4jb3DPccR+ZjPh1KSCDZM0ZTAS4fLyTM0q8Sy19fkykkt9ks='} 2023-09-05T12:55:19.269 INFO:teuthology.orchestra.console.smithi087:Power off 2023-09-05T12:55:19.270 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T12:55:19.295 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2023-09-05T12:55:19.295 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T12:55:19.312 INFO:teuthology.orchestra.console.smithi129:Power off 2023-09-05T12:55:19.312 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T12:55:19.321 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-09-05T12:55:19.333 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-09-05T12:55:19.334 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T12:55:19.354 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-09-05T12:55:19.422 INFO:teuthology.orchestra.console.smithi087:Power off completed 2023-09-05T12:55:19.456 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-09-05T12:55:19.580 INFO:teuthology.lock.ops:unlocked: smithi087.front.sepia.ceph.com 2023-09-05T12:55:19.596 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com