2023-07-27T14:11:28.858 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-27T14:11:28.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T14:11:28.859 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T14:11:29.008 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f96c7325310>, signals=[15]) 2023-07-27T14:11:29.010 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2023-07-27T14:11:29.010 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2023-07-27T14:11:29.010 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-07-27T14:11:29.037 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2023-07-27T14:11:29.037 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2023-07-27T14:11:29.037 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-07-27T14:11:29.039 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /host {"name": "smithi008"} 2023-07-27T14:11:32.519 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /host {"name": "smithi088"} 2023-07-27T14:11:47.593 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-27T14:11:52.583 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-27T14:11:52.629 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_centos_8.stream (ID 3) 2023-07-27T14:11:52.630 DEBUG:teuthology.provision.fog.smithi008:FOG request: PUT /host/114 {"imageID": 3} 2023-07-27T14:11:52.641 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_8.stream (ID 3) 2023-07-27T14:11:52.641 DEBUG:teuthology.provision.fog.smithi088:FOG request: PUT /host/193 {"imageID": 3} 2023-07-27T14:11:52.682 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 8.stream 2023-07-27T14:11:52.682 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-27T14:11:52.688 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 8.stream 2023-07-27T14:11:52.688 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-27T14:11:52.724 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /tasktype {"name": "deploy"} 2023-07-27T14:11:52.727 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /tasktype {"name": "deploy"} 2023-07-27T14:11:52.758 DEBUG:teuthology.provision.fog.smithi008:FOG request: POST /host/114/task {"taskTypeID": 1} 2023-07-27T14:11:52.761 DEBUG:teuthology.provision.fog.smithi088:FOG request: POST /host/193/task {"taskTypeID": 1} 2023-07-27T14:11:52.834 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-27T14:11:52.837 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-27T14:11:56.644 INFO:teuthology.orchestra.console:Power off smithi088 2023-07-27T14:11:56.645 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T14:11:56.659 INFO:teuthology.orchestra.console:Power off smithi008 2023-07-27T14:11:56.660 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T14:11:56.669 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-27T14:11:56.670 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:11:56.682 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-27T14:11:56.683 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:11:56.693 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T14:11:56.709 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T14:11:56.795 INFO:teuthology.orchestra.console:Power off for smithi088 completed 2023-07-27T14:11:56.895 INFO:teuthology.orchestra.console:Power on smithi088 2023-07-27T14:11:56.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-27T14:11:56.918 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-27T14:11:56.919 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:11:56.942 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T14:12:00.712 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:12:00.943 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:12:01.823 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T14:12:02.054 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T14:12:05.825 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:12:06.056 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:12:06.936 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T14:12:07.168 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T14:12:10.937 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:12:11.169 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:12:12.048 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T14:12:12.278 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T14:12:16.050 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:12:16.280 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:12:17.160 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T14:12:17.390 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T14:12:21.161 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:12:21.271 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T14:12:21.372 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2023-07-27T14:12:21.392 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:12:21.473 INFO:teuthology.orchestra.console:Power on smithi008 2023-07-27T14:12:21.474 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-27T14:12:22.501 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T14:12:26.500 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-27T14:12:26.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:12:26.509 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:12:26.621 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T14:12:26.722 INFO:teuthology.orchestra.console:Power on for smithi088 completed 2023-07-27T14:12:26.823 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2023-07-27T14:12:26.823 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-27T14:12:27.511 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T14:12:31.512 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:12:31.623 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T14:12:31.724 INFO:teuthology.orchestra.console:Power on for smithi008 completed 2023-07-27T14:12:31.825 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2023-07-27T14:12:31.826 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-27T14:12:41.888 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-27T14:12:47.792 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-27T14:12:56.952 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-27T14:13:07.872 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-27T14:13:12.948 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-27T14:13:22.940 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-27T14:13:27.996 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-27T14:13:43.020 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-27T14:13:48.029 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-27T14:14:08.112 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-27T14:14:08.113 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-27T14:14:23.187 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-27T14:14:23.188 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-27T14:14:53.267 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-27T14:14:53.269 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-27T14:14:58.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:15:01.424 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-07-27T14:15:07.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:15:13.360 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-27T14:15:18.367 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-07-27T14:15:18.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:15:21.520 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-27T14:15:24.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:15:27.444 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-07-27T14:15:27.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:15:30.576 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-27T14:15:33.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:15:36.528 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-07-27T14:15:36.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:15:39.632 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-27T14:15:42.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:15:45.588 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-07-27T14:15:45.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:15:51.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:15:53.712 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-27T14:15:54.676 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-07-27T14:15:59.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:16:00.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:16:03.760 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-07-27T14:16:09.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:16:33.140 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-07-27T14:16:39.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:16:44.576 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-27T14:16:44.577 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-27T14:16:59.719 WARNING:teuthology.provision.fog.smithi008:timed out 2023-07-27T14:17:05.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:17:10.728 INFO:teuthology.provision.fog.smithi088:Node is ready 2023-07-27T14:17:10.729 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2023-07-27T14:17:10.755 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2023-07-27T14:17:10.756 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2023-07-27T14:17:10.816 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2023-07-27T14:17:10.816 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-07-27T14:17:10.923 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2023-07-27T14:17:10.955 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2023-07-27T14:17:10.968 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-27T14:17:10.969 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-27T14:17:11.024 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2023-07-27T14:17:11.093 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-07-27T14:17:11.161 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-07-27T14:17:11.219 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2023-07-27T14:17:11.220 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2023-07-27T14:17:11.220 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2023-07-27T14:17:11.220 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2023-07-27T14:17:11.221 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2023-07-27T14:17:11.221 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-07-27T14:17:11.221 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-27T14:17:11.221 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-07-27T14:17:11.221 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-27T14:17:11.222 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2023-07-27T14:17:11.222 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T14:17:11.222 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T14:17:11.222 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-27T14:17:11.223 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2023-07-27T14:17:11.225 DEBUG:teuthology.parallel:result is None 2023-07-27T14:17:11.261 INFO:teuthology.provision.fog.smithi008:Node is ready 2023-07-27T14:17:11.261 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2023-07-27T14:17:11.284 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2023-07-27T14:17:11.285 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2023-07-27T14:17:11.346 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2023-07-27T14:17:11.347 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-07-27T14:17:11.460 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2023-07-27T14:17:11.492 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2023-07-27T14:17:11.563 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2023-07-27T14:17:11.635 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-07-27T14:17:11.710 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-07-27T14:17:11.772 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-07-27T14:17:11.772 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8" 2023-07-27T14:17:11.772 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-07-27T14:17:11.772 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-07-27T14:17:11.773 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8" 2023-07-27T14:17:11.773 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-07-27T14:17:11.773 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-27T14:17:11.773 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-07-27T14:17:11.773 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-27T14:17:11.773 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-07-27T14:17:11.773 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T14:17:11.774 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T14:17:11.774 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-27T14:17:11.774 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2023-07-27T14:17:11.775 DEBUG:teuthology.parallel:result is None 2023-07-27T14:17:31.947 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2023-07-27T14:17:31.948 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-27T14:17:36.982 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2023-07-27T14:17:36.983 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-27T14:17:42.007 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2023-07-27T14:17:42.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-07-27T14:17:42.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:17:42.078 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-07-27T14:17:42.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-07-27T14:17:42.217 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-07-27T14:17:42.280 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-07-27T14:17:42.280 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-07-27T14:17:42.341 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-07-27T14:17:42.341 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8" 2023-07-27T14:17:42.342 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-07-27T14:17:42.342 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-07-27T14:17:42.342 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8" 2023-07-27T14:17:42.342 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-07-27T14:17:42.342 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-27T14:17:42.342 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-07-27T14:17:42.342 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-27T14:17:42.343 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-07-27T14:17:42.343 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T14:17:42.343 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T14:17:42.343 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-27T14:17:42.344 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-07-27T14:17:47.372 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2023-07-27T14:17:47.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-07-27T14:17:47.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T14:17:52.443 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-07-27T14:17:52.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-07-27T14:17:52.584 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-07-27T14:17:52.643 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-07-27T14:17:52.643 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-07-27T14:17:52.702 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2023-07-27T14:17:52.702 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2023-07-27T14:17:52.703 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2023-07-27T14:17:52.703 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2023-07-27T14:17:52.703 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2023-07-27T14:17:52.704 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-07-27T14:17:52.704 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-27T14:17:52.704 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-07-27T14:17:52.705 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-27T14:17:52.705 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2023-07-27T14:17:52.705 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-27T14:17:52.706 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-27T14:17:52.706 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-27T14:17:52.707 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-07-27T14:17:57.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T14:17:57.738 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T14:18:02.844 INFO:teuthology.dispatcher.supervisor:Running job 7354409 2023-07-27T14:18:02.845 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354409 --name yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi --description fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} -- /home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354409/orig.config.yaml 2023-07-27T14:18:02.850 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354409 2023-07-27T14:18:02.851 INFO:teuthology.dispatcher.supervisor:Job PID: 19388 2023-07-27T14:18:02.851 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-27T14:20:02.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T14:20:02.950 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T14:22:05.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T14:22:05.686 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T14:24:09.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T14:24:09.482 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T14:26:14.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T14:26:14.659 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T14:28:19.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T14:28:19.841 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T14:30:25.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T14:30:25.027 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T14:32:30.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T14:32:30.242 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T14:34:35.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T14:34:35.422 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T14:36:36.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T14:36:36.562 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T14:38:41.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T14:38:41.930 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T14:40:47.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T14:40:47.141 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T14:42:52.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T14:42:52.318 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T14:42:55.564 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-07-27T14:42:55.670 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-27T14:42:55.671 INFO:teuthology.nuke:Checking targets against current locks 2023-07-27T14:42:55.712 DEBUG:teuthology.nuke:shortname: smithi008 2023-07-27T14:42:55.713 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-27T14:42:55.735 DEBUG:teuthology.nuke:shortname: smithi088 2023-07-27T14:42:55.736 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-27T14:42:55.739 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354409', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-27 14:11:28.058433', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYFIT2GQGeUo6IflTV0Mf34lno73QUiSaTddO+J9675MOhVNXMpIar0VPnpQSj7UYC6xaeVF7oMJgVBbIY7sQpqL21qVls4gPzE8erE/H0AquPUq3p4p2YiozmL7MbqlXaE0tpNhc0ixfKLkqa5f51fG4QnsMZ4VtLCyw9savdRfhVsR3MMrCRWeiJipAGRJo2O5vUaNG0lAVClVOw5hU2NJBdg7ia0trv1fW+mp2NNbU3YbxnYMVccAJlXi8afGYgnhnLsK9OEeE1nIq/+GAMphpQQRBM4Odh3LmrokqnWg89HfRgnF6o/wstuPsC2lcNra9v/Z7K4p9bDb26WrjUUAu/RYXgGgdXS3/BsBVTz3d+RTXdfWrJlBbIUHWJjC2ZqCFQ/k0Tjy/SnMRkRGiAvV1MjB0MOslDmdvsPz2MAapkk7BHX5gVWhh0/p96LsvBkiuSTsMKD0oKlJraR6Hn9c9TXlWk1pJRaLJ9sRFmyoAn0zC4pSCBrwPVIu1PqLM='} 2023-07-27T14:42:55.762 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-27_03:42:08-fs-wip-yuri10-testing-2023-07-26-0858-pacific-distro-default-smithi/7354409', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-27 14:11:28.062325', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDncLq3PnpgBtYzy/yGkt8m+PCoLrgVyX9Qr3c0VYyX4517ZJVauqjw8NBqoE2opk5JeZM+X69nTMz2Uob2TkJ/6v6Ma5Qdz8x+Xw9MT6ohHIU26Y8i1qYxXmC5WIrlD4cGyc0JbXnvCA+wK7uxL8n/tBBi8fshfbgSzV32LlqGer9mUsc2tZa3a/F+XqAVjnC7abOP2dzQCBJX8lgQcvHihPEzu05y0hZRwhCk1mqFBMCw8v17Y9FMeIr46caPxIDjc3GND1CIMfvewU7ShRfvo6+0WvPAfPqFU8lM8Mj7IVdrFYF/BuuXvzOjbQf3xX39W2JN7RGFplpw1ziVoWy22TqsmcUbhSgNNWwbl8bYopkFfkyJl4CH7VKXBuXEWGe7FF84hPFMY6B7MKpnRY754td2RXVvgUhwdF//VmMA4rXcWpXEpm4jqC67xRogqiFXiELu/I8D+axVP1oRdw/i70WCZsSY685wERp4vyVC/H6pwif2obIoDlh5ZVjMfRU='} 2023-07-27T14:42:55.794 INFO:teuthology.orchestra.console:Power off smithi008 2023-07-27T14:42:55.795 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T14:42:55.817 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-27T14:42:55.818 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:42:55.832 INFO:teuthology.orchestra.console:Power off smithi088 2023-07-27T14:42:55.833 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T14:42:55.843 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T14:42:55.854 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-27T14:42:55.854 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T14:42:55.877 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T14:42:55.945 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2023-07-27T14:42:55.978 INFO:teuthology.orchestra.console:Power off for smithi088 completed 2023-07-27T14:43:00.968 ERROR:teuthology.lock.ops:failed to unlock smithi088.front.sepia.ceph.com. reason: Cannot unlock an already-unlocked node 2023-07-27T14:43:00.997 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com