2023-07-13T23:13:08.876 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-13T23:13:08.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:13:08.878 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:13:09.038 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc3d68c9ee0>, signals=[15]) 2023-07-13T23:13:09.040 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2023-07-13T23:13:09.042 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T23:13:09.042 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-07-13T23:13:09.071 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2023-07-13T23:13:09.072 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T23:13:09.072 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-07-13T23:13:09.073 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"} 2023-07-13T23:13:09.096 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /host {"name": "smithi193"} 2023-07-13T23:13:09.157 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-13T23:13:09.167 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-13T23:13:09.202 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_8.stream (ID 3) 2023-07-13T23:13:09.203 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 3} 2023-07-13T23:13:09.213 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_centos_8.stream (ID 3) 2023-07-13T23:13:09.213 DEBUG:teuthology.provision.fog.smithi193:FOG request: PUT /host/298 {"imageID": 3} 2023-07-13T23:13:09.255 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 8.stream 2023-07-13T23:13:09.255 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-13T23:13:09.258 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of centos 8.stream 2023-07-13T23:13:09.258 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-13T23:13:09.306 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T23:13:09.313 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T23:13:09.341 DEBUG:teuthology.provision.fog.smithi193:FOG request: POST /host/298/task {"taskTypeID": 1} 2023-07-13T23:13:09.349 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1} 2023-07-13T23:13:09.389 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-13T23:13:09.392 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-13T23:13:09.480 INFO:teuthology.orchestra.console:Power off smithi062 2023-07-13T23:13:09.481 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:13:09.495 INFO:teuthology.orchestra.console:Power off smithi193 2023-07-13T23:13:09.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:13:09.506 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:13:09.518 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:13:13.532 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:13:13.542 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:13:17.646 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:13:17.656 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:13:17.866 INFO:teuthology.orchestra.console:Power off for smithi193 completed 2023-07-13T23:13:17.967 INFO:teuthology.orchestra.console:Power on smithi193 2023-07-13T23:13:17.967 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T23:13:17.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:13:21.760 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:13:21.971 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2023-07-13T23:13:22.020 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:13:22.073 INFO:teuthology.orchestra.console:Power on smithi062 2023-07-13T23:13:22.074 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T23:13:22.094 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:13:26.120 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:13:26.133 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:13:26.344 INFO:teuthology.orchestra.console:Power on for smithi193 completed 2023-07-13T23:13:26.445 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2023-07-13T23:13:26.446 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-13T23:13:30.232 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:13:30.442 INFO:teuthology.orchestra.console:Power on for smithi062 completed 2023-07-13T23:13:30.543 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2023-07-13T23:13:30.544 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-13T23:13:41.516 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-13T23:13:45.620 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-13T23:13:56.612 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-13T23:14:00.696 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-13T23:14:11.692 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-13T23:14:15.784 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-13T23:14:26.772 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-13T23:14:30.856 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-13T23:14:41.860 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-13T23:14:45.944 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-13T23:14:56.944 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-13T23:15:01.040 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-13T23:15:12.048 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-13T23:15:16.132 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-13T23:15:27.168 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-13T23:15:31.236 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-13T23:15:42.268 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-13T23:15:46.340 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-13T23:15:57.392 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-13T23:16:01.444 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-13T23:16:12.508 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-13T23:16:12.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:16:15.664 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-13T23:16:16.543 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-13T23:16:16.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:16:19.696 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-13T23:16:21.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:16:24.720 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-13T23:16:25.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:16:28.756 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-13T23:16:30.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:16:33.776 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-13T23:16:34.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:16:37.840 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-13T23:16:39.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:16:42.832 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-13T23:16:43.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:16:46.896 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-13T23:16:48.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:16:51.888 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-13T23:16:52.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:16:55.952 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-13T23:16:57.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:17:00.948 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-13T23:17:01.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:17:05.008 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-13T23:17:06.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:17:11.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:17:14.068 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-13T23:17:20.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:18:06.996 WARNING:teuthology.provision.fog.smithi193:timed out 2023-07-13T23:18:13.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:18:13.269 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T23:18:13.270 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T23:18:13.517 INFO:teuthology.provision.fog.smithi193:Node is ready 2023-07-13T23:18:13.517 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2023-07-13T23:18:13.537 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com 2023-07-13T23:18:13.537 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts 2023-07-13T23:18:13.596 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-07-13T23:18:13.596 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-07-13T23:18:13.698 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts 2023-07-13T23:18:13.726 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts 2023-07-13T23:18:13.793 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname 2023-07-13T23:18:13.861 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-07-13T23:18:13.928 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-07-13T23:18:13.985 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2023-07-13T23:18:13.986 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8" 2023-07-13T23:18:13.986 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2023-07-13T23:18:13.986 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2023-07-13T23:18:13.986 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8" 2023-07-13T23:18:13.986 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:18:13.986 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T23:18:13.987 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-07-13T23:18:13.987 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T23:18:13.987 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2023-07-13T23:18:13.987 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:18:13.987 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:18:13.987 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T23:18:13.988 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2023-07-13T23:18:13.989 DEBUG:teuthology.parallel:result is None 2023-07-13T23:18:20.080 WARNING:teuthology.provision.fog.smithi062:timed out 2023-07-13T23:18:26.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:18:26.344 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T23:18:26.344 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T23:18:26.620 INFO:teuthology.provision.fog.smithi062:Node is ready 2023-07-13T23:18:26.621 DEBUG:teuthology.orchestra.run.smithi062:> hostname 2023-07-13T23:18:26.640 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2023-07-13T23:18:26.640 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts 2023-07-13T23:18:26.699 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2023-07-13T23:18:26.699 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-07-13T23:18:26.828 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts 2023-07-13T23:18:26.858 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts 2023-07-13T23:18:26.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname 2023-07-13T23:18:26.994 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-07-13T23:18:27.061 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-07-13T23:18:27.119 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2023-07-13T23:18:27.119 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8" 2023-07-13T23:18:27.119 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2023-07-13T23:18:27.119 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2023-07-13T23:18:27.119 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8" 2023-07-13T23:18:27.119 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:18:27.120 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T23:18:27.120 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-07-13T23:18:27.120 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T23:18:27.120 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2023-07-13T23:18:27.120 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:18:27.120 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:18:27.120 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T23:18:27.121 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2023-07-13T23:18:27.121 DEBUG:teuthology.parallel:result is None 2023-07-13T23:18:27.277 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2023-07-13T23:18:27.278 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T23:18:27.300 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2023-07-13T23:18:27.301 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T23:18:27.318 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2023-07-13T23:18:27.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-07-13T23:18:27.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:18:27.386 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-07-13T23:18:27.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-07-13T23:18:27.454 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-07-13T23:18:27.511 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-07-13T23:18:27.512 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-07-13T23:18:27.569 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2023-07-13T23:18:27.569 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8" 2023-07-13T23:18:27.570 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2023-07-13T23:18:27.570 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2023-07-13T23:18:27.570 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8" 2023-07-13T23:18:27.570 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:18:27.570 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T23:18:27.570 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-07-13T23:18:27.571 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T23:18:27.571 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2023-07-13T23:18:27.571 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:18:27.571 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:18:27.571 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T23:18:27.572 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-07-13T23:18:27.600 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2023-07-13T23:18:27.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-07-13T23:18:27.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:18:27.668 DEBUG:teuthology.orchestra.run.smithi193:> true 2023-07-13T23:18:27.807 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-07-13T23:18:27.808 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2023-07-13T23:18:27.868 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2023-07-13T23:18:27.868 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-07-13T23:18:27.927 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2023-07-13T23:18:27.927 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8" 2023-07-13T23:18:27.927 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2023-07-13T23:18:27.927 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2023-07-13T23:18:27.927 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8" 2023-07-13T23:18:27.928 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:18:27.928 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T23:18:27.928 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-07-13T23:18:27.928 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T23:18:27.928 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2023-07-13T23:18:27.928 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:18:27.928 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:18:27.929 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T23:18:27.929 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-07-13T23:18:27.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:18:27.958 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:18:28.074 INFO:teuthology.dispatcher.supervisor:Running job 7336382 2023-07-13T23:18:28.074 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336382 --name rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} -- /home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336382/orig.config.yaml 2023-07-13T23:18:28.077 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336382 2023-07-13T23:18:28.078 INFO:teuthology.dispatcher.supervisor:Job PID: 14328 2023-07-13T23:18:28.078 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-13T23:20:28.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:20:28.161 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:22:28.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:22:28.333 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:24:28.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:24:28.514 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:26:28.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:26:28.687 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:28:28.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:28:28.855 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:30:29.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:30:29.059 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:32:29.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:32:29.230 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:34:31.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:34:31.409 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:36:41.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:36:41.594 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:38:42.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:38:42.342 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:40:46.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:40:46.357 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:42:51.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:42:51.535 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:43:01.612 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-13T23:43:08.927 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-13T23:43:08.928 INFO:teuthology.nuke:Checking targets against current locks 2023-07-13T23:43:08.976 DEBUG:teuthology.nuke:shortname: smithi062 2023-07-13T23:43:08.976 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T23:43:09.001 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336382', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 23:13:08.029391', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAp/y5059BaN74lnyCV/5ZkejOkHpOFW5AMUUu25YS7F9VReTaj4XZazcyk0CXi3CZyGsqryH9b5v4EzDc+7IL4='} 2023-07-13T23:43:09.003 DEBUG:teuthology.nuke:shortname: smithi193 2023-07-13T23:43:09.004 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T23:43:09.029 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336382', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 23:13:08.030943', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSrWBohkApgzSTCLvRwDJKzIuTpAtMkNb7OavIoYhJGWAX3PrUAZt21DKXVYWXi2lNwcEuekjV4tVHPsP9ZyHR44kqcAIPAXTRUMhvg7tozdCxouWKudGTfdPnMazaEnWTetR4LR1Cq0iqv02Jk1Q+Q6nc4dDxtK3uTJR51h4JMCep0OoGfurECVLLFl9rnjBGBrXc3yHif84EnzioTVyPcbn33WHzvl78nBpYwELqBGhirpuK3LZJ6v9AMXDUoOrH0eXwJrgcbdyY+dCRhxq1VKKtSzHhf40SkJ5t268DRkpV39rMkQwZCaBPbvbMlZVWixbTsYUU7SuOkqnPZKGgXFv+6BjHahNXxojH2+6xV4iZNde52MQb1ubi+03jmEX6siDHtwj0vwas7AFnxLnRNwcfX62XJCEL1n0+fzxV9k41H9e32H7GrcZJ9mP/zPPv7zAck9jlL0llLvBvuupmkC+XIehVcWtfnKmMHnZVLlXswuCTfVq75/WcmXHV7ME='} 2023-07-13T23:43:09.070 INFO:teuthology.orchestra.console:Power off smithi062 2023-07-13T23:43:09.072 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:43:14.062 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:43:14.097 INFO:teuthology.orchestra.console:Power off smithi193 2023-07-13T23:43:14.098 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:43:14.120 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:43:14.245 INFO:teuthology.orchestra.console:Power off for smithi193 completed 2023-07-13T23:43:14.492 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com 2023-07-13T23:43:19.076 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:43:19.287 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2023-07-13T23:43:28.280 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com