2023-07-21T03:43:13.736 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T03:43:13.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T03:43:13.738 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T03:43:13.896 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f67bb607ee0>, signals=[15]) 2023-07-21T03:43:13.898 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2023-07-21T03:43:13.898 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T03:43:13.899 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-07-21T03:43:13.925 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2023-07-21T03:43:13.925 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T03:43:13.926 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-07-21T03:43:13.927 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"} 2023-07-21T03:43:13.950 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /host {"name": "smithi086"} 2023-07-21T03:43:14.009 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-21T03:43:14.012 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-21T03:43:14.055 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_9.stream (ID 10) 2023-07-21T03:43:14.056 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 10} 2023-07-21T03:43:14.064 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_centos_9.stream (ID 10) 2023-07-21T03:43:14.065 DEBUG:teuthology.provision.fog.smithi086:FOG request: PUT /host/191 {"imageID": 10} 2023-07-21T03:43:14.105 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of centos 9.stream 2023-07-21T03:43:14.106 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-21T03:43:14.109 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 9.stream 2023-07-21T03:43:14.110 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-21T03:43:14.171 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T03:43:14.174 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T03:43:14.206 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1} 2023-07-21T03:43:14.209 DEBUG:teuthology.provision.fog.smithi086:FOG request: POST /host/191/task {"taskTypeID": 1} 2023-07-21T03:43:14.265 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-21T03:43:14.269 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-21T03:43:14.371 INFO:teuthology.orchestra.console:Power off smithi086 2023-07-21T03:43:14.372 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T03:43:14.385 INFO:teuthology.orchestra.console:Power off smithi062 2023-07-21T03:43:14.386 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T03:43:14.393 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T03:43:14.406 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T03:43:14.515 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2023-07-21T03:43:14.526 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2023-07-21T03:43:14.617 INFO:teuthology.orchestra.console:Power on smithi086 2023-07-21T03:43:14.617 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T03:43:14.627 INFO:teuthology.orchestra.console:Power on smithi062 2023-07-21T03:43:14.628 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T03:43:14.639 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T03:43:14.649 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T03:43:18.664 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T03:43:18.672 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T03:43:18.875 INFO:teuthology.orchestra.console:Power on for smithi086 completed 2023-07-21T03:43:18.977 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2023-07-21T03:43:18.977 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-21T03:43:22.786 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T03:43:22.995 INFO:teuthology.orchestra.console:Power on for smithi062 completed 2023-07-21T03:43:23.096 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2023-07-21T03:43:23.097 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-21T03:43:34.070 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-21T03:43:39.077 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-21T03:43:56.344 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-21T03:43:56.345 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-21T03:44:25.118 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-21T03:44:25.120 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-21T03:44:42.911 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-21T03:44:42.912 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-21T03:45:08.004 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-21T03:45:08.005 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-21T03:45:23.084 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-21T03:45:23.085 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-21T03:45:47.072 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-07-21T03:45:47.074 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-21T03:45:57.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T03:46:00.144 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-21T03:46:06.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T03:46:09.232 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-21T03:46:12.068 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-21T03:46:15.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T03:46:23.312 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-21T03:46:27.132 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-21T03:46:29.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T03:46:37.396 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-21T03:46:42.192 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-21T03:46:47.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T03:47:07.271 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-21T03:47:07.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T03:47:10.484 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-21T03:47:10.576 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-21T03:47:16.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T03:47:16.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T03:47:19.572 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-21T03:47:19.632 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-07-21T03:47:25.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T03:47:25.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T03:47:25.856 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T03:47:25.857 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T03:47:28.660 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-21T03:47:34.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T03:47:42.736 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-21T03:47:46.229 INFO:teuthology.provision.fog.smithi086:Node is ready 2023-07-21T03:47:46.229 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2023-07-21T03:47:46.249 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com 2023-07-21T03:47:46.250 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086.front.sepia.ceph.com /etc/hosts 2023-07-21T03:47:46.306 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2023-07-21T03:47:46.307 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-07-21T03:47:46.437 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hosts 2023-07-21T03:47:46.469 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts 2023-07-21T03:47:46.542 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hostname 2023-07-21T03:47:46.611 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-07-21T03:47:46.679 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-07-21T03:47:46.734 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2023-07-21T03:47:46.734 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2023-07-21T03:47:46.735 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2023-07-21T03:47:46.735 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2023-07-21T03:47:46.735 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2023-07-21T03:47:46.735 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2023-07-21T03:47:46.735 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T03:47:46.735 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-07-21T03:47:46.735 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2023-07-21T03:47:46.736 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T03:47:46.736 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2023-07-21T03:47:46.736 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T03:47:46.736 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T03:47:46.737 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T03:47:46.738 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2023-07-21T03:47:46.740 DEBUG:teuthology.parallel:result is None 2023-07-21T03:47:48.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T03:48:53.804 WARNING:teuthology.provision.fog.smithi062:timed out 2023-07-21T03:48:59.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T03:49:05.075 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T03:49:05.075 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T03:49:05.434 INFO:teuthology.provision.fog.smithi062:Node is ready 2023-07-21T03:49:05.434 DEBUG:teuthology.orchestra.run.smithi062:> hostname 2023-07-21T03:49:05.448 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2023-07-21T03:49:05.449 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts 2023-07-21T03:49:05.505 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2023-07-21T03:49:05.505 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-07-21T03:49:05.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts 2023-07-21T03:49:05.664 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts 2023-07-21T03:49:05.736 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname 2023-07-21T03:49:05.807 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-07-21T03:49:05.878 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-07-21T03:49:05.933 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2023-07-21T03:49:05.933 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2023-07-21T03:49:05.933 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2023-07-21T03:49:05.933 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2023-07-21T03:49:05.933 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2023-07-21T03:49:05.933 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2023-07-21T03:49:05.934 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T03:49:05.934 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-07-21T03:49:05.934 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2023-07-21T03:49:05.934 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T03:49:05.934 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2023-07-21T03:49:05.934 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T03:49:05.934 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T03:49:05.935 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T03:49:05.935 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2023-07-21T03:49:05.935 DEBUG:teuthology.parallel:result is None 2023-07-21T03:49:07.685 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2023-07-21T03:49:07.686 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T03:49:07.706 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2023-07-21T03:49:07.706 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T03:49:07.724 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2023-07-21T03:49:07.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-07-21T03:49:07.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T03:49:07.826 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-07-21T03:49:07.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-07-21T03:49:07.897 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-07-21T03:49:07.952 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-07-21T03:49:07.953 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-07-21T03:49:08.010 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2023-07-21T03:49:08.010 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2023-07-21T03:49:08.010 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2023-07-21T03:49:08.010 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2023-07-21T03:49:08.010 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2023-07-21T03:49:08.011 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2023-07-21T03:49:08.011 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T03:49:08.011 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-07-21T03:49:08.011 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2023-07-21T03:49:08.011 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T03:49:08.011 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2023-07-21T03:49:08.011 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T03:49:08.011 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T03:49:08.012 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T03:49:08.012 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-07-21T03:49:08.033 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2023-07-21T03:49:08.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-07-21T03:49:08.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T03:49:08.120 DEBUG:teuthology.orchestra.run.smithi086:> true 2023-07-21T03:49:08.294 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-07-21T03:49:08.295 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2023-07-21T03:49:08.348 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2023-07-21T03:49:08.349 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-07-21T03:49:08.402 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2023-07-21T03:49:08.403 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2023-07-21T03:49:08.403 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2023-07-21T03:49:08.403 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2023-07-21T03:49:08.403 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2023-07-21T03:49:08.403 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2023-07-21T03:49:08.404 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T03:49:08.404 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-07-21T03:49:08.404 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2023-07-21T03:49:08.404 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T03:49:08.404 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2023-07-21T03:49:08.404 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T03:49:08.405 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T03:49:08.405 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T03:49:08.405 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-07-21T03:49:08.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T03:49:08.431 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T03:49:08.542 INFO:teuthology.dispatcher.supervisor:Running job 7345716 2023-07-21T03:49:08.542 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7345716 --name yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}} -- /home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7345716/orig.config.yaml 2023-07-21T03:49:08.546 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7345716 2023-07-21T03:49:08.547 INFO:teuthology.dispatcher.supervisor:Job PID: 5992 2023-07-21T03:49:08.547 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-21T03:51:08.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T03:51:08.647 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T03:53:13.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T03:53:13.837 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T03:53:18.911 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-21T03:53:21.650 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-21T03:53:21.651 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T03:53:21.691 DEBUG:teuthology.nuke:shortname: smithi062 2023-07-21T03:53:21.692 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T03:53:21.719 DEBUG:teuthology.nuke:shortname: smithi086 2023-07-21T03:53:21.720 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T03:53:21.724 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7345716', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 03:43:02.932367', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA6KKGLK+sEiwJCI6uFeJoII52306haw7gtbrgCDKDHT5cik2nKDwCpEMsrWgK5XdNv4zZjPFEW3vZJQKgVGiEg='} 2023-07-21T03:53:21.749 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7345716', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 03:43:02.930286', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDs7PsvryBqHSP4efSjNUZumPXRQ8ug/Z1Q/x8dG0Jazn5lGAPiGvExkHqjEH/MasiA4waV8zvdIYxnQAdwOqzM='} 2023-07-21T03:53:31.802 INFO:teuthology.orchestra.console:Power off smithi062 2023-07-21T03:53:31.803 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T03:53:31.826 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T03:53:31.850 INFO:teuthology.orchestra.console:Power off smithi086 2023-07-21T03:53:31.851 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T03:53:31.874 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T03:53:31.961 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2023-07-21T03:53:31.996 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2023-07-21T03:53:32.118 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com 2023-07-21T03:53:32.150 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com