2023-07-14T21:53:34.828 INFO:root:teuthology version: 0.0.1.dev145+gaa6a80e 2023-07-14T21:53:34.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:53:34.830 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:53:35.001 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe542f4f8b0>, signals=[15]) 2023-07-14T21:53:35.003 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-07-14T21:53:35.003 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T21:53:35.004 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-07-14T21:53:35.033 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2023-07-14T21:53:35.033 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T21:53:35.034 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-07-14T21:53:35.035 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-07-14T21:53:39.024 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /host {"name": "smithi154"} 2023-07-14T21:53:43.274 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-14T21:53:43.277 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-14T21:53:43.319 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_centos_9.stream (ID 10) 2023-07-14T21:53:43.319 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 10} 2023-07-14T21:53:43.322 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_9.stream (ID 10) 2023-07-14T21:53:43.322 DEBUG:teuthology.provision.fog.smithi154:FOG request: PUT /host/259 {"imageID": 10} 2023-07-14T21:53:43.369 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 9.stream 2023-07-14T21:53:43.370 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-14T21:53:43.372 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of centos 9.stream 2023-07-14T21:53:43.372 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-14T21:53:43.426 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T21:53:43.445 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T21:53:43.469 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-07-14T21:53:43.480 DEBUG:teuthology.provision.fog.smithi154:FOG request: POST /host/259/task {"taskTypeID": 1} 2023-07-14T21:53:43.533 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-14T21:53:43.542 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-14T21:53:43.660 INFO:teuthology.orchestra.console:Power off smithi154 2023-07-14T21:53:43.662 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T21:53:43.678 INFO:teuthology.orchestra.console:Power off smithi139 2023-07-14T21:53:43.678 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T21:53:43.689 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:53:43.701 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:53:43.811 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2023-07-14T21:53:43.823 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-07-14T21:53:43.913 INFO:teuthology.orchestra.console:Power on smithi154 2023-07-14T21:53:43.913 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T21:53:43.924 INFO:teuthology.orchestra.console:Power on smithi139 2023-07-14T21:53:43.925 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T21:53:48.939 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:53:48.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:53:52.978 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:53:53.953 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:53:54.165 INFO:teuthology.orchestra.console:Power on for smithi154 completed 2023-07-14T21:53:54.266 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2023-07-14T21:53:54.266 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-14T21:54:04.276 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:54:09.388 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:54:14.502 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:54:19.356 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-14T21:54:19.614 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:54:24.728 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:54:29.841 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T21:54:30.052 INFO:teuthology.orchestra.console:Power on for smithi139 completed 2023-07-14T21:54:30.153 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-07-14T21:54:30.154 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-14T21:54:35.161 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-14T21:54:55.252 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-14T21:54:55.254 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-14T21:55:10.320 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-14T21:55:10.321 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-14T21:55:30.396 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-14T21:55:30.397 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-14T21:55:55.476 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-14T21:55:55.477 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-14T21:56:10.552 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-14T21:56:10.553 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-14T21:56:25.624 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-14T21:56:25.626 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-14T21:56:31.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T21:56:31.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T21:56:34.864 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-14T21:56:34.865 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-14T21:56:40.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T21:56:40.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T21:56:43.920 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-14T21:56:43.956 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-14T21:56:49.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T21:56:54.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T21:56:59.937 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-14T21:57:02.992 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-14T21:57:05.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T21:57:10.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T21:57:20.953 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-14T21:57:26.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T21:57:30.032 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-14T21:57:36.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T21:58:20.996 WARNING:teuthology.provision.fog.smithi139:timed out 2023-07-14T21:58:27.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T21:58:32.225 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T21:58:32.226 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T21:58:32.540 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-07-14T21:58:32.540 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-07-14T21:58:32.555 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-07-14T21:58:32.555 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-07-14T21:58:32.611 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-07-14T21:58:32.612 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-07-14T21:58:32.725 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-07-14T21:58:32.754 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-07-14T21:58:32.822 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-07-14T21:58:32.889 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-07-14T21:58:32.955 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-07-14T21:58:33.009 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2023-07-14T21:58:33.009 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2023-07-14T21:58:33.010 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2023-07-14T21:58:33.010 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2023-07-14T21:58:33.010 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2023-07-14T21:58:33.010 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2023-07-14T21:58:33.010 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-14T21:58:33.010 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-07-14T21:58:33.010 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2023-07-14T21:58:33.011 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-14T21:58:33.011 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2023-07-14T21:58:33.011 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T21:58:33.011 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-14T21:58:33.011 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T21:58:33.012 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-07-14T21:58:33.013 DEBUG:teuthology.parallel:result is None 2023-07-14T21:58:36.044 WARNING:teuthology.provision.fog.smithi154:timed out 2023-07-14T21:58:42.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T21:58:42.347 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T21:58:42.348 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T21:58:42.714 INFO:teuthology.provision.fog.smithi154:Node is ready 2023-07-14T21:58:42.715 DEBUG:teuthology.orchestra.run.smithi154:> hostname 2023-07-14T21:58:42.729 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2023-07-14T21:58:42.730 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts 2023-07-14T21:58:42.785 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2023-07-14T21:58:42.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-07-14T21:58:42.896 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts 2023-07-14T21:58:42.925 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts 2023-07-14T21:58:42.993 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname 2023-07-14T21:58:43.060 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-07-14T21:58:43.126 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-07-14T21:58:43.181 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2023-07-14T21:58:43.181 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2023-07-14T21:58:43.181 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2023-07-14T21:58:43.181 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2023-07-14T21:58:43.182 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2023-07-14T21:58:43.182 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2023-07-14T21:58:43.182 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-14T21:58:43.182 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-07-14T21:58:43.182 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2023-07-14T21:58:43.182 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-14T21:58:43.182 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2023-07-14T21:58:43.183 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T21:58:43.183 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-14T21:58:43.183 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T21:58:43.183 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2023-07-14T21:58:43.184 DEBUG:teuthology.parallel:result is None 2023-07-14T21:58:43.344 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-07-14T21:58:43.345 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-14T21:58:43.377 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2023-07-14T21:58:43.377 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-14T21:58:43.395 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-07-14T21:58:43.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-07-14T21:58:43.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T21:58:43.477 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-07-14T21:58:43.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-07-14T21:58:43.642 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-07-14T21:58:43.697 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-07-14T21:58:43.698 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-07-14T21:58:43.752 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2023-07-14T21:58:43.753 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2023-07-14T21:58:43.753 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2023-07-14T21:58:43.753 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2023-07-14T21:58:43.753 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2023-07-14T21:58:43.754 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2023-07-14T21:58:43.754 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-14T21:58:43.754 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-07-14T21:58:43.755 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2023-07-14T21:58:43.755 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-14T21:58:43.755 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2023-07-14T21:58:43.755 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T21:58:43.756 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-14T21:58:43.756 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T21:58:43.757 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-07-14T21:58:48.793 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2023-07-14T21:58:48.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-14T21:58:48.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T21:58:48.880 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-07-14T21:58:48.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-14T21:58:48.952 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-07-14T21:58:49.009 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-07-14T21:58:49.009 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-07-14T21:58:49.065 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2023-07-14T21:58:49.066 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2023-07-14T21:58:49.066 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2023-07-14T21:58:49.066 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2023-07-14T21:58:49.066 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2023-07-14T21:58:49.067 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2023-07-14T21:58:49.067 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-14T21:58:49.067 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-07-14T21:58:49.067 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2023-07-14T21:58:49.067 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-14T21:58:49.067 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2023-07-14T21:58:49.067 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T21:58:49.067 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-14T21:58:49.068 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-14T21:58:49.068 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-07-14T21:58:53.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T21:58:53.942 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T21:58:54.071 INFO:teuthology.dispatcher.supervisor:Running job 7337861 2023-07-14T21:58:54.071 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-14_13:57:40-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337861 --name yuriw-2023-07-14_13:57:40-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi --description fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/dbench}}} -- /home/teuthworker/archive/yuriw-2023-07-14_13:57:40-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337861/orig.config.yaml 2023-07-14T21:58:54.075 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-14_13:57:40-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337861 2023-07-14T21:58:54.076 INFO:teuthology.dispatcher.supervisor:Job PID: 18198 2023-07-14T21:58:54.076 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-14T22:00:54.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T22:00:54.126 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T22:02:55.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T22:02:55.377 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T22:04:57.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T22:04:57.182 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T22:06:57.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T22:06:57.366 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T22:09:02.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T22:09:02.537 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T22:11:07.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T22:11:07.713 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T22:11:12.789 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-14T22:11:22.901 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-14T22:11:22.902 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T22:11:41.191 DEBUG:teuthology.nuke:shortname: smithi139 2023-07-14T22:11:41.192 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T22:11:46.222 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_13:57:40-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337861', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 21:53:33.998881', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGImhz0yu5o5I36WP2nH/f3W5Rdq2PuTejvIt0rqeIBRSCgD6jvN+JYFX9HuNc2aw7hH4Stwta8aHOz68gcxJTQ='} 2023-07-14T22:11:49.567 DEBUG:teuthology.nuke:shortname: smithi154 2023-07-14T22:11:49.568 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T22:11:49.602 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_13:57:40-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7337861', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 21:53:34.001161', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLxjb7PBFdYHnL6X6Zk0NzVkC+zyl0mzfnWO+szPf9bkKGJqJhxWu9I1TfBjg+pyE0VcaZ+t756MfvrOn+ZojB4='} 2023-07-14T22:11:49.668 INFO:teuthology.orchestra.console:Power off smithi154 2023-07-14T22:11:49.669 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T22:11:49.685 INFO:teuthology.orchestra.console:Power off smithi139 2023-07-14T22:11:49.686 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T22:11:49.696 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T22:11:49.708 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T22:11:49.820 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2023-07-14T22:11:49.834 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-07-14T22:11:49.981 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com 2023-07-14T22:11:49.989 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com