2023-07-18T04:04:19.156 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-18T04:04:19.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T04:04:19.158 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T04:04:19.325 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbd926038b0>, signals=[15]) 2023-07-18T04:04:19.327 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging 2023-07-18T04:04:19.327 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server 2023-07-18T04:04:19.328 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-07-18T04:04:19.356 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-07-18T04:04:19.357 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-07-18T04:04:19.357 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-07-18T04:04:19.358 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /host {"name": "smithi144"} 2023-07-18T04:04:19.381 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"} 2023-07-18T04:04:19.435 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-18T04:04:19.449 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-18T04:04:19.476 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_centos_9.stream (ID 10) 2023-07-18T04:04:19.476 DEBUG:teuthology.provision.fog.smithi144:FOG request: PUT /host/249 {"imageID": 10} 2023-07-18T04:04:19.490 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_9.stream (ID 10) 2023-07-18T04:04:19.490 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 10} 2023-07-18T04:04:19.521 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of centos 9.stream 2023-07-18T04:04:19.521 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-18T04:04:19.529 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 9.stream 2023-07-18T04:04:19.529 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-18T04:04:19.566 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /tasktype {"name": "deploy"} 2023-07-18T04:04:19.572 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"} 2023-07-18T04:04:19.600 DEBUG:teuthology.provision.fog.smithi144:FOG request: POST /host/249/task {"taskTypeID": 1} 2023-07-18T04:04:19.618 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1} 2023-07-18T04:04:19.652 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-18T04:04:19.666 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-18T04:04:19.745 INFO:teuthology.orchestra.console:Power off smithi144 2023-07-18T04:04:19.746 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T04:04:19.765 INFO:teuthology.orchestra.console:Power off smithi169 2023-07-18T04:04:19.766 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T04:04:19.776 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:04:19.789 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:04:23.804 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:04:23.823 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:04:27.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:04:27.935 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:04:32.036 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:04:32.046 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:04:32.249 INFO:teuthology.orchestra.console:Power off for smithi144 completed 2023-07-18T04:04:32.258 INFO:teuthology.orchestra.console:Power off for smithi169 completed 2023-07-18T04:04:32.350 INFO:teuthology.orchestra.console:Power on smithi144 2023-07-18T04:04:32.351 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-18T04:04:32.360 INFO:teuthology.orchestra.console:Power on smithi169 2023-07-18T04:04:32.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-18T04:04:32.373 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:04:32.383 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:04:36.400 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:04:36.411 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:04:40.518 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:04:40.530 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:04:40.746 INFO:teuthology.orchestra.console:Power on for smithi169 completed 2023-07-18T04:04:40.838 INFO:teuthology.orchestra.console:Power on for smithi144 completed 2023-07-18T04:04:40.848 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-07-18T04:04:40.848 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-18T04:04:40.939 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish 2023-07-18T04:04:40.940 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-18T04:04:55.916 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-18T04:04:56.002 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-18T04:05:10.992 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-18T04:05:11.067 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-18T04:05:26.068 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-18T04:05:26.130 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-18T04:05:41.168 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-18T04:05:41.213 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-18T04:05:56.280 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-18T04:05:56.291 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-18T04:06:11.380 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-18T04:06:11.382 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-18T04:06:26.469 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-18T04:06:26.470 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-18T04:06:41.560 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-18T04:06:41.561 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-18T04:06:56.660 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-18T04:06:56.661 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-18T04:07:11.780 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-18T04:07:11.782 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-07-18T04:07:11.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T04:07:11.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T04:07:11.944 ERROR:teuthology.orchestra.connection:Error authenticating with smithi169.front.sepia.ceph.com: Authentication failed. 2023-07-18T04:07:11.946 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-18T04:07:11.946 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-18T04:07:11.947 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-18T04:07:14.928 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-07-18T04:07:20.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T04:07:23.984 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-07-18T04:07:29.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T04:07:33.040 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-07-18T04:07:39.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T04:07:42.096 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-07-18T04:07:48.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T04:07:51.156 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-07-18T04:07:57.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T04:08:00.208 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-07-18T04:08:06.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T04:08:09.270 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-07-18T04:08:15.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T04:09:04.368 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-18T04:09:04.370 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi169 2023-07-18T04:09:13.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-07-18T04:09:13.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T04:09:13.726 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-07-18T04:09:14.010 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-07-18T04:09:14.010 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-18T04:09:14.010 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-18T04:09:15.274 WARNING:teuthology.provision.fog.smithi144:timed out 2023-07-18T04:09:19.025 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-07-18T04:09:19.026 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-07-18T04:09:19.043 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2023-07-18T04:09:19.044 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2023-07-18T04:09:19.101 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-07-18T04:09:19.101 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-07-18T04:09:19.226 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2023-07-18T04:09:19.257 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-07-18T04:09:19.326 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2023-07-18T04:09:19.394 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-07-18T04:09:19.462 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-07-18T04:09:19.518 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-07-18T04:09:19.518 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2023-07-18T04:09:19.518 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-07-18T04:09:19.518 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-07-18T04:09:19.518 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2023-07-18T04:09:19.518 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2023-07-18T04:09:19.519 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-18T04:09:19.519 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-07-18T04:09:19.519 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2023-07-18T04:09:19.519 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-18T04:09:19.519 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-07-18T04:09:19.519 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T04:09:19.519 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-18T04:09:19.520 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-18T04:09:19.520 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-07-18T04:09:19.521 DEBUG:teuthology.parallel:result is None 2023-07-18T04:09:21.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T04:09:21.591 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-18T04:09:21.592 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-18T04:09:21.944 INFO:teuthology.provision.fog.smithi144:Node is ready 2023-07-18T04:09:21.945 DEBUG:teuthology.orchestra.run.smithi144:> hostname 2023-07-18T04:09:21.959 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com 2023-07-18T04:09:21.959 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144.front.sepia.ceph.com /etc/hosts 2023-07-18T04:09:22.015 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144 2023-07-18T04:09:22.015 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-07-18T04:09:22.127 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hosts 2023-07-18T04:09:22.155 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts 2023-07-18T04:09:22.222 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hostname 2023-07-18T04:09:22.289 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-07-18T04:09:22.356 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-07-18T04:09:22.409 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2023-07-18T04:09:22.410 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2023-07-18T04:09:22.410 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2023-07-18T04:09:22.410 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2023-07-18T04:09:22.410 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2023-07-18T04:09:22.410 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2023-07-18T04:09:22.410 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-18T04:09:22.411 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-07-18T04:09:22.411 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2023-07-18T04:09:22.411 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-18T04:09:22.411 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2023-07-18T04:09:22.411 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T04:09:22.411 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-18T04:09:22.411 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-18T04:09:22.412 INFO:teuthology.provision.fog.smithi144:Deploy complete! 2023-07-18T04:09:22.412 DEBUG:teuthology.parallel:result is None 2023-07-18T04:09:22.593 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com 2023-07-18T04:09:22.594 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-18T04:09:22.619 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-07-18T04:09:22.620 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-18T04:09:22.645 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server 2023-07-18T04:09:22.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-07-18T04:09:22.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T04:09:22.729 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-07-18T04:09:22.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-07-18T04:09:22.751 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-07-18T04:09:22.804 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-07-18T04:09:22.805 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-07-18T04:09:22.858 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2023-07-18T04:09:22.858 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2023-07-18T04:09:22.859 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2023-07-18T04:09:22.859 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2023-07-18T04:09:22.859 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2023-07-18T04:09:22.859 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2023-07-18T04:09:22.859 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-18T04:09:22.859 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-07-18T04:09:22.859 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2023-07-18T04:09:22.860 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-18T04:09:22.860 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2023-07-18T04:09:22.860 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T04:09:22.860 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-18T04:09:22.860 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-18T04:09:22.861 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-07-18T04:09:22.885 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-07-18T04:09:22.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-07-18T04:09:22.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T04:09:22.970 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-07-18T04:09:23.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-07-18T04:09:23.041 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-07-18T04:09:23.097 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-07-18T04:09:23.097 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-07-18T04:09:23.153 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-07-18T04:09:23.153 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2023-07-18T04:09:23.153 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-07-18T04:09:23.153 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-07-18T04:09:23.153 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2023-07-18T04:09:23.154 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2023-07-18T04:09:23.154 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-18T04:09:23.154 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-07-18T04:09:23.154 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2023-07-18T04:09:23.154 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-18T04:09:23.154 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-07-18T04:09:23.154 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T04:09:23.155 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-18T04:09:23.155 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-18T04:09:23.155 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-07-18T04:09:23.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T04:09:23.177 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T04:09:23.275 INFO:teuthology.dispatcher.supervisor:Running job 7342609 2023-07-18T04:09:23.276 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi/7342609 --name yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi --description fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/dbench}}} -- /home/teuthworker/archive/yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi/7342609/orig.config.yaml 2023-07-18T04:09:23.279 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi/7342609 2023-07-18T04:09:23.280 INFO:teuthology.dispatcher.supervisor:Job PID: 18866 2023-07-18T04:09:23.281 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-18T04:11:23.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T04:11:23.381 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T04:13:23.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T04:13:23.557 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T04:15:23.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T04:15:23.735 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T04:17:23.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T04:17:23.909 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T04:19:24.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T04:19:24.081 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T04:21:24.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T04:21:24.265 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T04:23:24.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T04:23:24.445 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T04:23:24.516 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-18T04:23:24.632 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-18T04:23:24.632 INFO:teuthology.nuke:Checking targets against current locks 2023-07-18T04:23:24.682 DEBUG:teuthology.nuke:shortname: smithi144 2023-07-18T04:23:24.683 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-18T04:23:24.709 DEBUG:teuthology.nuke:shortname: smithi169 2023-07-18T04:23:24.709 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-18T04:23:24.712 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi/7342609', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-18 04:04:18.304296', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHy4I3CsSQbwNXHrtk31jtwThZPPRrqXgOe2C+aGcCrhrhVFjVNT9SdNA4HmHJmgx7UiNrI5+22fGYhCZqGdQZc='} 2023-07-18T04:23:24.740 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-17_21:03:43-fs-wip-yuri2-testing-2023-07-17-0957-distro-default-smithi/7342609', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-18 04:04:18.302706', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKcBULKY5/Ms8VKQUz6gkcAxnNmARAdBXOoL9Q/4IusFGjd6kc+I6HhrmS5pYWmnzGxGLd0txB7Y/p3MzOEIJec='} 2023-07-18T04:23:24.771 INFO:teuthology.orchestra.console:Power off smithi144 2023-07-18T04:23:24.772 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T04:23:24.790 INFO:teuthology.orchestra.console:Power off smithi169 2023-07-18T04:23:24.791 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T04:23:24.800 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:23:24.811 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T04:23:24.922 INFO:teuthology.orchestra.console:Power off for smithi144 completed 2023-07-18T04:23:24.934 INFO:teuthology.orchestra.console:Power off for smithi169 completed 2023-07-18T04:23:25.082 INFO:teuthology.lock.ops:unlocked: smithi144.front.sepia.ceph.com 2023-07-18T04:23:25.090 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com