2023-07-01T03:01:27.322 INFO:root:teuthology version: 0.0.1.dev138+g8dce2fc 2023-07-01T03:01:27.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:01:27.325 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:01:27.492 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fef724a8790>, signals=[15]) 2023-07-01T03:01:27.493 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging 2023-07-01T03:01:27.494 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server 2023-07-01T03:01:27.494 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-07-01T03:01:27.515 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2023-07-01T03:01:27.516 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2023-07-01T03:01:27.516 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-07-01T03:01:27.517 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /host {"name": "smithi005"} 2023-07-01T03:01:27.540 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"} 2023-07-01T03:01:27.599 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-01T03:01:27.610 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-01T03:01:27.653 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_8.stream (ID 3) 2023-07-01T03:01:27.653 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 3} 2023-07-01T03:01:27.655 DEBUG:teuthology.provision.fog.smithi005:Requesting image smithi_centos_8.stream (ID 3) 2023-07-01T03:01:27.656 DEBUG:teuthology.provision.fog.smithi005:FOG request: PUT /host/111 {"imageID": 3} 2023-07-01T03:01:27.696 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of centos 8.stream 2023-07-01T03:01:27.696 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-07-01T03:01:27.712 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 8.stream 2023-07-01T03:01:27.712 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-01T03:01:27.752 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /tasktype {"name": "deploy"} 2023-07-01T03:01:27.761 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"} 2023-07-01T03:01:27.785 DEBUG:teuthology.provision.fog.smithi005:FOG request: POST /host/111/task {"taskTypeID": 1} 2023-07-01T03:01:27.799 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1} 2023-07-01T03:01:27.830 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-07-01T03:01:27.855 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-01T03:01:27.923 INFO:teuthology.orchestra.console:Power off smithi005 2023-07-01T03:01:27.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-01T03:01:27.948 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T03:01:27.973 INFO:teuthology.orchestra.console:Power off smithi107 2023-07-01T03:01:27.974 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-01T03:01:27.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T03:01:31.988 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T03:01:32.022 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T03:01:36.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T03:01:36.137 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T03:01:36.317 INFO:teuthology.orchestra.console:Power off for smithi005 completed 2023-07-01T03:01:36.418 INFO:teuthology.orchestra.console:Power on smithi005 2023-07-01T03:01:36.418 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-01T03:01:36.439 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T03:01:40.252 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T03:01:40.462 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T03:01:40.472 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2023-07-01T03:01:40.574 INFO:teuthology.orchestra.console:Power on smithi107 2023-07-01T03:01:40.575 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-01T03:01:40.598 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T03:01:44.588 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T03:01:44.624 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T03:01:44.800 INFO:teuthology.orchestra.console:Power on for smithi005 completed 2023-07-01T03:01:44.902 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2023-07-01T03:01:44.902 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-07-01T03:01:48.736 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T03:01:48.948 INFO:teuthology.orchestra.console:Power on for smithi107 completed 2023-07-01T03:01:49.049 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2023-07-01T03:01:49.049 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-01T03:01:59.972 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-07-01T03:02:04.129 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-01T03:02:15.052 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-07-01T03:02:19.210 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-01T03:02:30.128 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-07-01T03:02:34.290 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-01T03:02:45.220 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-07-01T03:02:49.372 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-01T03:03:00.300 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-07-01T03:03:04.453 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-01T03:03:15.392 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-07-01T03:03:19.532 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-01T03:03:30.464 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-07-01T03:03:34.616 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-01T03:03:45.566 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-07-01T03:03:49.692 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-01T03:04:00.648 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-07-01T03:04:04.778 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-01T03:04:15.740 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-07-01T03:04:15.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:04:19.864 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-01T03:04:34.164 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-07-01T03:04:34.935 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-07-01T03:04:35.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:04:38.064 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-01T03:04:40.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:04:43.248 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-07-01T03:04:44.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:04:47.120 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-01T03:04:49.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:04:52.304 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-07-01T03:04:53.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:04:56.176 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-01T03:04:58.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:05:01.360 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-07-01T03:05:02.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:05:05.232 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-01T03:05:07.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:05:11.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:05:14.288 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-01T03:05:20.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:05:23.344 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-01T03:05:29.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:05:32.432 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-07-01T03:05:38.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:06:07.392 WARNING:teuthology.provision.fog.smithi005:timed out 2023-07-01T03:06:13.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:06:13.622 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-01T03:06:13.623 DEBUG:teuthology.orchestra.run.smithi005:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-01T03:06:13.884 INFO:teuthology.provision.fog.smithi005:Node is ready 2023-07-01T03:06:13.884 DEBUG:teuthology.orchestra.run.smithi005:> hostname 2023-07-01T03:06:13.905 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2023-07-01T03:06:13.906 DEBUG:teuthology.orchestra.run.smithi005:> grep smithi005.front.sepia.ceph.com /etc/hosts 2023-07-01T03:06:13.967 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2023-07-01T03:06:13.967 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2023-07-01T03:06:14.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hosts 2023-07-01T03:06:14.114 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/172.21.15.5/172.21.15.5/g' /etc/hosts 2023-07-01T03:06:14.187 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hostname 2023-07-01T03:06:14.258 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2023-07-01T03:06:14.329 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-07-01T03:06:14.390 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2023-07-01T03:06:14.390 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8" 2023-07-01T03:06:14.391 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2023-07-01T03:06:14.391 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2023-07-01T03:06:14.391 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8" 2023-07-01T03:06:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2023-07-01T03:06:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-01T03:06:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-07-01T03:06:14.393 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-01T03:06:14.393 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2023-07-01T03:06:14.393 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-01T03:06:14.393 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-01T03:06:14.394 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-01T03:06:14.395 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2023-07-01T03:06:14.397 DEBUG:teuthology.parallel:result is None 2023-07-01T03:06:38.464 WARNING:teuthology.provision.fog.smithi107:timed out 2023-07-01T03:06:44.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:06:44.708 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-01T03:06:44.708 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-01T03:06:44.977 INFO:teuthology.provision.fog.smithi107:Node is ready 2023-07-01T03:06:44.977 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2023-07-01T03:06:44.997 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2023-07-01T03:06:44.997 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2023-07-01T03:06:45.056 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2023-07-01T03:06:45.056 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-07-01T03:06:45.165 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2023-07-01T03:06:45.194 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2023-07-01T03:06:45.262 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2023-07-01T03:06:45.331 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-07-01T03:06:45.397 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-07-01T03:06:45.456 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2023-07-01T03:06:45.456 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8" 2023-07-01T03:06:45.457 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2023-07-01T03:06:45.457 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2023-07-01T03:06:45.457 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8" 2023-07-01T03:06:45.458 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2023-07-01T03:06:45.458 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-01T03:06:45.459 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-07-01T03:06:45.459 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-01T03:06:45.460 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2023-07-01T03:06:45.460 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-01T03:06:45.460 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-01T03:06:45.461 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-01T03:06:45.462 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2023-07-01T03:06:45.463 DEBUG:teuthology.parallel:result is None 2023-07-01T03:06:45.627 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2023-07-01T03:06:45.628 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-01T03:06:45.661 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2023-07-01T03:06:45.661 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-01T03:06:45.687 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2023-07-01T03:06:45.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-07-01T03:06:45.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:06:45.757 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-07-01T03:06:45.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-07-01T03:06:45.896 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2023-07-01T03:06:45.956 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2023-07-01T03:06:45.957 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-07-01T03:06:46.017 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2023-07-01T03:06:46.017 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8" 2023-07-01T03:06:46.017 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2023-07-01T03:06:46.018 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2023-07-01T03:06:46.018 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8" 2023-07-01T03:06:46.018 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2023-07-01T03:06:46.019 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-01T03:06:46.019 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-07-01T03:06:46.019 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-01T03:06:46.019 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2023-07-01T03:06:46.019 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-01T03:06:46.019 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-01T03:06:46.020 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-01T03:06:46.020 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-07-01T03:06:46.044 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2023-07-01T03:06:46.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-07-01T03:06:46.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T03:06:46.111 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-07-01T03:06:46.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-07-01T03:06:46.178 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-07-01T03:06:46.235 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-07-01T03:06:46.236 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-07-01T03:06:46.293 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2023-07-01T03:06:46.294 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8" 2023-07-01T03:06:46.294 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2023-07-01T03:06:46.294 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2023-07-01T03:06:46.295 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8" 2023-07-01T03:06:46.295 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2023-07-01T03:06:46.295 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-01T03:06:46.295 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-07-01T03:06:46.296 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-01T03:06:46.296 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2023-07-01T03:06:46.296 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-01T03:06:46.296 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-01T03:06:46.296 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-01T03:06:46.297 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-07-01T03:06:46.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:06:46.319 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:06:46.410 INFO:teuthology.dispatcher.supervisor:Running job 7323517 2023-07-01T03:06:46.410 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8dce2fc6417e1b191b069043fa417c11b1882785/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323517 --name yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi --description rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/e2e} -- /home/teuthworker/archive/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323517/orig.config.yaml 2023-07-01T03:06:46.414 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323517 2023-07-01T03:06:46.414 INFO:teuthology.dispatcher.supervisor:Job PID: 328 2023-07-01T03:06:46.414 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-01T03:08:46.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:08:46.516 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:10:46.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:10:46.688 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:12:46.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:12:46.854 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:14:47.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:14:47.038 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:16:47.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:16:47.153 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:18:47.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:18:47.330 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:20:47.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:20:47.507 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:22:47.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:22:47.686 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:24:47.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:24:47.851 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:26:48.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:26:48.026 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:28:48.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:28:48.203 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:30:48.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:30:48.380 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:32:48.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:32:48.554 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:34:48.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:34:48.734 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:36:48.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:36:48.918 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:38:49.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T03:38:49.094 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T03:38:49.160 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-01T03:38:49.261 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-01T03:38:49.262 INFO:teuthology.nuke:Checking targets against current locks 2023-07-01T03:38:49.315 DEBUG:teuthology.nuke:shortname: smithi005 2023-07-01T03:38:49.315 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-01T03:38:49.342 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323517', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-01 03:01:26.496871', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAtaqa5zuGdNgiYYZGaSTxIfTxgpdiTEiwtj9efQMJa+mHQ+MnryDvzn9O7rjuJg7yjh0tz6Z9dgcIloivOb1/01z4m6hxspTfDy/405MAXSBM9sK1FU9qsaNwr+D3reNQQLEoEMspkX7m5Fzqhw0D35sf4m12uKn70fJ5SlR8MAabh0xSiY9woQvbUduRXMloWrVHgesh0quTRgyjLr5fCKDkr5ePiM25WCUJht5qQcHzF/Wsw3i6eeNfdsrkniP2D4KoA8ojrTFYWfOkd6AyyE3sgOtnMpe2nFE1aXYKPU1M/hZfdZnfyy3iarPS622skaZ9OONpygt0Lf2izDg+Lu7QcktJL+HOt1p3U35V7Fa6bGat3LomLNAtg9tNubBWP/HTzrxjlxQ5Y748Pu6qK9sH+l6SMPh+L2bxPAqvjuJC29KBJnAexkVkMHF2Jo+FHxn8IbK6uRdiI0wywH4bUL3rssX5qfcwyDfMhNahZqHqcDKO4KMcmYlWUzqBqQk='} 2023-07-01T03:38:49.345 DEBUG:teuthology.nuke:shortname: smithi107 2023-07-01T03:38:49.345 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-01T03:38:49.369 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323517', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-01 03:01:26.494905', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjWzwF52BxnsHj6zyDIVv7kyE7CegXO21rZsMoJn68E5QGxVTmEnzNgn/wTm/Elw8zsnYtKxIlTetiR6c9zm63Rp+jJlynYUeAwAnKqwyjESboXVbhleypjGcbj4rnGGnlZgZUgXRiNCpRs+JvUHqdz2Tssixyqs42FtWHuJRMzR4K6mvJA6c5yedT2ixvcp5mmsjwXgA4KxNxtf4Z+FXtjL1oBwxF/e5TyKZiDKIK7TLLNkPGMZKuxjhYgkYAZQ7/woPscNw5EUQn093wvopkkr9ysQNCZG3ztPct0A/XRJWhuu8Yeq1vxQVy4tfmv88rfmKdM88YVPw2bE2RxKFJk5Ho1p3NgCPvPa+jmq1uqF+dLPV9PUuSvhGbq7jhVouECNdHO0QJ4bEx2J9QiuGIiWLm/kE0efLeE4voHru0Hsi5Fy3Aejxphbp1WbAkuNcJfY1AykrZwCecWMWhjXZeK3LeOGQkaIMjk59CLaK1/2PRrjoIQEa8H5FtH+9Sh2c='} 2023-07-01T03:38:49.403 INFO:teuthology.orchestra.console:Power off smithi005 2023-07-01T03:38:49.404 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-01T03:38:49.425 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T03:38:49.448 INFO:teuthology.orchestra.console:Power off smithi107 2023-07-01T03:38:49.449 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-01T03:38:49.470 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T03:38:49.560 INFO:teuthology.orchestra.console:Power off for smithi005 completed 2023-07-01T03:38:49.592 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2023-07-01T03:38:49.734 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com 2023-07-01T03:38:49.751 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com