2023-06-24T05:58:51.563 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-24T05:58:51.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T05:58:51.565 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T05:58:51.725 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f68278de8b0>, signals=[15]) 2023-06-24T05:58:51.727 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging 2023-06-24T05:58:51.727 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server 2023-06-24T05:58:51.728 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-06-24T05:58:51.753 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2023-06-24T05:58:51.754 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2023-06-24T05:58:51.754 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-06-24T05:58:51.755 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /host {"name": "smithi134"} 2023-06-24T05:58:51.778 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"} 2023-06-24T05:58:51.837 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-24T05:58:51.858 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-24T05:58:51.878 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_centos_8.stream (ID 3) 2023-06-24T05:58:51.878 DEBUG:teuthology.provision.fog.smithi134:FOG request: PUT /host/239 {"imageID": 3} 2023-06-24T05:58:51.904 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_8.stream (ID 3) 2023-06-24T05:58:51.904 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 3} 2023-06-24T05:58:51.928 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 8.stream 2023-06-24T05:58:51.929 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-06-24T05:58:51.945 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 8.stream 2023-06-24T05:58:51.946 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-24T05:58:51.992 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /tasktype {"name": "deploy"} 2023-06-24T05:58:52.007 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"} 2023-06-24T05:58:52.030 DEBUG:teuthology.provision.fog.smithi134:FOG request: POST /host/239/task {"taskTypeID": 1} 2023-06-24T05:58:52.045 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1} 2023-06-24T05:58:52.093 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-06-24T05:58:52.096 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-24T05:58:52.193 INFO:teuthology.orchestra.console:Power off smithi134 2023-06-24T05:58:52.194 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-24T05:58:52.210 INFO:teuthology.orchestra.console:Power off smithi159 2023-06-24T05:58:52.211 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-24T05:58:52.219 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T05:58:52.230 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T05:58:56.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T05:58:56.254 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T05:59:00.360 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T05:59:00.369 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T05:59:00.572 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2023-06-24T05:59:00.673 INFO:teuthology.orchestra.console:Power on smithi134 2023-06-24T05:59:00.674 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-24T05:59:00.695 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T05:59:04.480 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T05:59:04.692 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2023-06-24T05:59:04.716 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T05:59:04.794 INFO:teuthology.orchestra.console:Power on smithi159 2023-06-24T05:59:04.795 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-24T05:59:04.817 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T05:59:08.828 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T05:59:08.839 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T05:59:09.041 INFO:teuthology.orchestra.console:Power on for smithi134 completed 2023-06-24T05:59:09.051 INFO:teuthology.orchestra.console:Power on for smithi159 completed 2023-06-24T05:59:09.142 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2023-06-24T05:59:09.143 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-06-24T05:59:09.151 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2023-06-24T05:59:09.152 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-24T05:59:24.233 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-06-24T05:59:24.234 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-24T05:59:39.312 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-24T05:59:39.314 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-06-24T05:59:54.404 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-24T05:59:54.405 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-06-24T06:00:09.508 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-06-24T06:00:09.510 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-24T06:00:24.584 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-24T06:00:24.585 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-06-24T06:00:39.660 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-06-24T06:00:39.663 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-24T06:00:54.736 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-24T06:00:54.738 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-06-24T06:01:09.816 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-24T06:01:09.818 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-06-24T06:01:24.888 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-24T06:01:24.890 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-06-24T06:01:39.960 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-06-24T06:01:39.961 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-24T06:01:55.028 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-06-24T06:01:55.030 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-06-24T06:01:55.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:01:55.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:01:58.160 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-06-24T06:01:58.161 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-06-24T06:02:04.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:02:04.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:02:07.216 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-06-24T06:02:07.217 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-06-24T06:02:13.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:02:13.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:02:16.276 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-06-24T06:02:16.277 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-06-24T06:02:22.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:02:22.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:02:25.364 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-06-24T06:02:25.365 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-06-24T06:02:31.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:02:31.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:02:34.448 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-06-24T06:02:34.449 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-06-24T06:02:40.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:02:40.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:02:43.536 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-06-24T06:02:43.540 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-06-24T06:02:49.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:02:49.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:02:52.596 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-06-24T06:02:58.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:03:49.592 WARNING:teuthology.provision.fog.smithi134:timed out 2023-06-24T06:03:55.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:03:55.839 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-24T06:03:55.840 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-24T06:03:56.090 INFO:teuthology.provision.fog.smithi134:Node is ready 2023-06-24T06:03:56.090 DEBUG:teuthology.orchestra.run.smithi134:> hostname 2023-06-24T06:03:56.110 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2023-06-24T06:03:56.111 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts 2023-06-24T06:03:56.171 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2023-06-24T06:03:56.172 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-06-24T06:03:56.265 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts 2023-06-24T06:03:56.295 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts 2023-06-24T06:03:56.363 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname 2023-06-24T06:03:56.431 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-06-24T06:03:56.499 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-06-24T06:03:56.557 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2023-06-24T06:03:56.557 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8" 2023-06-24T06:03:56.557 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2023-06-24T06:03:56.558 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2023-06-24T06:03:56.558 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8" 2023-06-24T06:03:56.558 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-06-24T06:03:56.558 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-24T06:03:56.558 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-06-24T06:03:56.558 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-24T06:03:56.558 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2023-06-24T06:03:56.558 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-24T06:03:56.559 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-24T06:03:56.559 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-24T06:03:56.559 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2023-06-24T06:03:56.561 DEBUG:teuthology.parallel:result is None 2023-06-24T06:03:58.606 WARNING:teuthology.provision.fog.smithi159:timed out 2023-06-24T06:04:04.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:04:04.882 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-24T06:04:04.882 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-24T06:04:05.150 INFO:teuthology.provision.fog.smithi159:Node is ready 2023-06-24T06:04:05.150 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2023-06-24T06:04:05.169 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2023-06-24T06:04:05.169 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts 2023-06-24T06:04:05.228 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2023-06-24T06:04:05.229 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-06-24T06:04:05.328 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts 2023-06-24T06:04:05.357 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts 2023-06-24T06:04:05.424 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname 2023-06-24T06:04:05.493 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-06-24T06:04:05.559 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-06-24T06:04:05.616 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-06-24T06:04:05.617 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-06-24T06:04:05.618 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-06-24T06:04:05.618 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-06-24T06:04:05.618 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-06-24T06:04:05.619 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-06-24T06:04:05.619 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-24T06:04:05.619 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-06-24T06:04:05.619 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-24T06:04:05.620 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-06-24T06:04:05.620 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-24T06:04:05.620 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-24T06:04:05.620 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-24T06:04:05.621 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2023-06-24T06:04:05.622 DEBUG:teuthology.parallel:result is None 2023-06-24T06:04:05.788 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com 2023-06-24T06:04:05.789 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-24T06:04:05.822 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2023-06-24T06:04:05.822 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-24T06:04:05.851 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server 2023-06-24T06:04:05.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-06-24T06:04:05.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:04:05.920 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-06-24T06:04:05.993 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2023-06-24T06:04:06.054 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2023-06-24T06:04:06.055 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-06-24T06:04:06.116 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2023-06-24T06:04:06.117 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8" 2023-06-24T06:04:06.118 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2023-06-24T06:04:06.118 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2023-06-24T06:04:06.118 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8" 2023-06-24T06:04:06.118 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-06-24T06:04:06.119 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-24T06:04:06.119 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-06-24T06:04:06.119 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-24T06:04:06.120 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2023-06-24T06:04:06.121 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-24T06:04:06.121 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-24T06:04:06.121 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-24T06:04:06.122 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-06-24T06:04:06.150 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2023-06-24T06:04:06.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-06-24T06:04:06.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T06:04:06.215 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-06-24T06:04:06.241 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-06-24T06:04:06.299 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-06-24T06:04:06.299 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-06-24T06:04:06.358 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-06-24T06:04:06.358 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-06-24T06:04:06.358 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-06-24T06:04:06.358 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-06-24T06:04:06.359 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-06-24T06:04:06.359 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-06-24T06:04:06.359 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-24T06:04:06.359 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-06-24T06:04:06.359 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-24T06:04:06.359 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-06-24T06:04:06.359 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-24T06:04:06.360 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-24T06:04:06.360 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-24T06:04:06.360 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-06-24T06:04:06.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T06:04:06.383 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T06:04:06.489 INFO:teuthology.dispatcher.supervisor:Running job 7315428 2023-06-24T06:04:06.490 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_trociny@teuthology --archive /home/teuthworker/archive/trociny-2023-06-24_05:53:36-fs-wip-mgolub-testing-distro-default-smithi/7315428 --name trociny-2023-06-24_05:53:36-fs-wip-mgolub-testing-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} -- /home/teuthworker/archive/trociny-2023-06-24_05:53:36-fs-wip-mgolub-testing-distro-default-smithi/7315428/orig.config.yaml 2023-06-24T06:04:06.494 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/trociny-2023-06-24_05:53:36-fs-wip-mgolub-testing-distro-default-smithi/7315428 2023-06-24T06:04:06.495 INFO:teuthology.dispatcher.supervisor:Job PID: 2420 2023-06-24T06:04:06.495 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-24T06:06:06.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T06:06:06.596 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T06:08:06.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T06:08:06.769 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T06:10:06.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T06:10:06.925 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T06:12:07.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T06:12:07.098 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T06:14:07.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T06:14:07.262 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T06:16:07.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T06:16:07.439 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T06:18:07.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T06:18:07.622 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T06:20:07.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T06:20:07.811 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T06:22:07.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T06:22:07.990 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T06:22:08.061 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-24T06:22:08.180 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-24T06:22:08.180 INFO:teuthology.nuke:Checking targets against current locks 2023-06-24T06:22:08.235 DEBUG:teuthology.nuke:shortname: smithi134 2023-06-24T06:22:08.235 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-24T06:22:08.259 DEBUG:teuthology.nuke:shortname: smithi159 2023-06-24T06:22:08.260 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-24T06:22:08.263 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/trociny-2023-06-24_05:53:36-fs-wip-mgolub-testing-distro-default-smithi/7315428', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-24 05:58:50.755719', 'locked_by': 'scheduled_trociny@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCv8htvmkGVqYlJC5FGCBngP/XlBOgreqxvHZMt+6ClIhIBguRqLSw0ybaVvWz7BOxd6Gn5oqi0Kz1ZSSfyCPPMNHa5rfun2YvMPvUS9TO+0a6bNZe74V6u0GOIVGfOnnH7nA+2f+sIG4WoyP1+1ocqsdZbxdD+ANtOOEq6lloEr72PA3udCUTfb5/ox85R6l7QZxfykVQd4vxdsmecdSowQ1p7wGZQDmEo4my7pBirF+Nqh0c2oU4h7qHM/QZkcgg9ObyvXyQfGrjz8Mu04r/k/smUhyDleB9GtABfywF/NqfCDsUEMXMTmIn0PXH7PJCkhTvOKL957SBBctR73bKp4GyQ3xG5/BUEqUmICVBFCw9mvkEV8sdXcNugjUnKG1zwELZjSoeJ5N35fZ1nhL4jYOJxfFsQsrghwGbmIde+9kuYOFQhIG6Ivxzh1qCk5SU8tMD3v6HG5TRHgchrk02SKolvHowF8eFVoZ7V+cR69VmdvU+c2xdzMq0k4u5RRJs='} 2023-06-24T06:22:08.290 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/trociny-2023-06-24_05:53:36-fs-wip-mgolub-testing-distro-default-smithi/7315428', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-24 05:58:50.757016', 'locked_by': 'scheduled_trociny@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyBbjp0l9Z48GBZSAz2Vyj2xwuL+iH+gYEjQ0bA3EKkyXj/gF2wu3xG1jHeaL1WHDMOHFqb112iBcf0fz9i1liO1dncfZrGBPnrJW6Gn7S0H2JOqmGQWbXP7U4o01mEwRnx+KzR3PQ+hgruvqebp1IgDZ34JPR5HmowRV75braBsJNArpok01q0X3VeoZayPYcXsXAuufz9TVQ8IckWlhxf4bPgckrskUADjfjnFz6+RPOXdustYGWNKnWJwbHxCZFAvI103hVMxywImpkUISSMbphGRWbD0sLgadfYH8YCvkp0Bg31fwLK2M4QxeUqMlUA6f3KNI/DtGpA3FInb/eGgCXLz3klBBaLDPT/TtFDsxeF22k9/kESXGaA7YNcRoQfgsp7Db2Eisragfyck50JjJM3SRJM6E5wgRVVvtT1jVvw1kZfM30MIKSjfmVFJHcZ2P042I11NfwoepCbjI4X8pALXrmyYaqw/EiLpqqT5+1r2AGNo5VdhUxBYaBZ6E='} 2023-06-24T06:22:08.317 INFO:teuthology.orchestra.console:Power off smithi134 2023-06-24T06:22:08.318 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-24T06:22:08.338 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T06:22:08.361 INFO:teuthology.orchestra.console:Power off smithi159 2023-06-24T06:22:08.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-24T06:22:08.386 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T06:22:08.473 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2023-06-24T06:22:08.510 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2023-06-24T06:22:08.627 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com 2023-06-24T06:22:08.659 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com