2023-07-13T23:15:32.037 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-13T23:15:32.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:15:32.039 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:15:32.177 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2aba660dc0>, signals=[15]) 2023-07-13T23:15:32.179 INFO:teuthology.lock.ops:Start node 'smithi101.front.sepia.ceph.com' reimaging 2023-07-13T23:15:32.179 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T23:15:32.179 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-07-13T23:15:32.200 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-07-13T23:15:32.200 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T23:15:32.200 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-07-13T23:15:32.202 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /host {"name": "smithi101"} 2023-07-13T23:15:32.225 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-07-13T23:15:32.285 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-13T23:15:32.300 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-13T23:15:32.327 DEBUG:teuthology.provision.fog.smithi101:Requesting image smithi_centos_8.stream (ID 3) 2023-07-13T23:15:32.327 DEBUG:teuthology.provision.fog.smithi101:FOG request: PUT /host/206 {"imageID": 3} 2023-07-13T23:15:32.343 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_centos_8.stream (ID 3) 2023-07-13T23:15:32.344 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 3} 2023-07-13T23:15:32.378 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of centos 8.stream 2023-07-13T23:15:32.379 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-13T23:15:32.386 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of centos 8.stream 2023-07-13T23:15:32.386 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:15:32.476 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T23:15:32.482 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T23:15:32.529 DEBUG:teuthology.provision.fog.smithi101:FOG request: POST /host/206/task {"taskTypeID": 1} 2023-07-13T23:15:32.532 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-07-13T23:15:32.583 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:15:32.587 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-13T23:15:32.721 INFO:teuthology.orchestra.console:Power off smithi101 2023-07-13T23:15:32.722 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:15:32.740 INFO:teuthology.orchestra.console:Power off smithi139 2023-07-13T23:15:32.741 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:15:32.751 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:15:32.762 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:15:32.874 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-07-13T23:15:32.885 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-07-13T23:15:32.976 INFO:teuthology.orchestra.console:Power on smithi101 2023-07-13T23:15:32.977 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T23:15:32.987 INFO:teuthology.orchestra.console:Power on smithi139 2023-07-13T23:15:32.987 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T23:15:33.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:15:33.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:15:37.028 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:15:37.037 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:15:37.240 INFO:teuthology.orchestra.console:Power on for smithi101 completed 2023-07-13T23:15:37.249 INFO:teuthology.orchestra.console:Power on for smithi139 completed 2023-07-13T23:15:37.342 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish 2023-07-13T23:15:37.342 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-13T23:15:37.351 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-07-13T23:15:37.351 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:15:52.453 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:15:52.455 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-13T23:16:07.578 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:16:07.579 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-13T23:16:22.693 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-13T23:16:22.695 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:16:37.796 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:16:37.798 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-13T23:16:52.920 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:16:52.922 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-13T23:17:08.024 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-13T23:17:08.026 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:17:23.123 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-13T23:17:23.126 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:17:38.220 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:17:38.222 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-13T23:17:53.321 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-13T23:17:53.322 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:18:08.436 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-13T23:18:08.438 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:18:23.536 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:18:23.537 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-13T23:18:23.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:18:26.672 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-13T23:18:32.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:18:35.728 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-13T23:18:38.616 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:18:41.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:18:44.784 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-13T23:18:50.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:18:53.691 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-13T23:18:53.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:18:53.840 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-13T23:18:56.820 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-13T23:18:59.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:19:02.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:19:02.896 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-13T23:19:05.904 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-13T23:19:08.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:19:11.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:19:11.952 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-13T23:19:14.960 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-13T23:19:17.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:19:20.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:19:24.016 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-13T23:19:30.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:19:33.072 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-13T23:19:39.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:19:42.128 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-13T23:19:48.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:20:17.984 WARNING:teuthology.provision.fog.smithi101:timed out 2023-07-13T23:20:23.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:20:24.217 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T23:20:24.218 DEBUG:teuthology.orchestra.run.smithi101:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T23:20:24.492 INFO:teuthology.provision.fog.smithi101:Node is ready 2023-07-13T23:20:24.492 DEBUG:teuthology.orchestra.run.smithi101:> hostname 2023-07-13T23:20:24.511 INFO:teuthology.orchestra.run.smithi101.stdout:smithi101.front.sepia.ceph.com 2023-07-13T23:20:24.512 DEBUG:teuthology.orchestra.run.smithi101:> grep smithi101.front.sepia.ceph.com /etc/hosts 2023-07-13T23:20:24.571 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.101 smithi101.front.sepia.ceph.com smithi101 2023-07-13T23:20:24.571 DEBUG:teuthology.orchestra.run.smithi101:> sudo hostname smithi101 2023-07-13T23:20:24.709 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/smithi101.front.sepia.ceph.com/smithi101/g' /etc/hosts 2023-07-13T23:20:24.740 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/172.21.15.101/172.21.15.101/g' /etc/hosts 2023-07-13T23:20:24.809 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/smithi101.front.sepia.ceph.com/smithi101/g' /etc/hostname 2023-07-13T23:20:24.878 DEBUG:teuthology.orchestra.run.smithi101:> sudo hostname smithi101 2023-07-13T23:20:24.944 DEBUG:teuthology.orchestra.run.smithi101:> cat /etc/os-release 2023-07-13T23:20:25.002 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="CentOS Stream" 2023-07-13T23:20:25.003 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8" 2023-07-13T23:20:25.003 INFO:teuthology.orchestra.run.smithi101.stdout:ID="centos" 2023-07-13T23:20:25.003 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="rhel fedora" 2023-07-13T23:20:25.003 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8" 2023-07-13T23:20:25.003 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:20:25.003 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T23:20:25.003 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2023-07-13T23:20:25.003 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T23:20:25.004 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://centos.org/" 2023-07-13T23:20:25.004 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:20:25.004 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:20:25.004 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T23:20:25.005 INFO:teuthology.provision.fog.smithi101:Deploy complete! 2023-07-13T23:20:25.006 DEBUG:teuthology.parallel:result is None 2023-07-13T23:20:48.156 WARNING:teuthology.provision.fog.smithi139:timed out 2023-07-13T23:20:54.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:20:54.409 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T23:20:54.410 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T23:20:54.670 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-07-13T23:20:54.670 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-07-13T23:20:54.689 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-07-13T23:20:54.690 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-07-13T23:20:54.748 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-07-13T23:20:54.749 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-07-13T23:20:54.852 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-07-13T23:20:54.882 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-07-13T23:20:54.951 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-07-13T23:20:55.019 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-07-13T23:20:55.086 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-07-13T23:20:55.144 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2023-07-13T23:20:55.144 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8" 2023-07-13T23:20:55.145 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2023-07-13T23:20:55.145 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2023-07-13T23:20:55.145 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8" 2023-07-13T23:20:55.145 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:20:55.145 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T23:20:55.145 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-07-13T23:20:55.145 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T23:20:55.146 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2023-07-13T23:20:55.146 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:20:55.146 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:20:55.146 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T23:20:55.146 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-07-13T23:20:55.147 DEBUG:teuthology.parallel:result is None 2023-07-13T23:20:55.325 INFO:teuthology.lock.ops:Checking smithi101.front.sepia.ceph.com 2023-07-13T23:20:55.326 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T23:20:55.350 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-07-13T23:20:55.351 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T23:20:55.368 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: set os type and version on server 2023-07-13T23:20:55.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-07-13T23:20:55.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:20:55.436 DEBUG:teuthology.orchestra.run.smithi101:> true 2023-07-13T23:20:55.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-07-13T23:20:55.566 DEBUG:teuthology.orchestra.run.smithi101:> uname -m 2023-07-13T23:20:55.624 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64 2023-07-13T23:20:55.624 DEBUG:teuthology.orchestra.run.smithi101:> cat /etc/os-release 2023-07-13T23:20:55.682 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="CentOS Stream" 2023-07-13T23:20:55.682 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8" 2023-07-13T23:20:55.682 INFO:teuthology.orchestra.run.smithi101.stdout:ID="centos" 2023-07-13T23:20:55.683 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="rhel fedora" 2023-07-13T23:20:55.683 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8" 2023-07-13T23:20:55.683 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:20:55.683 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T23:20:55.683 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2023-07-13T23:20:55.683 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T23:20:55.683 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://centos.org/" 2023-07-13T23:20:55.683 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:20:55.684 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:20:55.684 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T23:20:55.684 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-07-13T23:20:55.709 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-07-13T23:20:55.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-07-13T23:20:55.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T23:20:55.774 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-07-13T23:20:55.845 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-07-13T23:20:55.846 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-07-13T23:20:55.903 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-07-13T23:20:55.903 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-07-13T23:20:55.961 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2023-07-13T23:20:55.961 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8" 2023-07-13T23:20:55.961 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2023-07-13T23:20:55.961 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2023-07-13T23:20:55.962 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8" 2023-07-13T23:20:55.962 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-07-13T23:20:55.962 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T23:20:55.962 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-07-13T23:20:55.963 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T23:20:55.963 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2023-07-13T23:20:55.963 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T23:20:55.963 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T23:20:55.963 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T23:20:55.964 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-07-13T23:20:55.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:20:55.984 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:20:56.074 INFO:teuthology.dispatcher.supervisor:Running job 7336566 2023-07-13T23:20:56.075 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology -v --owner scheduled_akupczyk@teuthology --archive /home/teuthworker/archive/akupczyk-2023-07-13_23:13:49-rados-wip-aclamk-bs-esb-5-distro-default-smithi/7336566 --name akupczyk-2023-07-13_23:13:49-rados-wip-aclamk-bs-esb-5-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/akupczyk-2023-07-13_23:13:49-rados-wip-aclamk-bs-esb-5-distro-default-smithi/7336566/orig.config.yaml 2023-07-13T23:20:56.079 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/akupczyk-2023-07-13_23:13:49-rados-wip-aclamk-bs-esb-5-distro-default-smithi/7336566 2023-07-13T23:20:56.080 INFO:teuthology.dispatcher.supervisor:Job PID: 6335 2023-07-13T23:20:56.080 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-13T23:22:56.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:22:56.182 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:24:56.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:24:56.359 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:26:56.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:26:56.588 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:28:56.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:28:56.779 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:30:56.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:30:56.983 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:32:57.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:32:57.155 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:35:07.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T23:35:07.330 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T23:35:17.410 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-13T23:35:27.526 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-13T23:35:27.527 INFO:teuthology.nuke:Checking targets against current locks 2023-07-13T23:35:38.301 DEBUG:teuthology.nuke:shortname: smithi101 2023-07-13T23:35:38.302 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T23:35:38.362 DEBUG:teuthology.nuke:shortname: smithi139 2023-07-13T23:35:38.363 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T23:35:38.365 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi101.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-07-13_23:13:49-rados-wip-aclamk-bs-esb-5-distro-default-smithi/7336566', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 23:15:31.148389', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6BAuudKSmKJP1C9BlPQISt48ze44Seax/iN6+l3mHcSJWJZ0fxefi249eBfBHw+wgQeedxHV1PGbN3ePcGMHyFBA5FUsPQcGQiiw0mySi3KB+tf4Kf6w2Aa5mArhjwO8SmZ6Sx2UPWfzQD5p7Akaq4i+vDh0Z1y+fPVe9szBityTPeLxzGc3c+X1VprGBvQ9uKVpA8/QFeBM0ca9p5RFfXma0GFPkXXytlbGCf+XCpOME+s/ehiAHXWM8fGZ797h9zLaXYKb1Gg3sDhYXFRfabh20kogMiu0X0RPoVQBZ5/gsmqM4SjHLp4oQtHcqIql/8IAcr2liqbkMGurwyrFs+1vh7pcMyZm2tt4pAkuoJLTsrN1m7++ww890hoLUnyIDfbade1b43vwM0eoe71oWSsQze9gXo4Yy0/iIWDf++PSC3C4/hFbXq2Ddmy86KTqzzYGusdUgrw0SuezFFcLwj0lZ2pBy7ysdU/IvR/kQWvfOF1CJb/ilQNMpB1xNAo0='} 2023-07-13T23:35:38.403 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-07-13_23:13:49-rados-wip-aclamk-bs-esb-5-distro-default-smithi/7336566', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 23:15:31.146378', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeK6DLFj0gBnGW4aO8gxwE99DYDSwVQf7xoyeYm1/C1z69y/SLP3iOwnH6laPpFtQp44hZediTlBeGfa2UvjnES+mp5ZTwZfBwso6DgR9hcN8KaX0oR8eGRnnY270E0vBAyQIsVwQ7ez7JNKraWOPWitylYBIVSgv0HMvIldNOBxLW/o7L/qGcGW0YN6zDw1knQL3DniIXn/820G4SwGEJw2UNz7vUw2/BDJFEmoNYdHCs8ZHD9Ix1dCsN3tQ7HpHUzobEhFGEcernhDgXZbtFgbj4rQd9F91aQNCYop34OsEITJGUvA4qvNqSlKFkXMUBKrWOe5+dYewpbjH2G5EHbl9QcqIlleGntgUyFFsWa9XVuC7spz+uCrvpMC4WjTl66CukDFZIuO/7smQhqtO8pYSbBNxf4gHWc9PO06t+Gt0MIRgbAuwsHsU4evWDYyokECRj8P/IuolnZ9neWgHJttRxT57nVRnGTbiMmcJdtO5+V5DBATeqXv+z+a8WXO8='} 2023-07-13T23:35:38.447 INFO:teuthology.orchestra.console:Power off smithi101 2023-07-13T23:35:38.448 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:35:38.487 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:35:38.556 INFO:teuthology.orchestra.console:Power off smithi139 2023-07-13T23:35:38.557 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T23:35:38.583 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T23:35:38.672 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-07-13T23:35:38.720 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-07-13T23:35:38.843 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com 2023-07-13T23:35:38.906 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com