2023-07-04T04:01:40.732 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-04T04:01:40.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:01:40.734 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:01:40.896 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f51d262cd30>, signals=[15]) 2023-07-04T04:01:40.898 INFO:teuthology.lock.ops:Start node 'smithi061.front.sepia.ceph.com' reimaging 2023-07-04T04:01:40.898 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: reset os type and version on server 2023-07-04T04:01:40.899 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-07-04T04:01:40.938 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging 2023-07-04T04:01:40.939 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server 2023-07-04T04:01:40.939 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-07-04T04:01:40.941 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /host {"name": "smithi061"} 2023-07-04T04:01:40.963 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /host {"name": "smithi071"} 2023-07-04T04:01:41.019 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-04T04:01:41.041 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-04T04:01:41.057 DEBUG:teuthology.provision.fog.smithi061:Requesting image smithi_centos_8.stream (ID 3) 2023-07-04T04:01:41.058 DEBUG:teuthology.provision.fog.smithi061:FOG request: PUT /host/166 {"imageID": 3} 2023-07-04T04:01:41.087 DEBUG:teuthology.provision.fog.smithi071:Requesting image smithi_centos_8.stream (ID 3) 2023-07-04T04:01:41.087 DEBUG:teuthology.provision.fog.smithi071:FOG request: PUT /host/176 {"imageID": 3} 2023-07-04T04:01:41.114 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of centos 8.stream 2023-07-04T04:01:41.115 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-04T04:01:41.133 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of centos 8.stream 2023-07-04T04:01:41.133 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-07-04T04:01:41.181 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /tasktype {"name": "deploy"} 2023-07-04T04:01:41.195 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /tasktype {"name": "deploy"} 2023-07-04T04:01:41.212 DEBUG:teuthology.provision.fog.smithi061:FOG request: POST /host/166/task {"taskTypeID": 1} 2023-07-04T04:01:41.230 DEBUG:teuthology.provision.fog.smithi071:FOG request: POST /host/176/task {"taskTypeID": 1} 2023-07-04T04:01:41.326 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-04T04:01:41.392 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-07-04T04:01:41.467 INFO:teuthology.orchestra.console:Power off smithi061 2023-07-04T04:01:41.468 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T04:01:41.485 INFO:teuthology.orchestra.console:Power off smithi071 2023-07-04T04:01:41.485 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T04:01:41.494 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:01:41.507 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:01:45.520 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:01:45.531 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:01:49.636 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:01:49.645 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:01:49.848 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2023-07-04T04:01:49.857 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2023-07-04T04:01:49.950 INFO:teuthology.orchestra.console:Power on smithi061 2023-07-04T04:01:49.950 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-04T04:01:49.959 INFO:teuthology.orchestra.console:Power on smithi071 2023-07-04T04:01:49.960 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-04T04:01:49.971 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:01:49.984 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:01:54.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:01:54.008 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:01:58.115 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:01:58.124 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:01:58.327 INFO:teuthology.orchestra.console:Power on for smithi061 completed 2023-07-04T04:01:58.336 INFO:teuthology.orchestra.console:Power on for smithi071 completed 2023-07-04T04:01:58.429 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish 2023-07-04T04:01:58.429 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-04T04:01:58.437 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2023-07-04T04:01:58.437 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-07-04T04:02:13.528 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-07-04T04:02:13.530 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-04T04:02:28.636 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-04T04:02:28.638 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-07-04T04:02:43.732 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-04T04:02:43.734 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-07-04T04:02:58.822 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-07-04T04:02:58.823 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-04T04:03:13.904 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-07-04T04:03:13.905 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-04T04:03:28.976 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-04T04:03:28.977 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-07-04T04:03:44.052 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-04T04:03:44.053 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-07-04T04:03:59.120 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-07-04T04:03:59.121 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-04T04:04:14.196 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-04T04:04:14.197 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-07-04T04:04:29.268 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-04T04:04:29.270 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-07-04T04:04:44.342 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-07-04T04:04:44.345 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-04T04:04:44.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:04:44.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:04:47.472 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-04T04:04:47.474 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-07-04T04:04:53.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:04:53.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:04:56.560 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-04T04:04:56.561 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-07-04T04:05:02.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:05:02.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:05:05.620 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-04T04:05:05.621 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-07-04T04:05:11.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:05:11.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:05:14.704 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-04T04:05:14.705 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-07-04T04:05:20.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:05:20.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:05:23.760 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-04T04:05:23.796 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-07-04T04:05:29.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:05:29.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:05:32.848 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-04T04:05:38.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:06:29.848 WARNING:teuthology.provision.fog.smithi071:timed out 2023-07-04T04:06:35.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:06:36.079 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-04T04:06:36.080 DEBUG:teuthology.orchestra.run.smithi071:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-04T04:06:36.313 INFO:teuthology.provision.fog.smithi071:Node is ready 2023-07-04T04:06:36.313 DEBUG:teuthology.orchestra.run.smithi071:> hostname 2023-07-04T04:06:36.332 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2023-07-04T04:06:36.332 DEBUG:teuthology.orchestra.run.smithi071:> grep smithi071.front.sepia.ceph.com /etc/hosts 2023-07-04T04:06:36.391 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2023-07-04T04:06:36.391 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2023-07-04T04:06:36.498 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hosts 2023-07-04T04:06:36.527 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/172.21.15.71/172.21.15.71/g' /etc/hosts 2023-07-04T04:06:36.595 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hostname 2023-07-04T04:06:36.663 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2023-07-04T04:06:36.730 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-07-04T04:06:36.788 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2023-07-04T04:06:36.789 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8" 2023-07-04T04:06:36.789 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2023-07-04T04:06:36.789 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2023-07-04T04:06:36.789 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8" 2023-07-04T04:06:36.789 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2023-07-04T04:06:36.789 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-04T04:06:36.789 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-07-04T04:06:36.790 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-04T04:06:36.790 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2023-07-04T04:06:36.790 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-04T04:06:36.790 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-04T04:06:36.790 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-04T04:06:36.791 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2023-07-04T04:06:36.793 DEBUG:teuthology.parallel:result is None 2023-07-04T04:06:38.856 WARNING:teuthology.provision.fog.smithi061:timed out 2023-07-04T04:06:44.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:06:45.102 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-04T04:06:45.102 DEBUG:teuthology.orchestra.run.smithi061:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-04T04:06:45.362 INFO:teuthology.provision.fog.smithi061:Node is ready 2023-07-04T04:06:45.363 DEBUG:teuthology.orchestra.run.smithi061:> hostname 2023-07-04T04:06:45.382 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com 2023-07-04T04:06:45.383 DEBUG:teuthology.orchestra.run.smithi061:> grep smithi061.front.sepia.ceph.com /etc/hosts 2023-07-04T04:06:45.442 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061 2023-07-04T04:06:45.442 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-07-04T04:06:45.541 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hosts 2023-07-04T04:06:45.572 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/172.21.15.61/172.21.15.61/g' /etc/hosts 2023-07-04T04:06:45.643 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hostname 2023-07-04T04:06:45.711 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-07-04T04:06:45.780 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-07-04T04:06:45.839 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="CentOS Stream" 2023-07-04T04:06:45.840 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8" 2023-07-04T04:06:45.840 INFO:teuthology.orchestra.run.smithi061.stdout:ID="centos" 2023-07-04T04:06:45.840 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="rhel fedora" 2023-07-04T04:06:45.840 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8" 2023-07-04T04:06:45.840 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2023-07-04T04:06:45.840 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-04T04:06:45.841 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2023-07-04T04:06:45.841 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-04T04:06:45.841 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://centos.org/" 2023-07-04T04:06:45.841 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-04T04:06:45.841 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-04T04:06:45.841 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-04T04:06:45.842 INFO:teuthology.provision.fog.smithi061:Deploy complete! 2023-07-04T04:06:45.842 DEBUG:teuthology.parallel:result is None 2023-07-04T04:06:46.026 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com 2023-07-04T04:06:46.027 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-04T04:06:46.065 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2023-07-04T04:06:46.066 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-04T04:06:46.092 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server 2023-07-04T04:06:46.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-07-04T04:06:46.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:06:46.161 DEBUG:teuthology.orchestra.run.smithi061:> true 2023-07-04T04:06:46.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-07-04T04:06:46.231 DEBUG:teuthology.orchestra.run.smithi061:> uname -m 2023-07-04T04:06:46.289 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2023-07-04T04:06:46.290 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-07-04T04:06:46.348 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="CentOS Stream" 2023-07-04T04:06:46.348 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8" 2023-07-04T04:06:46.348 INFO:teuthology.orchestra.run.smithi061.stdout:ID="centos" 2023-07-04T04:06:46.348 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="rhel fedora" 2023-07-04T04:06:46.349 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8" 2023-07-04T04:06:46.349 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2023-07-04T04:06:46.349 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-04T04:06:46.349 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2023-07-04T04:06:46.349 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-04T04:06:46.349 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://centos.org/" 2023-07-04T04:06:46.349 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-04T04:06:46.350 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-04T04:06:46.350 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-04T04:06:46.350 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-07-04T04:06:46.374 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2023-07-04T04:06:46.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-07-04T04:06:46.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-04T04:06:46.441 DEBUG:teuthology.orchestra.run.smithi071:> true 2023-07-04T04:06:46.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-07-04T04:06:46.470 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2023-07-04T04:06:46.530 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2023-07-04T04:06:46.530 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-07-04T04:06:46.589 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2023-07-04T04:06:46.590 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8" 2023-07-04T04:06:46.590 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2023-07-04T04:06:46.590 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2023-07-04T04:06:46.590 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8" 2023-07-04T04:06:46.590 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2023-07-04T04:06:46.591 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-04T04:06:46.591 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-07-04T04:06:46.591 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-04T04:06:46.591 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2023-07-04T04:06:46.591 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-04T04:06:46.591 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-04T04:06:46.591 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-04T04:06:46.592 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-07-04T04:06:46.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:06:46.616 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:06:46.724 INFO:teuthology.dispatcher.supervisor:Running job 7325926 2023-07-04T04:06:46.725 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_prsrivas@teuthology --archive /home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325926 --name prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} -- /home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325926/orig.config.yaml 2023-07-04T04:06:46.728 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325926 2023-07-04T04:06:46.729 INFO:teuthology.dispatcher.supervisor:Job PID: 11810 2023-07-04T04:06:46.730 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-04T04:08:46.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:08:46.829 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:10:47.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:10:47.022 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:12:47.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:12:47.262 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:14:47.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:14:47.458 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:16:47.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:16:47.642 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:18:47.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:18:47.826 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:20:48.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:20:48.010 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:22:48.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:22:48.194 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:24:48.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:24:48.378 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:26:48.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:26:48.561 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:28:48.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:28:48.738 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:30:48.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:30:48.910 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:32:49.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:32:49.068 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:34:49.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:34:49.225 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:36:49.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:36:49.394 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:38:49.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:38:49.570 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:40:49.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:40:49.738 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:42:49.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:42:49.859 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:44:50.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-04T04:44:50.027 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-04T04:44:50.091 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-04T04:44:50.206 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-04T04:44:50.206 INFO:teuthology.nuke:Checking targets against current locks 2023-07-04T04:44:50.256 DEBUG:teuthology.nuke:shortname: smithi061 2023-07-04T04:44:50.257 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-04T04:44:50.288 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325926', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-04 04:01:39.893910', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOd6hCfVvqxy611QIkDZr+LJOb3g7cQpME/xE8Oyv6CPXplyIQ38OCS06aeRa6pB1+YozYjTmuSi+xoLmhxeqVY='} 2023-07-04T04:44:50.291 DEBUG:teuthology.nuke:shortname: smithi071 2023-07-04T04:44:50.291 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-04T04:44:50.316 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-04_03:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7325926', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-04 04:01:39.892541', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzJlVy6gkS2LmHX+kWSHac3aemoWG1F4YmmxpZ/qtyOo1msz/MBPvu/rUuPlIMhqSy/OQK12o6waEQ1+Dk+uhl+iTbVElSHKlYePie8jz58WuCIpdo1oOd2HDwGPYQ/DJKlmbksZLT5PQTdIUVg0mJSnEKag3jf1yU1lG71e+4XDTrHaGOxbsXULn32/xfuPrBp36ZFC+7rEtRvGxAU1+3Rz562rrkQl+WJLYoWr3M0FX8k86WTJSTmKqhme1iMt1+564XLync4ATgm/KdbgwaUZXiRSCW6zH9Ka+DrLeQB77QQjWJEHQNiJ5smNi6xNoBt+EeKh7/hO+6M8UPfFqqQuKdbmr3Hh6lzgixeeR0eiV4oi+srM0p7vc3ce40ilX7qy4TDQZQxN7VzeSEgrMPdJi0wLNdag415OOSMCGMDMBEGiHa3LuNTTuD+43RZDDEw3zeTuoFISc8USW9sNuF16NnlGAjLFsjiYoP4orO2njWa821rj2xjI0HibMJkpM='} 2023-07-04T04:44:50.352 INFO:teuthology.orchestra.console:Power off smithi061 2023-07-04T04:44:50.353 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T04:44:50.375 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:44:50.392 INFO:teuthology.orchestra.console:Power off smithi071 2023-07-04T04:44:50.393 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-04T04:44:50.415 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-04T04:44:50.504 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2023-07-04T04:44:50.538 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2023-07-04T04:44:50.665 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com 2023-07-04T04:44:50.681 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com