2023-06-29T19:31:28.098 INFO:root:teuthology version: 0.0.1.dev134+ge25bf39 2023-06-29T19:31:28.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:31:28.099 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:31:28.248 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f37074978b0>, signals=[15]) 2023-06-29T19:31:28.249 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging 2023-06-29T19:31:28.250 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server 2023-06-29T19:31:28.250 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-06-29T19:31:28.274 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging 2023-06-29T19:31:28.275 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server 2023-06-29T19:31:28.275 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-06-29T19:31:28.277 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /host {"name": "smithi071"} 2023-06-29T19:31:28.299 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /host {"name": "smithi117"} 2023-06-29T19:31:28.367 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-29T19:31:28.373 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-29T19:31:28.414 DEBUG:teuthology.provision.fog.smithi071:Requesting image smithi_centos_8.stream (ID 3) 2023-06-29T19:31:28.415 DEBUG:teuthology.provision.fog.smithi071:FOG request: PUT /host/176 {"imageID": 3} 2023-06-29T19:31:28.419 DEBUG:teuthology.provision.fog.smithi117:Requesting image smithi_centos_8.stream (ID 3) 2023-06-29T19:31:28.419 DEBUG:teuthology.provision.fog.smithi117:FOG request: PUT /host/222 {"imageID": 3} 2023-06-29T19:31:28.460 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of centos 8.stream 2023-06-29T19:31:28.460 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-29T19:31:28.465 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of centos 8.stream 2023-06-29T19:31:28.465 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-06-29T19:31:28.543 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /tasktype {"name": "deploy"} 2023-06-29T19:31:28.547 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /tasktype {"name": "deploy"} 2023-06-29T19:31:28.577 DEBUG:teuthology.provision.fog.smithi071:FOG request: POST /host/176/task {"taskTypeID": 1} 2023-06-29T19:31:28.583 DEBUG:teuthology.provision.fog.smithi117:FOG request: POST /host/222/task {"taskTypeID": 1} 2023-06-29T19:31:28.630 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-29T19:31:28.633 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-06-29T19:31:28.767 INFO:teuthology.orchestra.console:Power off smithi117 2023-06-29T19:31:28.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T19:31:28.782 INFO:teuthology.orchestra.console:Power off smithi071 2023-06-29T19:31:28.783 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T19:31:28.794 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:31:28.804 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:31:32.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:31:32.827 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:31:36.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:31:36.937 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:31:37.140 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2023-06-29T19:31:37.242 INFO:teuthology.orchestra.console:Power on smithi117 2023-06-29T19:31:37.242 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-29T19:31:37.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:31:41.049 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:31:41.260 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2023-06-29T19:31:41.286 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:31:41.362 INFO:teuthology.orchestra.console:Power on smithi071 2023-06-29T19:31:41.362 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-29T19:31:41.383 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:31:45.400 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:31:45.409 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:31:45.612 INFO:teuthology.orchestra.console:Power on for smithi117 completed 2023-06-29T19:31:45.621 INFO:teuthology.orchestra.console:Power on for smithi071 completed 2023-06-29T19:31:45.713 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish 2023-06-29T19:31:45.714 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-06-29T19:31:45.722 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2023-06-29T19:31:45.723 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-29T19:32:00.837 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-06-29T19:32:00.838 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-29T19:32:15.944 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-06-29T19:32:15.947 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-29T19:32:31.052 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-29T19:32:31.053 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-06-29T19:32:46.144 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-29T19:32:46.145 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-06-29T19:33:01.236 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-06-29T19:33:01.238 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-29T19:33:16.324 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-06-29T19:33:16.325 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-29T19:33:31.430 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-06-29T19:33:31.431 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-29T19:33:46.524 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-06-29T19:33:46.526 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-29T19:34:01.607 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-06-29T19:34:01.608 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-29T19:34:16.688 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-06-29T19:34:16.689 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-29T19:34:31.760 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-06-29T19:34:31.761 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-29T19:34:31.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:34.896 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-06-29T19:34:40.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:43.952 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-06-29T19:34:46.844 DEBUG:teuthology.provision.fog.smithi071:FOG request: GET /task/active None 2023-06-29T19:34:46.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:49.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:49.968 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-06-29T19:34:53.008 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-06-29T19:34:55.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:59.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:34:59.028 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-06-29T19:35:02.064 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-06-29T19:35:05.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:35:08.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:35:08.112 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-06-29T19:35:11.120 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-06-29T19:35:14.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:35:17.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:35:17.172 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-06-29T19:35:20.176 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-06-29T19:35:23.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:35:26.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:35:26.256 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71 2023-06-29T19:35:29.232 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-06-29T19:35:32.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:35:35.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:36:32.321 WARNING:teuthology.provision.fog.smithi071:timed out 2023-06-29T19:36:35.240 WARNING:teuthology.provision.fog.smithi117:timed out 2023-06-29T19:36:38.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:36:38.558 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-29T19:36:38.560 DEBUG:teuthology.orchestra.run.smithi071:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-29T19:36:38.791 INFO:teuthology.provision.fog.smithi071:Node is ready 2023-06-29T19:36:38.791 DEBUG:teuthology.orchestra.run.smithi071:> hostname 2023-06-29T19:36:38.811 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2023-06-29T19:36:38.811 DEBUG:teuthology.orchestra.run.smithi071:> grep smithi071.front.sepia.ceph.com /etc/hosts 2023-06-29T19:36:38.871 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2023-06-29T19:36:38.872 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2023-06-29T19:36:38.985 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hosts 2023-06-29T19:36:39.015 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/172.21.15.71/172.21.15.71/g' /etc/hosts 2023-06-29T19:36:39.083 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hostname 2023-06-29T19:36:39.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071 2023-06-29T19:36:39.218 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-06-29T19:36:39.276 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2023-06-29T19:36:39.276 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8" 2023-06-29T19:36:39.276 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2023-06-29T19:36:39.276 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2023-06-29T19:36:39.277 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8" 2023-06-29T19:36:39.277 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2023-06-29T19:36:39.277 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-29T19:36:39.277 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-06-29T19:36:39.277 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-29T19:36:39.277 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2023-06-29T19:36:39.277 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T19:36:39.278 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T19:36:39.278 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-29T19:36:39.278 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2023-06-29T19:36:39.280 DEBUG:teuthology.parallel:result is None 2023-06-29T19:36:41.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:36:41.474 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-29T19:36:41.474 DEBUG:teuthology.orchestra.run.smithi117:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-29T19:36:41.765 INFO:teuthology.provision.fog.smithi117:Node is ready 2023-06-29T19:36:41.765 DEBUG:teuthology.orchestra.run.smithi117:> hostname 2023-06-29T19:36:41.784 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com 2023-06-29T19:36:41.785 DEBUG:teuthology.orchestra.run.smithi117:> grep smithi117.front.sepia.ceph.com /etc/hosts 2023-06-29T19:36:41.843 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117 2023-06-29T19:36:41.843 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2023-06-29T19:36:41.956 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hosts 2023-06-29T19:36:41.986 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/172.21.15.117/172.21.15.117/g' /etc/hosts 2023-06-29T19:36:42.054 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hostname 2023-06-29T19:36:42.122 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2023-06-29T19:36:42.189 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2023-06-29T19:36:42.247 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2023-06-29T19:36:42.247 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8" 2023-06-29T19:36:42.247 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2023-06-29T19:36:42.248 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2023-06-29T19:36:42.248 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8" 2023-06-29T19:36:42.248 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8" 2023-06-29T19:36:42.248 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-29T19:36:42.248 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2023-06-29T19:36:42.248 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-29T19:36:42.248 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2023-06-29T19:36:42.249 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T19:36:42.249 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T19:36:42.249 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-29T19:36:42.249 INFO:teuthology.provision.fog.smithi117:Deploy complete! 2023-06-29T19:36:42.250 DEBUG:teuthology.parallel:result is None 2023-06-29T19:36:42.402 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2023-06-29T19:36:42.404 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-29T19:36:42.433 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com 2023-06-29T19:36:42.433 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-29T19:36:42.459 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2023-06-29T19:36:42.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2023-06-29T19:36:42.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:36:42.528 DEBUG:teuthology.orchestra.run.smithi071:> true 2023-06-29T19:36:42.602 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2023-06-29T19:36:42.663 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2023-06-29T19:36:42.664 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2023-06-29T19:36:42.724 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2023-06-29T19:36:42.724 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8" 2023-06-29T19:36:42.725 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2023-06-29T19:36:42.725 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2023-06-29T19:36:42.725 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8" 2023-06-29T19:36:42.725 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2023-06-29T19:36:42.725 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-29T19:36:42.725 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2023-06-29T19:36:42.726 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-29T19:36:42.726 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2023-06-29T19:36:42.726 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T19:36:42.726 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T19:36:42.726 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-29T19:36:42.727 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2023-06-29T19:36:42.749 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server 2023-06-29T19:36:42.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-06-29T19:36:42.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:36:42.816 DEBUG:teuthology.orchestra.run.smithi117:> true 2023-06-29T19:36:42.882 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2023-06-29T19:36:42.940 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2023-06-29T19:36:42.940 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2023-06-29T19:36:42.998 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2023-06-29T19:36:42.998 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8" 2023-06-29T19:36:42.998 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2023-06-29T19:36:42.999 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2023-06-29T19:36:42.999 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8" 2023-06-29T19:36:42.999 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8" 2023-06-29T19:36:42.999 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-29T19:36:42.999 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2023-06-29T19:36:42.999 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-29T19:36:42.999 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2023-06-29T19:36:43.000 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-29T19:36:43.000 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-29T19:36:43.000 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-29T19:36:43.000 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-06-29T19:36:43.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:36:43.025 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:36:43.120 INFO:teuthology.dispatcher.supervisor:Running job 7321552 2023-06-29T19:36:43.121 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321552 --name adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi --description orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} -- /home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321552/orig.config.yaml 2023-06-29T19:36:43.124 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321552 2023-06-29T19:36:43.125 INFO:teuthology.dispatcher.supervisor:Job PID: 13643 2023-06-29T19:36:43.125 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-29T19:38:43.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:38:43.226 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:40:43.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:40:43.413 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:42:43.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:42:43.586 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:44:43.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:44:43.763 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:46:43.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:46:43.942 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:48:44.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:48:44.115 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:50:44.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:50:44.291 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:52:44.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:52:44.467 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:54:44.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:54:44.642 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:56:44.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:56:44.826 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:58:45.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:58:45.010 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:00:45.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:00:45.185 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:02:45.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:02:45.578 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:04:45.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:04:45.770 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:06:46.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:06:46.040 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:08:46.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:08:46.206 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:10:46.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:10:46.390 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:12:46.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:12:46.557 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:14:46.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:14:46.725 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:16:46.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T20:16:46.893 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T20:16:46.969 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-29T20:16:47.088 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-29T20:16:47.089 INFO:teuthology.nuke:Checking targets against current locks 2023-06-29T20:16:47.148 DEBUG:teuthology.nuke:shortname: smithi071 2023-06-29T20:16:47.149 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-29T20:16:47.164 DEBUG:teuthology.nuke:shortname: smithi117 2023-06-29T20:16:47.164 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-29T20:16:47.171 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321552', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-29 19:31:27.237988', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMQxSqhsyCYpIDRhLUkly75BSQ7pJp8vdG34gxd5mT7O9cF0zMkiSFZTxlTe2BvGTxAJubNEswQQr1Ebt9A/b3Q='} 2023-06-29T20:16:47.188 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321552', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-29 19:31:27.240364', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQaTuYw7BRyGt+gdovaN5QbK4hDBiU7dzS4i0xIxLX7+OO0XDzfy4Vg0rEOpMfhBeici963VeYl9ViKhx7i4YgH/4aq+tHlfco/qdKw6n0rHUwDH6buA5ySvAhh2DWlt8wRqNh6Fmiygdr5SlwPGHIe4EgrkFnnsNi53yz2E9wEjP9eewLXS9x9fFzBYNFZG8zO/cDxNwHShgfAipsRfZLc426kxsCO4H/UNVg2sEWbogP6jupNipjiTUfyz0Kexi6JekxB0Cyh1u5p2K4vZBW2BxpohOGaqAEHxMvQbHi/KeHIqM/7laQWdci2ki7OT9wEK+gGZkppsda8Gk1Kah2jHl9QuGfnTAC1dAa7vawSU3SmINyPk1jK4415KD2B1TYL32ygJPj/c/dqGaeTzdd77tF+Zmz5gn+jyi138Ed8ffSmwdy13PeSPht0LMP7rM0USNi2ey67yxo1dkn9xjN49NrZAOBfcLrJ693244T7v+y9uBbP8M7rfSnuRaUHhs='} 2023-06-29T20:16:47.229 INFO:teuthology.orchestra.console:Power off smithi071 2023-06-29T20:16:47.229 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T20:16:47.252 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T20:16:47.273 INFO:teuthology.orchestra.console:Power off smithi117 2023-06-29T20:16:47.273 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T20:16:47.296 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T20:16:47.385 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2023-06-29T20:16:47.432 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2023-06-29T20:16:47.542 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com 2023-06-29T20:16:47.584 INFO:teuthology.lock.ops:unlocked: smithi117.front.sepia.ceph.com