2023-07-06T15:18:48.885 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-06T15:18:48.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:18:48.887 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:18:49.043 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9bf65318b0>, signals=[15]) 2023-07-06T15:18:49.045 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2023-07-06T15:18:49.046 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T15:18:49.046 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-07-06T15:18:49.068 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2023-07-06T15:18:49.068 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T15:18:49.068 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-07-06T15:18:49.069 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"} 2023-07-06T15:18:49.093 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /host {"name": "smithi111"} 2023-07-06T15:18:49.143 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-06T15:18:49.161 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-06T15:18:49.184 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_8.stream (ID 3) 2023-07-06T15:18:49.185 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 3} 2023-07-06T15:18:49.200 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_centos_8.stream (ID 3) 2023-07-06T15:18:49.200 DEBUG:teuthology.provision.fog.smithi111:FOG request: PUT /host/216 {"imageID": 3} 2023-07-06T15:18:49.228 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 8.stream 2023-07-06T15:18:49.228 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:18:49.244 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 8.stream 2023-07-06T15:18:49.244 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:18:49.301 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T15:18:49.304 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T15:18:49.340 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1} 2023-07-06T15:18:49.347 DEBUG:teuthology.provision.fog.smithi111:FOG request: POST /host/216/task {"taskTypeID": 1} 2023-07-06T15:18:49.397 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:18:49.403 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:18:49.498 INFO:teuthology.orchestra.console:Power off smithi062 2023-07-06T15:18:49.499 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T15:18:49.512 INFO:teuthology.orchestra.console:Power off smithi111 2023-07-06T15:18:49.512 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T15:18:49.521 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:49.533 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:49.655 INFO:teuthology.orchestra.console:Power off for smithi111 completed 2023-07-06T15:18:49.756 INFO:teuthology.orchestra.console:Power on smithi111 2023-07-06T15:18:49.756 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T15:18:49.777 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:53.544 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:53.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:57.656 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:57.911 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:58.119 INFO:teuthology.orchestra.console:Power on for smithi111 completed 2023-07-06T15:18:58.220 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2023-07-06T15:18:58.221 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:19:01.769 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:19:01.978 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2023-07-06T15:19:02.079 INFO:teuthology.orchestra.console:Power on smithi062 2023-07-06T15:19:02.080 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T15:19:02.099 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:19:06.123 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:19:06.333 INFO:teuthology.orchestra.console:Power on for smithi062 completed 2023-07-06T15:19:06.434 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2023-07-06T15:19:06.434 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:19:13.305 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:19:21.522 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:19:28.396 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:19:36.612 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:19:43.473 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:19:51.705 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:19:58.565 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:20:06.806 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:20:13.648 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:20:21.891 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:20:28.728 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:20:36.983 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:20:43.811 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:20:52.084 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:20:58.898 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:21:07.191 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:21:13.990 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:21:22.283 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:21:29.080 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:21:37.380 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:21:44.149 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:21:52.462 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:21:59.230 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:22:07.548 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:22:14.308 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:22:22.626 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:22:29.391 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-07-06T15:22:29.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:22:29.523 ERROR:teuthology.orchestra.connection:Error authenticating with smithi111.front.sepia.ceph.com: Authentication failed. 2023-07-06T15:22:29.525 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T15:22:29.526 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T15:22:29.527 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-06T15:22:37.695 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-07-06T15:22:37.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:22:56.240 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-06T15:23:02.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:05.296 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-06T15:23:11.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:14.352 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-06T15:23:20.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:23.408 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-07-06T15:23:29.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:24:29.411 WARNING:teuthology.provision.fog.smithi062:timed out 2023-07-06T15:24:35.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:24:35.660 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T15:24:35.660 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T15:24:35.907 INFO:teuthology.provision.fog.smithi062:Node is ready 2023-07-06T15:24:35.907 DEBUG:teuthology.orchestra.run.smithi062:> hostname 2023-07-06T15:24:35.926 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2023-07-06T15:24:35.927 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts 2023-07-06T15:24:35.985 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2023-07-06T15:24:35.986 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-07-06T15:24:36.089 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts 2023-07-06T15:24:36.118 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts 2023-07-06T15:24:36.187 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname 2023-07-06T15:24:36.255 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-07-06T15:24:36.322 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-07-06T15:24:36.379 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2023-07-06T15:24:36.380 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8" 2023-07-06T15:24:36.380 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2023-07-06T15:24:36.380 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2023-07-06T15:24:36.380 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8" 2023-07-06T15:24:36.380 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-07-06T15:24:36.380 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T15:24:36.381 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-07-06T15:24:36.381 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T15:24:36.381 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2023-07-06T15:24:36.381 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T15:24:36.381 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T15:24:36.381 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T15:24:36.382 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2023-07-06T15:24:36.383 DEBUG:teuthology.parallel:result is None 2023-07-06T15:26:08.496 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-06T15:26:08.497 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi111 2023-07-06T15:26:17.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-07-06T15:26:17.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:26:17.752 DEBUG:teuthology.orchestra.run.smithi111:> true 2023-07-06T15:26:18.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-07-06T15:26:18.004 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T15:26:18.004 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T15:26:18.022 INFO:teuthology.provision.fog.smithi111:Node is ready 2023-07-06T15:26:18.023 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2023-07-06T15:26:18.081 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2023-07-06T15:26:18.081 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts 2023-07-06T15:26:18.141 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2023-07-06T15:26:18.141 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-07-06T15:26:18.248 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts 2023-07-06T15:26:18.276 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts 2023-07-06T15:26:18.345 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname 2023-07-06T15:26:18.413 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-07-06T15:26:18.479 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-07-06T15:26:18.537 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2023-07-06T15:26:18.538 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8" 2023-07-06T15:26:18.538 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2023-07-06T15:26:18.538 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2023-07-06T15:26:18.538 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8" 2023-07-06T15:26:18.538 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8" 2023-07-06T15:26:18.538 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T15:26:18.538 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2023-07-06T15:26:18.539 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T15:26:18.539 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2023-07-06T15:26:18.539 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T15:26:18.539 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T15:26:18.539 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T15:26:18.539 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2023-07-06T15:26:18.540 DEBUG:teuthology.parallel:result is None 2023-07-06T15:26:18.688 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2023-07-06T15:26:18.689 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-06T15:26:18.719 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2023-07-06T15:26:18.719 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-06T15:26:18.745 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2023-07-06T15:26:18.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-07-06T15:26:18.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:26:18.814 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-07-06T15:26:18.951 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-07-06T15:26:18.951 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-07-06T15:26:19.009 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-07-06T15:26:19.009 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-07-06T15:26:19.067 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2023-07-06T15:26:19.067 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8" 2023-07-06T15:26:19.067 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2023-07-06T15:26:19.068 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2023-07-06T15:26:19.068 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8" 2023-07-06T15:26:19.068 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-07-06T15:26:19.068 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T15:26:19.068 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-07-06T15:26:19.068 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T15:26:19.068 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2023-07-06T15:26:19.069 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T15:26:19.069 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T15:26:19.069 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T15:26:19.069 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-07-06T15:26:19.094 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2023-07-06T15:26:19.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-07-06T15:26:19.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:26:19.159 DEBUG:teuthology.orchestra.run.smithi111:> true 2023-07-06T15:26:19.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-07-06T15:26:19.226 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2023-07-06T15:26:19.283 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2023-07-06T15:26:19.284 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-07-06T15:26:19.341 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2023-07-06T15:26:19.341 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8" 2023-07-06T15:26:19.342 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2023-07-06T15:26:19.342 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2023-07-06T15:26:19.342 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8" 2023-07-06T15:26:19.342 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8" 2023-07-06T15:26:19.342 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T15:26:19.342 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2023-07-06T15:26:19.342 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T15:26:19.343 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2023-07-06T15:26:19.343 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T15:26:19.343 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T15:26:19.343 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T15:26:19.343 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-07-06T15:26:19.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:26:19.369 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:26:19.456 INFO:teuthology.dispatcher.supervisor:Running job 7328103 2023-07-06T15:26:19.457 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_akupczyk@teuthology --archive /home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328103 --name akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328103/orig.config.yaml 2023-07-06T15:26:19.459 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328103 2023-07-06T15:26:19.460 INFO:teuthology.dispatcher.supervisor:Job PID: 30303 2023-07-06T15:26:19.460 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-06T15:28:19.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:28:19.462 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:30:19.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:30:19.530 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:32:19.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:32:19.621 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:34:19.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:34:19.792 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:36:19.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:36:19.970 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:38:20.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:38:20.137 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:40:20.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:40:20.308 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:42:20.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:42:20.435 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:44:20.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:44:20.586 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:46:20.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:46:20.705 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:48:20.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:48:20.852 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:50:20.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:50:20.999 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:52:21.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:52:21.170 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:54:21.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:54:21.266 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:56:21.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:56:21.421 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:58:21.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:58:21.582 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:00:21.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:00:21.737 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:02:21.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:02:21.899 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:04:22.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:04:22.070 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:06:22.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:06:22.247 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:08:22.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:08:22.393 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:10:22.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:10:22.475 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:12:22.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:12:22.642 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:14:22.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:14:22.803 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:16:22.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:16:22.962 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:18:28.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:18:28.049 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:20:31.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:20:31.338 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:22:31.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:22:31.469 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:24:31.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:24:31.642 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:24:31.714 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-06T16:24:31.821 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-06T16:24:31.821 INFO:teuthology.nuke:Checking targets against current locks 2023-07-06T16:24:31.872 DEBUG:teuthology.nuke:shortname: smithi062 2023-07-06T16:24:31.873 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T16:24:31.897 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328103', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 15:18:48.090393', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOapAxnn7eOFmr+9c9XGcFIFY7VtczmNWG+1Jq8RPEZb04PlXxI+PcHBXl14O17b3tce6amv5ELUlzvG9CA34c0='} 2023-07-06T16:24:31.899 DEBUG:teuthology.nuke:shortname: smithi111 2023-07-06T16:24:31.899 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T16:24:31.923 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328103', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 15:18:48.088881', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL8hsA8kkK3YRJoPYG2CDr42SuM+qar+QutEvBDDfQtOBlCO3+Rtl+eFd1kAU+DhLZDy/aeolnNDmVQjhNTkH1s='} 2023-07-06T16:24:31.951 INFO:teuthology.orchestra.console:Power off smithi062 2023-07-06T16:24:31.951 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T16:24:31.971 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T16:24:31.992 INFO:teuthology.orchestra.console:Power off smithi111 2023-07-06T16:24:31.993 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T16:24:32.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T16:24:32.101 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2023-07-06T16:24:32.133 INFO:teuthology.orchestra.console:Power off for smithi111 completed 2023-07-06T16:24:32.266 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com 2023-07-06T16:24:32.280 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com