2023-07-06T15:18:48.384 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-06T15:18:48.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:18:48.386 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:18:48.525 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f812b3da8b0>, signals=[15]) 2023-07-06T15:18:48.527 INFO:teuthology.lock.ops:Start node 'smithi042.front.sepia.ceph.com' reimaging 2023-07-06T15:18:48.527 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T15:18:48.528 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2023-07-06T15:18:48.551 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging 2023-07-06T15:18:48.552 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T15:18:48.552 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2023-07-06T15:18:48.553 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /host {"name": "smithi042"} 2023-07-06T15:18:48.576 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /host {"name": "smithi137"} 2023-07-06T15:18:48.618 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-06T15:18:48.634 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-06T15:18:48.657 DEBUG:teuthology.provision.fog.smithi042:Requesting image smithi_centos_8.stream (ID 3) 2023-07-06T15:18:48.657 DEBUG:teuthology.provision.fog.smithi042:FOG request: PUT /host/147 {"imageID": 3} 2023-07-06T15:18:48.671 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_centos_8.stream (ID 3) 2023-07-06T15:18:48.672 DEBUG:teuthology.provision.fog.smithi137:FOG request: PUT /host/242 {"imageID": 3} 2023-07-06T15:18:48.692 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of centos 8.stream 2023-07-06T15:18:48.692 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-06T15:18:48.717 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of centos 8.stream 2023-07-06T15:18:48.718 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:18:48.758 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T15:18:48.775 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T15:18:48.793 DEBUG:teuthology.provision.fog.smithi042:FOG request: POST /host/147/task {"taskTypeID": 1} 2023-07-06T15:18:48.809 DEBUG:teuthology.provision.fog.smithi137:FOG request: POST /host/242/task {"taskTypeID": 1} 2023-07-06T15:18:48.856 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:18:48.858 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-06T15:18:48.958 INFO:teuthology.orchestra.console:Power off smithi137 2023-07-06T15:18:48.959 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T15:18:48.973 INFO:teuthology.orchestra.console:Power off smithi042 2023-07-06T15:18:48.974 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T15:18:48.982 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:48.992 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:49.112 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2023-07-06T15:18:49.213 INFO:teuthology.orchestra.console:Power on smithi042 2023-07-06T15:18:49.213 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T15:18:49.232 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:53.006 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:53.253 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:57.119 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:57.364 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:18:57.573 INFO:teuthology.orchestra.console:Power on for smithi042 completed 2023-07-06T15:18:57.674 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish 2023-07-06T15:18:57.674 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-06T15:19:01.233 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:19:01.442 INFO:teuthology.orchestra.console:Power off for smithi137 completed 2023-07-06T15:19:01.542 INFO:teuthology.orchestra.console:Power on smithi137 2023-07-06T15:19:01.543 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T15:19:01.563 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:19:05.584 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:19:09.697 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T15:19:09.907 INFO:teuthology.orchestra.console:Power on for smithi137 completed 2023-07-06T15:19:10.007 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish 2023-07-06T15:19:10.008 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:19:12.754 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-06T15:19:25.113 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:19:27.832 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-06T15:19:40.215 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:19:42.908 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-06T15:19:55.316 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:19:57.983 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-06T15:20:10.414 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:20:13.057 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-06T15:20:25.511 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:20:28.142 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-06T15:20:40.610 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:20:43.219 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-06T15:20:55.718 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:20:58.291 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-06T15:21:10.819 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:21:13.400 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-06T15:21:25.915 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:21:28.482 DEBUG:teuthology.provision.fog.smithi042:FOG request: GET /task/active None 2023-07-06T15:21:28.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:21:41.004 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:21:47.120 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-07-06T15:21:53.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:21:56.083 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:21:56.176 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-07-06T15:22:02.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:22:05.232 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-07-06T15:22:11.161 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:22:11.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:22:14.288 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2023-07-06T15:22:20.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:22:26.225 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-07-06T15:22:26.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:22:44.720 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-06T15:22:50.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:22:53.808 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-06T15:22:59.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:02.864 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-06T15:23:08.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:11.924 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-06T15:23:17.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:20.299 WARNING:teuthology.provision.fog.smithi042:timed out 2023-07-06T15:23:21.008 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-07-06T15:23:26.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:26.531 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T15:23:26.532 DEBUG:teuthology.orchestra.run.smithi042:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T15:23:26.807 INFO:teuthology.provision.fog.smithi042:Node is ready 2023-07-06T15:23:26.807 DEBUG:teuthology.orchestra.run.smithi042:> hostname 2023-07-06T15:23:26.825 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com 2023-07-06T15:23:26.826 DEBUG:teuthology.orchestra.run.smithi042:> grep smithi042.front.sepia.ceph.com /etc/hosts 2023-07-06T15:23:26.888 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042 2023-07-06T15:23:26.888 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042 2023-07-06T15:23:26.993 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hosts 2023-07-06T15:23:27.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:23:27.023 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/172.21.15.42/172.21.15.42/g' /etc/hosts 2023-07-06T15:23:27.095 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hostname 2023-07-06T15:23:27.165 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042 2023-07-06T15:23:27.235 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2023-07-06T15:23:27.297 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2023-07-06T15:23:27.297 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="8" 2023-07-06T15:23:27.297 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2023-07-06T15:23:27.298 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2023-07-06T15:23:27.298 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="8" 2023-07-06T15:23:27.298 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el8" 2023-07-06T15:23:27.298 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T15:23:27.298 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2023-07-06T15:23:27.298 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T15:23:27.298 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2023-07-06T15:23:27.299 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T15:23:27.299 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T15:23:27.299 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T15:23:27.300 INFO:teuthology.provision.fog.smithi042:Deploy complete! 2023-07-06T15:23:27.301 DEBUG:teuthology.parallel:result is None 2023-07-06T15:24:27.057 WARNING:teuthology.provision.fog.smithi137:timed out 2023-07-06T15:24:33.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:24:33.293 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T15:24:33.293 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T15:24:33.581 INFO:teuthology.provision.fog.smithi137:Node is ready 2023-07-06T15:24:33.582 DEBUG:teuthology.orchestra.run.smithi137:> hostname 2023-07-06T15:24:33.600 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com 2023-07-06T15:24:33.600 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi137.front.sepia.ceph.com /etc/hosts 2023-07-06T15:24:33.659 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137 2023-07-06T15:24:33.660 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2023-07-06T15:24:33.756 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hosts 2023-07-06T15:24:33.784 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.137/172.21.15.137/g' /etc/hosts 2023-07-06T15:24:33.851 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hostname 2023-07-06T15:24:33.919 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2023-07-06T15:24:33.984 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2023-07-06T15:24:34.042 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2023-07-06T15:24:34.042 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8" 2023-07-06T15:24:34.043 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2023-07-06T15:24:34.043 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2023-07-06T15:24:34.043 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8" 2023-07-06T15:24:34.043 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2023-07-06T15:24:34.043 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T15:24:34.043 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2023-07-06T15:24:34.043 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T15:24:34.044 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2023-07-06T15:24:34.044 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T15:24:34.044 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T15:24:34.044 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T15:24:34.044 INFO:teuthology.provision.fog.smithi137:Deploy complete! 2023-07-06T15:24:34.045 DEBUG:teuthology.parallel:result is None 2023-07-06T15:24:34.193 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com 2023-07-06T15:24:34.194 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-06T15:24:34.219 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com 2023-07-06T15:24:34.220 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-06T15:24:34.245 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server 2023-07-06T15:24:34.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2023-07-06T15:24:34.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:24:34.313 DEBUG:teuthology.orchestra.run.smithi042:> true 2023-07-06T15:24:34.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2023-07-06T15:24:34.452 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2023-07-06T15:24:34.510 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2023-07-06T15:24:34.511 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2023-07-06T15:24:34.569 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2023-07-06T15:24:34.569 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="8" 2023-07-06T15:24:34.570 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2023-07-06T15:24:34.570 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2023-07-06T15:24:34.570 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="8" 2023-07-06T15:24:34.570 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el8" 2023-07-06T15:24:34.570 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T15:24:34.570 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2023-07-06T15:24:34.570 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T15:24:34.571 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2023-07-06T15:24:34.571 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T15:24:34.571 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T15:24:34.571 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T15:24:34.572 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2023-07-06T15:24:34.741 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server 2023-07-06T15:24:34.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-07-06T15:24:34.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T15:24:34.807 DEBUG:teuthology.orchestra.run.smithi137:> true 2023-07-06T15:24:34.875 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-07-06T15:24:34.875 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2023-07-06T15:24:34.933 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2023-07-06T15:24:34.933 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2023-07-06T15:24:34.990 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2023-07-06T15:24:34.990 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8" 2023-07-06T15:24:34.991 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2023-07-06T15:24:34.991 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2023-07-06T15:24:34.991 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8" 2023-07-06T15:24:34.991 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2023-07-06T15:24:34.991 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T15:24:34.991 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2023-07-06T15:24:34.991 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T15:24:34.991 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2023-07-06T15:24:34.992 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T15:24:34.992 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T15:24:34.992 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T15:24:34.992 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2023-07-06T15:24:35.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:24:35.020 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:24:35.112 INFO:teuthology.dispatcher.supervisor:Running job 7328102 2023-07-06T15:24:35.112 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_akupczyk@teuthology --archive /home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328102 --name akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328102/orig.config.yaml 2023-07-06T15:24:35.115 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328102 2023-07-06T15:24:35.116 INFO:teuthology.dispatcher.supervisor:Job PID: 28659 2023-07-06T15:24:35.116 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-06T15:26:35.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:26:35.179 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:28:35.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:28:35.346 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:30:35.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:30:35.518 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:32:35.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:32:35.689 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:34:35.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:34:35.862 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:36:36.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:36:36.142 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:38:36.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:38:36.293 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:40:36.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:40:36.386 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:42:36.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:42:36.541 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:44:36.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:44:36.705 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:46:36.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:46:36.879 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:48:36.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:48:36.974 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:50:37.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:50:37.138 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:52:37.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:52:37.237 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:54:37.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:54:37.400 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:56:37.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:56:37.569 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T15:58:37.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T15:58:37.739 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:00:37.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:00:37.866 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:02:38.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:02:38.025 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:04:38.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:04:38.169 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:06:38.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:06:38.345 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:08:38.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:08:38.516 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:10:38.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:10:38.662 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:12:38.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:12:38.765 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:14:38.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T16:14:38.931 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T16:14:38.994 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-06T16:14:39.098 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-06T16:14:39.098 INFO:teuthology.nuke:Checking targets against current locks 2023-07-06T16:14:39.140 DEBUG:teuthology.nuke:shortname: smithi042 2023-07-06T16:14:39.140 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T16:14:39.164 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328102', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 15:18:47.635675', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBnTsrm3ok2VQdTwxfPKEbbPvnNz/xdBjmdhDJmATpr5F+bxm/HUf5dT7VI++gYoH24Upzn9LdmwL9+ra/GjXSPhhd5s+9swwRTtEqE6FmEBQH5DFR6A+1CwGzCbBbrCzCM0OhKVfLY/MUcs11AonCd2i5zFhAelr99LjeWpdK0JZ0odfcdTA7Jyw5d2h5WGBuCXOK1CP3fKNkgyoBvi8MeJTSgoWTvow+TS0TOUzzcJPeZippf8e3FmTe+AuWkrYJNYWKmxzx20kz2yH1gjpVt/BM4xy073tX9RpMcJpfAA1K2TraCCXO/GBcNfKl5lddHQxutmS7XaoefJZg19P01Y1A9t+afgj/suZsELtS4kqP7HyriuQvvOzHqgN4+CFz6WF9m6saKqU34L3nPAoVCQ9vvXkwvrl4/67002RVVc2rao9QQiJyrwRh5PjLDET81UaUvRfd7aBT1ixNrieiem9JReFrc4IrpLEHXXXlrUPgNTsSGMALtQ4JsmQQKCE='} 2023-07-06T16:14:39.166 DEBUG:teuthology.nuke:shortname: smithi137 2023-07-06T16:14:39.166 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T16:14:39.185 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328102', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 15:18:47.634526', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRuT+aA/emBq5wYccLgUwj0DpZuCKZyKr79WeOOqRe2r6x+oC9rkl1zho5/t/p/Gpys+cQTJaTn2ufPkxamt+lGKUtiqIhGkg8sJJoUf9TZD6r++vGYNUXLN9cfRFXCfY6KHJC5Rb865Pc+iyMcNPDTC3GxQMXv3at/NOgnu9uLydg1xjYyXJrxmDlw130ETME0dGypTvMZT5fu1dLgc8OeDiHcRdWg1pD1FBufVxMrqfplpIJt2NzUDIfOSS561hUwEM7z1IIvOyHAguv3XCQ8c3VYysf7MLZOaZg+BdrG8yLOv2qo1Uvkl38fpW65/YGzBbYET39EcQztu6QeN3W8SU+dRqt+b3N+dPKISUQnSdplVPeSuxJVY5ccttda3k4OqfOTurr+2CLT8pN5/H22ZP/TCfajWUotDEq5V3VRGu/Y0LCCOCFBHJcs2+emFGON1uveec6tXOT290yB6GmiW1XRTesMwYxvCDRCLJO/g49EaWpIOFAPqD0k/IsB1k='} 2023-07-06T16:14:39.212 INFO:teuthology.orchestra.console:Power off smithi042 2023-07-06T16:14:39.212 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T16:14:39.226 INFO:teuthology.orchestra.console:Power off smithi137 2023-07-06T16:14:39.226 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T16:14:39.236 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T16:14:39.246 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T16:14:39.358 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2023-07-06T16:14:39.366 INFO:teuthology.orchestra.console:Power off for smithi137 completed 2023-07-06T16:14:39.519 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com 2023-07-06T16:14:39.526 INFO:teuthology.lock.ops:unlocked: smithi042.front.sepia.ceph.com