2023-07-18T20:16:31.981 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-18T20:16:31.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:16:31.983 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:16:32.128 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f20ff6118b0>, signals=[15]) 2023-07-18T20:16:32.130 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2023-07-18T20:16:32.131 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2023-07-18T20:16:32.131 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-07-18T20:16:32.160 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging 2023-07-18T20:16:32.161 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server 2023-07-18T20:16:32.161 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-07-18T20:16:32.162 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /host {"name": "smithi069"} 2023-07-18T20:16:32.184 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /host {"name": "smithi077"} 2023-07-18T20:16:32.230 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-18T20:16:32.249 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-18T20:16:32.269 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_centos_9.stream (ID 10) 2023-07-18T20:16:32.269 DEBUG:teuthology.provision.fog.smithi069:FOG request: PUT /host/174 {"imageID": 10} 2023-07-18T20:16:32.288 DEBUG:teuthology.provision.fog.smithi077:Requesting image smithi_centos_9.stream (ID 10) 2023-07-18T20:16:32.288 DEBUG:teuthology.provision.fog.smithi077:FOG request: PUT /host/182 {"imageID": 10} 2023-07-18T20:16:32.317 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of centos 9.stream 2023-07-18T20:16:32.318 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-18T20:16:32.336 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of centos 9.stream 2023-07-18T20:16:32.336 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-18T20:16:32.361 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /tasktype {"name": "deploy"} 2023-07-18T20:16:32.377 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /tasktype {"name": "deploy"} 2023-07-18T20:16:32.399 DEBUG:teuthology.provision.fog.smithi069:FOG request: POST /host/174/task {"taskTypeID": 1} 2023-07-18T20:16:32.409 DEBUG:teuthology.provision.fog.smithi077:FOG request: POST /host/182/task {"taskTypeID": 1} 2023-07-18T20:16:32.458 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-18T20:16:32.468 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-18T20:16:32.546 INFO:teuthology.orchestra.console:Power off smithi077 2023-07-18T20:16:32.547 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T20:16:32.561 INFO:teuthology.orchestra.console:Power off smithi069 2023-07-18T20:16:32.562 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T20:16:32.571 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T20:16:32.583 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T20:16:32.696 INFO:teuthology.orchestra.console:Power off for smithi077 completed 2023-07-18T20:16:32.704 INFO:teuthology.orchestra.console:Power off for smithi069 completed 2023-07-18T20:16:32.798 INFO:teuthology.orchestra.console:Power on smithi077 2023-07-18T20:16:32.798 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-18T20:16:32.806 INFO:teuthology.orchestra.console:Power on smithi069 2023-07-18T20:16:32.806 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-18T20:16:32.819 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T20:16:32.828 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T20:16:36.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T20:16:36.851 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T20:16:40.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T20:16:40.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T20:16:41.168 INFO:teuthology.orchestra.console:Power on for smithi077 completed 2023-07-18T20:16:41.175 INFO:teuthology.orchestra.console:Power on for smithi069 completed 2023-07-18T20:16:41.270 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish 2023-07-18T20:16:41.270 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-18T20:16:41.276 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2023-07-18T20:16:41.277 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-18T20:16:56.345 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-18T20:16:56.346 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-18T20:17:11.427 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-18T20:17:11.429 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-18T20:17:26.508 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-18T20:17:26.509 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-18T20:17:41.583 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-18T20:17:41.585 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-18T20:17:56.663 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-18T20:17:56.664 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-18T20:18:11.731 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-18T20:18:11.733 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-18T20:18:26.810 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-18T20:18:26.812 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-18T20:18:41.892 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-18T20:18:41.894 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-18T20:18:56.974 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-18T20:18:56.975 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-18T20:19:12.060 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-07-18T20:19:12.061 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-07-18T20:19:12.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:19:12.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:19:30.545 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-18T20:19:30.545 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-18T20:19:36.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:19:36.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:19:39.632 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-18T20:19:39.633 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-18T20:19:45.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:19:45.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:19:48.720 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-18T20:19:48.721 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-18T20:19:54.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:19:54.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:19:57.808 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-18T20:19:57.809 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-18T20:20:03.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:20:03.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:20:06.896 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-18T20:20:06.897 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-18T20:20:12.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:20:12.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:20:15.984 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-07-18T20:20:21.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:20:53.699 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-18T20:20:53.700 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-18T20:21:12.907 WARNING:teuthology.provision.fog.smithi077:timed out 2023-07-18T20:21:18.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:21:19.095 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-18T20:21:19.095 DEBUG:teuthology.orchestra.run.smithi077:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-18T20:21:19.446 INFO:teuthology.provision.fog.smithi077:Node is ready 2023-07-18T20:21:19.447 DEBUG:teuthology.orchestra.run.smithi077:> hostname 2023-07-18T20:21:19.461 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com 2023-07-18T20:21:19.461 DEBUG:teuthology.orchestra.run.smithi077:> grep smithi077.front.sepia.ceph.com /etc/hosts 2023-07-18T20:21:19.515 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077 2023-07-18T20:21:19.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2023-07-18T20:21:19.554 INFO:teuthology.provision.fog.smithi069:Node is ready 2023-07-18T20:21:19.554 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2023-07-18T20:21:19.573 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com 2023-07-18T20:21:19.573 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts 2023-07-18T20:21:19.620 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hosts 2023-07-18T20:21:19.630 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069 2023-07-18T20:21:19.630 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-07-18T20:21:19.647 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/172.21.15.77/172.21.15.77/g' /etc/hosts 2023-07-18T20:21:19.714 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hostname 2023-07-18T20:21:19.759 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts 2023-07-18T20:21:19.781 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2023-07-18T20:21:19.790 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts 2023-07-18T20:21:19.847 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-07-18T20:21:19.861 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname 2023-07-18T20:21:19.901 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2023-07-18T20:21:19.901 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2023-07-18T20:21:19.902 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2023-07-18T20:21:19.902 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2023-07-18T20:21:19.902 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2023-07-18T20:21:19.902 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2023-07-18T20:21:19.902 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-18T20:21:19.902 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2023-07-18T20:21:19.902 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2023-07-18T20:21:19.903 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-18T20:21:19.903 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2023-07-18T20:21:19.903 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T20:21:19.903 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-18T20:21:19.903 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-18T20:21:19.904 INFO:teuthology.provision.fog.smithi077:Deploy complete! 2023-07-18T20:21:19.905 DEBUG:teuthology.parallel:result is None 2023-07-18T20:21:19.935 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-07-18T20:21:20.004 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-07-18T20:21:20.059 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2023-07-18T20:21:20.059 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2023-07-18T20:21:20.060 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2023-07-18T20:21:20.060 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2023-07-18T20:21:20.060 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2023-07-18T20:21:20.060 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2023-07-18T20:21:20.060 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-18T20:21:20.060 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-07-18T20:21:20.060 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2023-07-18T20:21:20.061 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-18T20:21:20.061 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2023-07-18T20:21:20.061 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T20:21:20.061 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-18T20:21:20.061 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-18T20:21:20.061 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2023-07-18T20:21:20.062 DEBUG:teuthology.parallel:result is None 2023-07-18T20:21:20.207 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2023-07-18T20:21:20.208 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-18T20:21:20.256 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com 2023-07-18T20:21:20.257 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-18T20:21:20.291 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2023-07-18T20:21:20.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-07-18T20:21:20.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:21:20.375 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-07-18T20:21:20.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-07-18T20:21:20.443 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-07-18T20:21:20.497 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-07-18T20:21:20.498 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-07-18T20:21:20.553 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2023-07-18T20:21:20.553 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2023-07-18T20:21:20.553 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2023-07-18T20:21:20.553 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2023-07-18T20:21:20.553 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2023-07-18T20:21:20.553 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2023-07-18T20:21:20.554 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-18T20:21:20.554 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-07-18T20:21:20.554 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2023-07-18T20:21:20.554 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-18T20:21:20.554 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2023-07-18T20:21:20.554 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T20:21:20.554 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-18T20:21:20.554 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-18T20:21:20.555 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-07-18T20:21:20.581 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server 2023-07-18T20:21:20.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-07-18T20:21:20.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T20:21:20.664 DEBUG:teuthology.orchestra.run.smithi077:> true 2023-07-18T20:21:20.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-07-18T20:21:20.730 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2023-07-18T20:21:20.783 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2023-07-18T20:21:20.783 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-07-18T20:21:20.837 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2023-07-18T20:21:20.837 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2023-07-18T20:21:20.838 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2023-07-18T20:21:20.838 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2023-07-18T20:21:20.838 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2023-07-18T20:21:20.838 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2023-07-18T20:21:20.838 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-18T20:21:20.838 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2023-07-18T20:21:20.838 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2023-07-18T20:21:20.839 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-18T20:21:20.839 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2023-07-18T20:21:20.839 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T20:21:20.839 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-18T20:21:20.839 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-18T20:21:20.840 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-07-18T20:21:20.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:21:20.865 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:21:20.956 INFO:teuthology.dispatcher.supervisor:Running job 7343028 2023-07-18T20:21:20.957 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2023-07-18_20:13:24-rados-wip-yuri2-testing-2023-07-15-0802-distro-default-smithi/7343028 --name lflores-2023-07-18_20:13:24-rados-wip-yuri2-testing-2023-07-15-0802-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/lflores-2023-07-18_20:13:24-rados-wip-yuri2-testing-2023-07-15-0802-distro-default-smithi/7343028/orig.config.yaml 2023-07-18T20:21:20.961 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2023-07-18_20:13:24-rados-wip-yuri2-testing-2023-07-15-0802-distro-default-smithi/7343028 2023-07-18T20:21:20.961 INFO:teuthology.dispatcher.supervisor:Job PID: 11514 2023-07-18T20:21:20.962 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-18T20:23:21.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:23:21.047 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:25:21.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:25:21.225 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:27:21.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:27:21.406 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:29:21.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:29:21.570 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:31:21.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:31:21.742 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:33:21.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:33:21.914 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:35:22.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:35:22.002 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:37:22.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:37:22.173 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:39:22.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:39:22.350 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:41:22.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:41:22.518 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:43:22.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:43:22.701 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:45:22.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:45:22.878 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:47:23.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:47:23.063 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:49:23.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:49:23.249 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:51:23.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:51:23.438 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:53:23.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:53:23.638 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:55:23.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:55:23.830 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:57:24.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:57:24.027 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T20:59:24.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T20:59:24.199 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:01:24.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:01:24.370 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:03:24.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:03:24.532 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:05:24.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:05:24.702 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:07:24.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:07:24.857 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:09:24.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:09:24.927 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:11:25.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:11:25.097 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:13:25.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:13:25.258 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:15:25.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:15:25.425 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:17:25.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:17:25.587 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:19:25.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:19:25.761 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:21:25.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:21:25.909 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:23:26.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:23:26.076 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:25:26.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:25:26.201 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:27:26.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:27:26.365 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:29:26.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:29:26.595 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:31:26.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:31:26.761 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:33:26.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:33:26.917 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:35:27.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:35:27.082 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:37:27.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T21:37:27.168 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T21:37:27.243 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-18T21:37:27.346 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-18T21:37:27.346 INFO:teuthology.nuke:Checking targets against current locks 2023-07-18T21:37:27.402 DEBUG:teuthology.nuke:shortname: smithi069 2023-07-18T21:37:27.402 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-18T21:37:27.424 DEBUG:teuthology.nuke:shortname: smithi077 2023-07-18T21:37:27.424 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-18T21:37:27.430 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-07-18_20:13:24-rados-wip-yuri2-testing-2023-07-15-0802-distro-default-smithi/7343028', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-18 20:16:31.216993', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKRuRZiOu9J7WX4f+oZjr+oWUnKCvmND72hxShJqIKAzwdeYZLQRGgr5nFqQ/FJiiHXjSXNRLO8OKNL20V08f5U='} 2023-07-18T21:37:27.446 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-07-18_20:13:24-rados-wip-yuri2-testing-2023-07-15-0802-distro-default-smithi/7343028', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-18 20:16:31.214923', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKLb+wLha2HPHFYWozFvGuY3crJMBjq8hv7iFZznCoQKT7z1tVoHKC6HwbYUYus71CYIb2kTbJPUmSQR7t+2R4I='} 2023-07-18T21:37:27.476 INFO:teuthology.orchestra.console:Power off smithi069 2023-07-18T21:37:27.477 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T21:37:27.491 INFO:teuthology.orchestra.console:Power off smithi077 2023-07-18T21:37:27.492 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T21:37:27.500 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T21:37:27.510 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T21:37:27.620 INFO:teuthology.orchestra.console:Power off for smithi069 completed 2023-07-18T21:37:27.628 INFO:teuthology.orchestra.console:Power off for smithi077 completed 2023-07-18T21:37:27.784 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com 2023-07-18T21:37:27.792 INFO:teuthology.lock.ops:unlocked: smithi069.front.sepia.ceph.com