2023-07-16T06:17:50.159 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-16T06:17:50.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:17:50.161 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:17:50.331 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5c1c20c8b0>, signals=[15]) 2023-07-16T06:17:50.335 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2023-07-16T06:17:50.336 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2023-07-16T06:17:50.336 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-07-16T06:17:50.364 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2023-07-16T06:17:50.364 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2023-07-16T06:17:50.364 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-07-16T06:17:50.366 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /host {"name": "smithi103"} 2023-07-16T06:17:50.389 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"} 2023-07-16T06:17:50.447 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-16T06:17:50.461 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-16T06:17:50.490 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_centos_8.stream (ID 3) 2023-07-16T06:17:50.490 DEBUG:teuthology.provision.fog.smithi103:FOG request: PUT /host/208 {"imageID": 3} 2023-07-16T06:17:50.513 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_centos_8.stream (ID 3) 2023-07-16T06:17:50.514 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 3} 2023-07-16T06:17:50.545 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 8.stream 2023-07-16T06:17:50.546 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-16T06:17:50.571 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of centos 8.stream 2023-07-16T06:17:50.572 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-16T06:17:50.603 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /tasktype {"name": "deploy"} 2023-07-16T06:17:50.632 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"} 2023-07-16T06:17:50.642 DEBUG:teuthology.provision.fog.smithi103:FOG request: POST /host/208/task {"taskTypeID": 1} 2023-07-16T06:17:50.664 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1} 2023-07-16T06:17:50.695 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-16T06:17:50.717 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-16T06:17:50.811 INFO:teuthology.orchestra.console:Power off smithi104 2023-07-16T06:17:50.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-16T06:17:50.834 INFO:teuthology.orchestra.console:Power off smithi103 2023-07-16T06:17:50.835 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-16T06:17:50.847 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T06:17:50.862 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T06:17:54.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T06:17:54.897 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T06:17:58.992 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T06:17:59.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T06:18:03.108 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T06:18:03.124 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T06:18:03.320 INFO:teuthology.orchestra.console:Power off for smithi104 completed 2023-07-16T06:18:03.336 INFO:teuthology.orchestra.console:Power off for smithi103 completed 2023-07-16T06:18:03.422 INFO:teuthology.orchestra.console:Power on smithi104 2023-07-16T06:18:03.422 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-16T06:18:03.437 INFO:teuthology.orchestra.console:Power on smithi103 2023-07-16T06:18:03.438 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-16T06:18:03.450 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T06:18:03.461 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T06:18:07.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T06:18:07.486 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T06:18:07.690 INFO:teuthology.orchestra.console:Power on for smithi104 completed 2023-07-16T06:18:07.791 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2023-07-16T06:18:07.792 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-16T06:18:11.602 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T06:18:11.815 INFO:teuthology.orchestra.console:Power on for smithi103 completed 2023-07-16T06:18:11.916 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2023-07-16T06:18:11.917 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-16T06:18:22.864 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-16T06:18:26.988 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-16T06:18:37.940 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-16T06:18:42.053 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-16T06:18:53.004 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-16T06:18:57.120 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-16T06:19:08.068 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-16T06:19:12.173 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-16T06:19:23.136 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-16T06:19:27.233 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-16T06:19:38.192 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-16T06:19:42.286 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-16T06:19:53.262 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-16T06:19:57.332 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-16T06:20:08.324 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-16T06:20:12.384 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-16T06:20:23.388 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-16T06:20:27.440 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-16T06:20:38.445 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-16T06:20:42.496 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-16T06:20:53.508 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None 2023-07-16T06:20:53.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:20:56.628 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-16T06:20:57.551 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-16T06:21:02.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:21:05.712 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-16T06:21:12.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:21:12.613 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-07-16T06:21:12.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:21:15.568 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-16T06:21:15.728 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-16T06:21:21.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:21:21.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:21:24.628 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-16T06:21:24.788 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-16T06:21:30.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:21:30.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:21:33.712 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-16T06:21:33.840 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-16T06:21:39.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:21:39.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:21:42.769 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2023-07-16T06:21:42.901 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-16T06:21:48.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:21:48.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:21:51.985 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-16T06:21:57.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:22:01.040 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-16T06:22:07.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:22:10.096 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-16T06:22:16.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:22:48.813 WARNING:teuthology.provision.fog.smithi104:timed out 2023-07-16T06:22:54.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:22:55.021 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-16T06:22:55.023 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-16T06:22:55.274 INFO:teuthology.provision.fog.smithi104:Node is ready 2023-07-16T06:22:55.275 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2023-07-16T06:22:55.294 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com 2023-07-16T06:22:55.295 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts 2023-07-16T06:22:55.356 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2023-07-16T06:22:55.357 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-07-16T06:22:55.467 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts 2023-07-16T06:22:55.497 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts 2023-07-16T06:22:55.568 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname 2023-07-16T06:22:55.639 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2023-07-16T06:22:55.710 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-07-16T06:22:55.770 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2023-07-16T06:22:55.770 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8" 2023-07-16T06:22:55.770 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2023-07-16T06:22:55.771 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2023-07-16T06:22:55.771 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8" 2023-07-16T06:22:55.771 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2023-07-16T06:22:55.771 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-16T06:22:55.771 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-07-16T06:22:55.771 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-16T06:22:55.771 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2023-07-16T06:22:55.772 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-16T06:22:55.772 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-16T06:22:55.772 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-16T06:22:55.772 INFO:teuthology.provision.fog.smithi104:Deploy complete! 2023-07-16T06:22:55.774 DEBUG:teuthology.parallel:result is None 2023-07-16T06:23:16.121 WARNING:teuthology.provision.fog.smithi103:timed out 2023-07-16T06:23:22.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:23:22.440 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-16T06:23:22.441 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-16T06:23:22.673 INFO:teuthology.provision.fog.smithi103:Node is ready 2023-07-16T06:23:22.673 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2023-07-16T06:23:22.737 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2023-07-16T06:23:22.738 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts 2023-07-16T06:23:22.802 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2023-07-16T06:23:22.803 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-07-16T06:23:22.921 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts 2023-07-16T06:23:22.953 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2023-07-16T06:23:23.030 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname 2023-07-16T06:23:23.103 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-07-16T06:23:23.178 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-07-16T06:23:23.241 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2023-07-16T06:23:23.241 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8" 2023-07-16T06:23:23.242 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2023-07-16T06:23:23.242 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2023-07-16T06:23:23.242 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8" 2023-07-16T06:23:23.242 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2023-07-16T06:23:23.242 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-16T06:23:23.242 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-07-16T06:23:23.243 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-16T06:23:23.243 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2023-07-16T06:23:23.243 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-16T06:23:23.243 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-16T06:23:23.243 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-16T06:23:23.243 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2023-07-16T06:23:23.244 DEBUG:teuthology.parallel:result is None 2023-07-16T06:23:23.438 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2023-07-16T06:23:23.438 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-16T06:23:23.463 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com 2023-07-16T06:23:23.464 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-16T06:23:23.490 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2023-07-16T06:23:23.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-16T06:23:23.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:23:23.600 DEBUG:teuthology.orchestra.run.smithi103:> true 2023-07-16T06:23:23.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-16T06:23:23.668 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2023-07-16T06:23:23.725 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2023-07-16T06:23:23.725 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-07-16T06:23:23.790 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2023-07-16T06:23:23.790 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8" 2023-07-16T06:23:23.790 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2023-07-16T06:23:23.790 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2023-07-16T06:23:23.790 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8" 2023-07-16T06:23:23.791 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2023-07-16T06:23:23.791 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-16T06:23:23.791 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2023-07-16T06:23:23.791 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-16T06:23:23.791 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2023-07-16T06:23:23.791 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-16T06:23:23.791 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-16T06:23:23.792 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-16T06:23:23.792 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-07-16T06:23:23.814 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server 2023-07-16T06:23:23.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-07-16T06:23:23.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-16T06:23:23.926 DEBUG:teuthology.orchestra.run.smithi104:> true 2023-07-16T06:23:24.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2023-07-16T06:23:24.063 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2023-07-16T06:23:24.124 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2023-07-16T06:23:24.125 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2023-07-16T06:23:24.183 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2023-07-16T06:23:24.183 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8" 2023-07-16T06:23:24.183 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2023-07-16T06:23:24.183 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2023-07-16T06:23:24.184 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8" 2023-07-16T06:23:24.184 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2023-07-16T06:23:24.184 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-16T06:23:24.184 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2023-07-16T06:23:24.184 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-16T06:23:24.184 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2023-07-16T06:23:24.185 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-16T06:23:24.185 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-16T06:23:24.185 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-16T06:23:24.185 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2023-07-16T06:23:24.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:23:24.206 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:23:25.240 INFO:teuthology.dispatcher.supervisor:Running job 7340826 2023-07-16T06:23:25.240 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-15_23:37:56-rados-wip-yuri2-testing-2023-07-15-0802-distro-default-smithi/7340826 --name yuriw-2023-07-15_23:37:56-rados-wip-yuri2-testing-2023-07-15-0802-distro-default-smithi --description rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/e2e} -- /home/teuthworker/archive/yuriw-2023-07-15_23:37:56-rados-wip-yuri2-testing-2023-07-15-0802-distro-default-smithi/7340826/orig.config.yaml 2023-07-16T06:23:25.246 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-15_23:37:56-rados-wip-yuri2-testing-2023-07-15-0802-distro-default-smithi/7340826 2023-07-16T06:23:25.247 INFO:teuthology.dispatcher.supervisor:Job PID: 12378 2023-07-16T06:23:25.247 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-16T06:25:25.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:25:25.346 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:27:25.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:27:25.529 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:29:25.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:29:25.710 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:31:25.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:31:25.881 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:33:26.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:33:26.061 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:35:26.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:35:26.246 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:37:26.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:37:26.449 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:39:26.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:39:26.654 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:41:26.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:41:26.830 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:43:27.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:43:27.017 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:45:27.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:45:27.144 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:47:27.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:47:27.311 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:49:27.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:49:27.485 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:51:27.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:51:27.661 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:53:27.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:53:27.850 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:55:28.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:55:28.032 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:57:28.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:57:28.206 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T06:59:28.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T06:59:28.390 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T07:01:28.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T07:01:28.562 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T07:03:28.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T07:03:28.737 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T07:05:28.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-16T07:05:28.906 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-16T07:05:29.035 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-16T07:05:29.168 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-16T07:05:29.169 INFO:teuthology.nuke:Checking targets against current locks 2023-07-16T07:05:29.224 DEBUG:teuthology.nuke:shortname: smithi103 2023-07-16T07:05:29.225 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-16T07:05:29.250 DEBUG:teuthology.nuke:shortname: smithi104 2023-07-16T07:05:29.250 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-16T07:05:29.255 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-15_23:37:56-rados-wip-yuri2-testing-2023-07-15-0802-distro-default-smithi/7340826', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-16 06:17:49.363874', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1o+BmG7hJyKad2mJDcg6d4tn7yJxTvPL8Cn00CCTGz1/VUFTe5voPffJA7vlDrZppTlPuW3I6AN7r1zGcD5O1rP1lNVljAgLplqSp4h34cvNMd+Z9oiCyaUn0UlmqgPoKNp+QUgTAENFbfeWH2NLhn7E+ASGcgZ7rSV1aSp/0t8WcaO9dYg/zHcuX8+L7NhKDf/AZ9P15wbTfIzllHwFcZtm8JB15x83qMm+W1bJnsHEseYGQg14d0XRYDGEndFwvWSUsU+p/yGeAdmyyr44FFlQ8iv0p43b7k2m7yGZD0CYXwH6IdMM5LE6VNkVNdC9jJ0LEgtvAPPB13haFTwPTG5KZKcXV+uPdu0JN71ARgWi4u8d/4zIfp+ZQRyM/A9jeTL+oZ1Pr2ODNyyzIV/Z4+yrCvB8Mda9HczxlrKE1HKBPOOlFGOZYuzPltXEAdSFXKYv5CDl+APgOsePRZ5kSuKJx+PZzn5R+qGmIFOpCezO8E7U2mKKqhhDTnjd+cXE='} 2023-07-16T07:05:29.278 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-15_23:37:56-rados-wip-yuri2-testing-2023-07-15-0802-distro-default-smithi/7340826', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-16 06:17:49.365333', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIrr5pkhIEqrYrZ64xmn7x7zI2AZSchUZdOr92suPbu1nNzautLdX/mGLzeSAYqMGGlVBGLr1vU8dSR4dIWTSkQ='} 2023-07-16T07:05:29.312 INFO:teuthology.orchestra.console:Power off smithi103 2023-07-16T07:05:29.313 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-16T07:05:29.336 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T07:05:29.358 INFO:teuthology.orchestra.console:Power off smithi104 2023-07-16T07:05:29.359 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-16T07:05:29.379 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-16T07:05:29.470 INFO:teuthology.orchestra.console:Power off for smithi103 completed 2023-07-16T07:05:29.506 INFO:teuthology.orchestra.console:Power off for smithi104 completed 2023-07-16T07:05:29.631 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com 2023-07-16T07:05:29.665 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com