2023-07-09T02:33:29.221 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-09T02:33:29.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:33:29.223 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:33:29.385 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f58e0388d30>, signals=[15]) 2023-07-09T02:33:29.387 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2023-07-09T02:33:29.387 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2023-07-09T02:33:29.387 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-07-09T02:33:29.413 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging 2023-07-09T02:33:29.414 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server 2023-07-09T02:33:29.414 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-07-09T02:33:29.415 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /host {"name": "smithi012"} 2023-07-09T02:33:29.437 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /host {"name": "smithi023"} 2023-07-09T02:33:29.504 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-09T02:33:29.513 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-09T02:33:29.547 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_8.stream (ID 3) 2023-07-09T02:33:29.547 DEBUG:teuthology.provision.fog.smithi012:FOG request: PUT /host/118 {"imageID": 3} 2023-07-09T02:33:29.562 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_centos_8.stream (ID 3) 2023-07-09T02:33:29.562 DEBUG:teuthology.provision.fog.smithi023:FOG request: PUT /host/129 {"imageID": 3} 2023-07-09T02:33:29.595 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 8.stream 2023-07-09T02:33:29.595 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-09T02:33:29.602 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 8.stream 2023-07-09T02:33:29.602 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-09T02:33:29.655 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /tasktype {"name": "deploy"} 2023-07-09T02:33:29.657 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /tasktype {"name": "deploy"} 2023-07-09T02:33:29.695 DEBUG:teuthology.provision.fog.smithi012:FOG request: POST /host/118/task {"taskTypeID": 1} 2023-07-09T02:33:29.697 DEBUG:teuthology.provision.fog.smithi023:FOG request: POST /host/129/task {"taskTypeID": 1} 2023-07-09T02:33:29.753 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-09T02:33:29.759 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-09T02:33:29.845 INFO:teuthology.orchestra.console:Power off smithi012 2023-07-09T02:33:29.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T02:33:29.865 INFO:teuthology.orchestra.console:Power off smithi023 2023-07-09T02:33:29.866 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T02:33:29.876 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:33:29.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:33:30.001 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2023-07-09T02:33:30.012 INFO:teuthology.orchestra.console:Power off for smithi023 completed 2023-07-09T02:33:30.103 INFO:teuthology.orchestra.console:Power on smithi012 2023-07-09T02:33:30.103 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-09T02:33:30.114 INFO:teuthology.orchestra.console:Power on smithi023 2023-07-09T02:33:30.115 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-09T02:33:30.130 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:33:30.143 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:33:34.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:33:34.166 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:33:38.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:33:38.280 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:33:38.483 INFO:teuthology.orchestra.console:Power on for smithi012 completed 2023-07-09T02:33:38.492 INFO:teuthology.orchestra.console:Power on for smithi023 completed 2023-07-09T02:33:38.585 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2023-07-09T02:33:38.586 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-09T02:33:38.593 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2023-07-09T02:33:38.594 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-09T02:33:53.660 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-09T02:33:53.662 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-09T02:34:08.724 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-09T02:34:08.725 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-09T02:34:23.788 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-09T02:34:23.789 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-09T02:34:38.852 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-09T02:34:38.854 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-09T02:34:53.919 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-09T02:34:53.920 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-09T02:35:08.984 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-09T02:35:08.985 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-09T02:35:24.052 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-09T02:35:24.053 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-09T02:35:39.119 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-09T02:35:39.120 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-09T02:35:54.186 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-09T02:35:54.188 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-09T02:36:09.248 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-09T02:36:09.249 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-09T02:36:09.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T02:36:12.368 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-09T02:36:18.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T02:36:21.460 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-09T02:36:24.307 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-09T02:36:27.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T02:36:30.548 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-09T02:36:36.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T02:36:39.356 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-09T02:36:39.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T02:36:39.636 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-09T02:36:39.691 ERROR:teuthology.orchestra.connection:Error authenticating with smithi023.front.sepia.ceph.com: Authentication failed. 2023-07-09T02:36:39.692 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-09T02:36:39.693 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-09T02:36:39.694 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T02:36:40.698 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T02:36:41.703 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T02:36:42.707 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T02:36:43.712 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T02:36:45.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T02:37:45.639 WARNING:teuthology.provision.fog.smithi012:timed out 2023-07-09T02:37:51.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T02:37:51.890 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-09T02:37:51.890 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-09T02:37:52.154 INFO:teuthology.provision.fog.smithi012:Node is ready 2023-07-09T02:37:52.154 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2023-07-09T02:37:52.174 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2023-07-09T02:37:52.175 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2023-07-09T02:37:52.235 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2023-07-09T02:37:52.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-07-09T02:37:52.330 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2023-07-09T02:37:52.361 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2023-07-09T02:37:52.431 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2023-07-09T02:37:52.500 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-07-09T02:37:52.568 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-07-09T02:37:52.626 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-07-09T02:37:52.627 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8" 2023-07-09T02:37:52.627 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-07-09T02:37:52.627 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-07-09T02:37:52.627 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8" 2023-07-09T02:37:52.627 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8" 2023-07-09T02:37:52.627 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-09T02:37:52.628 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-07-09T02:37:52.628 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-09T02:37:52.628 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-07-09T02:37:52.628 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T02:37:52.628 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T02:37:52.628 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-09T02:37:52.629 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2023-07-09T02:37:52.630 DEBUG:teuthology.parallel:result is None 2023-07-09T02:39:08.912 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-09T02:39:08.914 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi023 2023-07-09T02:39:17.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-07-09T02:39:17.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T02:39:18.128 DEBUG:teuthology.orchestra.run.smithi023:> true 2023-07-09T02:39:18.414 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-07-09T02:39:18.414 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-09T02:39:18.415 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-09T02:39:18.435 INFO:teuthology.provision.fog.smithi023:Node is ready 2023-07-09T02:39:18.435 DEBUG:teuthology.orchestra.run.smithi023:> hostname 2023-07-09T02:39:18.494 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com 2023-07-09T02:39:18.495 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts 2023-07-09T02:39:18.554 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023 2023-07-09T02:39:18.555 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-07-09T02:39:18.667 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts 2023-07-09T02:39:18.697 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts 2023-07-09T02:39:18.766 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname 2023-07-09T02:39:18.835 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-07-09T02:39:18.902 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-07-09T02:39:18.960 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2023-07-09T02:39:18.961 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8" 2023-07-09T02:39:18.961 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2023-07-09T02:39:18.961 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2023-07-09T02:39:18.961 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8" 2023-07-09T02:39:18.961 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8" 2023-07-09T02:39:18.961 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-09T02:39:18.961 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2023-07-09T02:39:18.962 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-09T02:39:18.962 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2023-07-09T02:39:18.962 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T02:39:18.962 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T02:39:18.962 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-09T02:39:18.962 INFO:teuthology.provision.fog.smithi023:Deploy complete! 2023-07-09T02:39:18.963 DEBUG:teuthology.parallel:result is None 2023-07-09T02:39:19.117 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2023-07-09T02:39:19.118 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-09T02:39:19.148 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com 2023-07-09T02:39:19.149 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-09T02:39:19.175 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2023-07-09T02:39:19.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-07-09T02:39:19.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T02:39:19.243 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-07-09T02:39:19.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-07-09T02:39:19.380 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-07-09T02:39:19.440 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-07-09T02:39:19.440 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-07-09T02:39:19.500 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-07-09T02:39:19.500 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8" 2023-07-09T02:39:19.501 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-07-09T02:39:19.501 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-07-09T02:39:19.501 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8" 2023-07-09T02:39:19.501 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8" 2023-07-09T02:39:19.501 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-09T02:39:19.501 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-07-09T02:39:19.502 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-09T02:39:19.502 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-07-09T02:39:19.502 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T02:39:19.502 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T02:39:19.502 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-09T02:39:19.503 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-07-09T02:39:19.524 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server 2023-07-09T02:39:19.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-07-09T02:39:19.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T02:39:19.592 DEBUG:teuthology.orchestra.run.smithi023:> true 2023-07-09T02:39:19.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-07-09T02:39:19.659 DEBUG:teuthology.orchestra.run.smithi023:> uname -m 2023-07-09T02:39:19.717 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2023-07-09T02:39:19.717 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-07-09T02:39:19.776 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2023-07-09T02:39:19.776 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8" 2023-07-09T02:39:19.776 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2023-07-09T02:39:19.777 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2023-07-09T02:39:19.777 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8" 2023-07-09T02:39:19.777 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8" 2023-07-09T02:39:19.777 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-09T02:39:19.777 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2023-07-09T02:39:19.777 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-09T02:39:19.777 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2023-07-09T02:39:19.777 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T02:39:19.778 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T02:39:19.778 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-09T02:39:19.778 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-07-09T02:39:19.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:39:19.799 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:39:19.901 INFO:teuthology.dispatcher.supervisor:Running job 7331292 2023-07-09T02:39:19.902 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331292 --name rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} -- /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331292/orig.config.yaml 2023-07-09T02:39:19.905 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331292 2023-07-09T02:39:19.906 INFO:teuthology.dispatcher.supervisor:Job PID: 17466 2023-07-09T02:39:19.906 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-09T02:41:19.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:41:19.908 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:43:20.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:43:20.067 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:45:20.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:45:20.215 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:47:20.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:47:20.394 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:49:20.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:49:20.583 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:51:20.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:51:20.757 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:53:20.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:53:20.930 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:55:21.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:55:21.106 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:57:21.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:57:21.282 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:59:21.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:59:21.447 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T03:01:21.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T03:01:21.614 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T03:03:21.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T03:03:21.786 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T03:05:21.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T03:05:21.874 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T03:07:21.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T03:07:22.000 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T03:09:22.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T03:09:22.174 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T03:11:22.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T03:11:22.389 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T03:11:22.456 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-09T03:11:22.632 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-09T03:11:22.632 INFO:teuthology.nuke:Checking targets against current locks 2023-07-09T03:11:22.679 DEBUG:teuthology.nuke:shortname: smithi012 2023-07-09T03:11:22.679 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T03:11:22.693 DEBUG:teuthology.nuke:shortname: smithi023 2023-07-09T03:11:22.693 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T03:11:22.699 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331292', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 02:33:28.358476', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM3IyJTAgCbrh7Mo376pQtKESi3ayGkAQaqKe0U5ig+cybqLkYxHgalyD1TqEWRdCb1gU8s3VRut1GKhaA2fak='} 2023-07-09T03:11:22.714 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi023.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331292', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 02:33:28.356065', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDy0zXrE6xTDB/WUoYVRCRD7nwUxzZvX+IZQQhU1c52BvqIdN0AzjcPZYIe7Eet8/N3/+QChppHNQCxaQjKQFfp8WZqPu0oG+hhPHp2UvdvybBpA2te4l+M6oTnR61kXFa1KFMJfOfIyJXeLewVXRaa6JExOt51xQZR+YH9DWgtvEO6w60MGwtG48Eev7sf52y8sxlYGAPshfkTA0ytkOzgMcLoUEyKwl23XMT3bwOkzNyYLm6FbjBjDX4y+qymFaa5jRezvh8Du+kut6AcC+tWsLl2VMl0m/SM7QjJQLeCrBIqkcvPbNqNtEdiMDovWVi0poRyS3+WilmX2areqN+tmDDWt9yNC0+AOQCWj2730t+2ZNsW/wIzHXp3HQv7jWod6IO7KlGxgkOoMMk9PXTJmlSgJk5/TOY4t4nLtZavTQeYFkeiCbLgaZC57gEy1P+WWnM89inkTidxxMyK1bPGJpDxJIAhR6RxYouZ6fjanQUh0HiDj3gij/dHfgqLQeE='} 2023-07-09T03:11:22.746 INFO:teuthology.orchestra.console:Power off smithi012 2023-07-09T03:11:22.746 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T03:11:22.764 INFO:teuthology.orchestra.console:Power off smithi023 2023-07-09T03:11:22.765 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T03:11:22.777 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T03:11:22.790 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T03:11:22.901 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2023-07-09T03:11:22.913 INFO:teuthology.orchestra.console:Power off for smithi023 completed 2023-07-09T03:11:23.054 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com 2023-07-09T03:11:23.063 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com