2023-07-03T07:57:02.496 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-03T07:57:02.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T07:57:02.499 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T07:57:02.648 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f038392bd30>, signals=[15]) 2023-07-03T07:57:02.650 INFO:teuthology.lock.ops:Start node 'smithi060.front.sepia.ceph.com' reimaging 2023-07-03T07:57:02.650 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: reset os type and version on server 2023-07-03T07:57:02.650 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-07-03T07:57:02.674 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2023-07-03T07:57:02.675 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2023-07-03T07:57:02.675 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-07-03T07:57:02.679 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /host {"name": "smithi060"} 2023-07-03T07:57:02.708 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /host {"name": "smithi119"} 2023-07-03T07:57:02.747 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-03T07:57:02.776 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-03T07:57:02.786 DEBUG:teuthology.provision.fog.smithi060:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-03T07:57:02.786 DEBUG:teuthology.provision.fog.smithi060:FOG request: PUT /host/165 {"imageID": 5} 2023-07-03T07:57:02.817 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-03T07:57:02.817 DEBUG:teuthology.provision.fog.smithi119:FOG request: PUT /host/224 {"imageID": 5} 2023-07-03T07:57:02.825 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of rhel 8.6 2023-07-03T07:57:02.826 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-03T07:57:02.863 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of rhel 8.6 2023-07-03T07:57:02.863 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-03T07:57:02.923 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /tasktype {"name": "deploy"} 2023-07-03T07:57:02.954 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /tasktype {"name": "deploy"} 2023-07-03T07:57:02.963 DEBUG:teuthology.provision.fog.smithi060:FOG request: POST /host/165/task {"taskTypeID": 1} 2023-07-03T07:57:02.988 DEBUG:teuthology.provision.fog.smithi119:FOG request: POST /host/224/task {"taskTypeID": 1} 2023-07-03T07:57:03.021 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-03T07:57:03.066 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-03T07:57:03.161 INFO:teuthology.orchestra.console:Power off smithi060 2023-07-03T07:57:03.162 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T07:57:03.178 INFO:teuthology.orchestra.console:Power off smithi119 2023-07-03T07:57:03.179 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T07:57:03.189 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T07:57:03.200 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T07:57:03.315 INFO:teuthology.orchestra.console:Power off for smithi060 completed 2023-07-03T07:57:03.321 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2023-07-03T07:57:03.417 INFO:teuthology.orchestra.console:Power on smithi060 2023-07-03T07:57:03.417 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-03T07:57:03.427 INFO:teuthology.orchestra.console:Power on smithi119 2023-07-03T07:57:03.428 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-03T07:57:03.440 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T07:57:03.451 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T07:57:07.468 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T07:57:07.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T07:57:11.580 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T07:57:11.588 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T07:57:11.791 INFO:teuthology.orchestra.console:Power on for smithi060 completed 2023-07-03T07:57:11.798 INFO:teuthology.orchestra.console:Power on for smithi119 completed 2023-07-03T07:57:11.893 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish 2023-07-03T07:57:11.893 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-03T07:57:11.899 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2023-07-03T07:57:11.900 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-03T07:57:27.016 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-03T07:57:27.017 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-03T07:57:42.112 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-03T07:57:42.113 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-03T07:57:57.213 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-03T07:57:57.214 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-03T07:58:12.320 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-03T07:58:12.321 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-03T07:58:27.410 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-03T07:58:27.412 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-03T07:58:42.496 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-03T07:58:42.497 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-03T07:58:57.584 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-03T07:58:57.585 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-03T07:59:12.652 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-03T07:59:12.654 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-03T07:59:27.746 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-03T07:59:27.747 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-03T07:59:42.835 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-03T07:59:42.836 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-03T07:59:57.924 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-07-03T07:59:57.927 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-07-03T07:59:57.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:59:57.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T07:59:58.268 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-07-03T07:59:58.270 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-03T07:59:58.270 DEBUG:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-03T07:59:58.271 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-03T08:00:01.040 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-03T08:00:07.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:00:10.096 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-03T08:00:16.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:00:19.152 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-03T08:00:25.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:00:28.212 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-03T08:00:34.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:00:37.264 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-03T08:00:43.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:00:46.320 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-03T08:00:52.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:00:55.380 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-03T08:01:01.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:01:19.728 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-03T08:01:25.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:01:28.784 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-03T08:01:34.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:01:35.408 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-03T08:01:35.409 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-03T08:01:35.699 INFO:teuthology.provision.fog.smithi119:Node is ready 2023-07-03T08:01:35.699 DEBUG:teuthology.orchestra.run.smithi119:> hostname 2023-07-03T08:01:35.716 INFO:teuthology.orchestra.run.smithi119.stdout:smithi022 2023-07-03T08:01:35.716 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi022 /etc/hosts 2023-07-03T08:01:35.771 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-07-03T08:01:35.772 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2023-07-03T08:01:35.908 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi022/smithi119/g' /etc/hosts 2023-07-03T08:01:35.934 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.22/172.21.15.119/g' /etc/hosts 2023-07-03T08:01:36.001 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi022/smithi119/g' /etc/hostname 2023-07-03T08:01:36.077 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2023-07-03T08:01:36.148 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-07-03T08:01:36.204 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux" 2023-07-03T08:01:36.204 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)" 2023-07-03T08:01:36.205 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel" 2023-07-03T08:01:36.205 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora" 2023-07-03T08:01:36.205 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6" 2023-07-03T08:01:36.205 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2023-07-03T08:01:36.205 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-03T08:01:36.206 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-07-03T08:01:36.206 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-03T08:01:36.206 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/" 2023-07-03T08:01:36.206 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-03T08:01:36.207 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-03T08:01:36.207 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-03T08:01:36.207 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-03T08:01:36.207 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-03T08:01:36.207 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-03T08:01:36.208 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-03T08:01:36.209 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2023-07-03T08:01:36.211 DEBUG:teuthology.parallel:result is None 2023-07-03T08:02:02.992 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-03T08:02:02.994 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi060 2023-07-03T08:02:12.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-07-03T08:02:12.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:02:12.328 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-07-03T08:02:12.637 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-07-03T08:02:12.637 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-03T08:02:12.638 DEBUG:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-03T08:02:12.657 INFO:teuthology.provision.fog.smithi060:Node is ready 2023-07-03T08:02:12.657 DEBUG:teuthology.orchestra.run.smithi060:> hostname 2023-07-03T08:02:12.716 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com 2023-07-03T08:02:12.717 DEBUG:teuthology.orchestra.run.smithi060:> grep smithi060.front.sepia.ceph.com /etc/hosts 2023-07-03T08:02:12.776 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060 2023-07-03T08:02:12.776 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-07-03T08:02:12.939 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hosts 2023-07-03T08:02:12.971 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/172.21.15.60/172.21.15.60/g' /etc/hosts 2023-07-03T08:02:13.042 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hostname 2023-07-03T08:02:13.113 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-07-03T08:02:13.182 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-07-03T08:02:13.240 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux" 2023-07-03T08:02:13.240 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.6 (Ootpa)" 2023-07-03T08:02:13.241 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel" 2023-07-03T08:02:13.241 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora" 2023-07-03T08:02:13.241 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.6" 2023-07-03T08:02:13.241 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-07-03T08:02:13.241 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-03T08:02:13.241 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-07-03T08:02:13.241 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-03T08:02:13.242 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/" 2023-07-03T08:02:13.242 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-03T08:02:13.242 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-03T08:02:13.242 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-03T08:02:13.242 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-03T08:02:13.242 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-03T08:02:13.242 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-03T08:02:13.242 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-03T08:02:13.243 INFO:teuthology.provision.fog.smithi060:Deploy complete! 2023-07-03T08:02:13.243 DEBUG:teuthology.parallel:result is None 2023-07-03T08:02:13.407 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com 2023-07-03T08:02:13.408 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-03T08:02:13.434 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2023-07-03T08:02:13.434 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-03T08:02:13.459 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server 2023-07-03T08:02:13.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-07-03T08:02:13.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:02:13.526 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-07-03T08:02:13.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-07-03T08:02:13.600 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2023-07-03T08:02:13.659 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2023-07-03T08:02:13.659 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-07-03T08:02:13.718 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux" 2023-07-03T08:02:13.718 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.6 (Ootpa)" 2023-07-03T08:02:13.718 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel" 2023-07-03T08:02:13.719 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora" 2023-07-03T08:02:13.719 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.6" 2023-07-03T08:02:13.719 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8" 2023-07-03T08:02:13.719 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-03T08:02:13.719 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-07-03T08:02:13.719 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-03T08:02:13.719 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/" 2023-07-03T08:02:13.720 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-03T08:02:13.720 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-03T08:02:13.720 INFO:teuthology.orchestra.run.smithi060.stdout: 2023-07-03T08:02:13.720 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-03T08:02:13.720 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-03T08:02:13.720 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-03T08:02:13.720 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-03T08:02:13.721 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-07-03T08:02:13.742 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2023-07-03T08:02:13.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-07-03T08:02:13.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T08:02:13.808 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-07-03T08:02:13.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-07-03T08:02:13.900 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2023-07-03T08:02:13.957 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2023-07-03T08:02:13.958 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-07-03T08:02:14.015 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux" 2023-07-03T08:02:14.015 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)" 2023-07-03T08:02:14.015 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel" 2023-07-03T08:02:14.015 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora" 2023-07-03T08:02:14.016 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6" 2023-07-03T08:02:14.016 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8" 2023-07-03T08:02:14.016 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-03T08:02:14.016 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2023-07-03T08:02:14.016 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-03T08:02:14.017 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/" 2023-07-03T08:02:14.017 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-03T08:02:14.017 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-03T08:02:14.017 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-03T08:02:14.017 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-03T08:02:14.017 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-03T08:02:14.017 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-03T08:02:14.018 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-03T08:02:14.018 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-07-03T08:02:14.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:02:14.042 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:02:14.132 INFO:teuthology.dispatcher.supervisor:Running job 7324583 2023-07-03T08:02:14.132 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-07-03_07:51:01-rgw-wip-T52363-xrmeng8756-i001-distro-default-smithi/7324583 --name mkogan-2023-07-03_07:51:01-rgw-wip-T52363-xrmeng8756-i001-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{rhel_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/lockdep} -- /home/teuthworker/archive/mkogan-2023-07-03_07:51:01-rgw-wip-T52363-xrmeng8756-i001-distro-default-smithi/7324583/orig.config.yaml 2023-07-03T08:02:14.136 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-07-03_07:51:01-rgw-wip-T52363-xrmeng8756-i001-distro-default-smithi/7324583 2023-07-03T08:02:14.136 INFO:teuthology.dispatcher.supervisor:Job PID: 21600 2023-07-03T08:02:14.137 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-03T08:04:14.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:04:14.238 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:06:14.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:06:14.410 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:08:14.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:08:14.579 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:10:14.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:10:14.752 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:12:14.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:12:14.926 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:14:15.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:14:15.087 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:16:15.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:16:15.266 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:18:15.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:18:15.450 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:20:15.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:20:15.610 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:22:15.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:22:15.790 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:24:15.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:24:15.964 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:26:16.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:26:16.134 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:28:16.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:28:16.314 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:30:16.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:30:16.493 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:32:16.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:32:16.678 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:34:16.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:34:16.858 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:36:17.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T08:36:17.043 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T08:36:17.115 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-03T08:36:17.324 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-03T08:36:17.325 INFO:teuthology.nuke:Checking targets against current locks 2023-07-03T08:36:17.379 DEBUG:teuthology.nuke:shortname: smithi060 2023-07-03T08:36:17.380 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-03T08:36:17.407 DEBUG:teuthology.nuke:shortname: smithi119 2023-07-03T08:36:17.407 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-03T08:36:17.411 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-07-03_07:51:01-rgw-wip-T52363-xrmeng8756-i001-distro-default-smithi/7324583', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-03 07:57:01.677751', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-03T08:36:17.437 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-07-03_07:51:01-rgw-wip-T52363-xrmeng8756-i001-distro-default-smithi/7324583', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-03 07:57:01.679280', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-03T08:36:17.498 INFO:teuthology.orchestra.console:Power off smithi060 2023-07-03T08:36:17.499 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T08:36:17.552 INFO:teuthology.orchestra.console:Power off smithi119 2023-07-03T08:36:17.553 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T08:36:17.571 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T08:36:17.584 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T08:36:17.713 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2023-07-03T08:36:17.735 INFO:teuthology.orchestra.console:Power off for smithi060 completed 2023-07-03T08:36:17.873 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com 2023-07-03T08:36:17.890 INFO:teuthology.lock.ops:unlocked: smithi060.front.sepia.ceph.com