2023-07-16T11:30:22.681 INFO:root:teuthology version: 0.0.1.dev147+gff9991b
2023-07-16T11:30:22.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:30:22.685 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:30:22.857 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff930d45640>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff93070dee0>, signals=[15])
2023-07-16T11:30:22.858 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging
2023-07-16T11:30:22.859 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server
2023-07-16T11:30:22.859 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-07-16T11:30:22.888 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging
2023-07-16T11:30:22.889 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server
2023-07-16T11:30:22.889 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server
2023-07-16T11:30:22.892 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"}
2023-07-16T11:30:22.913 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"}
2023-07-16T11:30:22.972 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-16T11:30:22.980 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-16T11:30:23.016 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_8.stream (ID 3)
2023-07-16T11:30:23.017 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 3}
2023-07-16T11:30:23.024 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_centos_8.stream (ID 3)
2023-07-16T11:30:23.024 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 3}
2023-07-16T11:30:23.056 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 8.stream
2023-07-16T11:30:23.056 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-07-16T11:30:23.071 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 8.stream
2023-07-16T11:30:23.071 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-07-16T11:30:23.133 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"}
2023-07-16T11:30:23.135 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"}
2023-07-16T11:30:23.177 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1}
2023-07-16T11:30:23.181 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1}
2023-07-16T11:30:23.237 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-07-16T11:30:23.239 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-07-16T11:30:23.349 INFO:teuthology.orchestra.console:Power off smithi195
2023-07-16T11:30:23.350 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-16T11:30:23.365 INFO:teuthology.orchestra.console:Power off smithi159
2023-07-16T11:30:23.366 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-16T11:30:23.379 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:30:23.391 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:30:27.408 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:30:27.419 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:30:31.524 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:30:31.536 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:30:31.741 INFO:teuthology.orchestra.console:Power off for smithi195 completed
2023-07-16T11:30:31.748 INFO:teuthology.orchestra.console:Power off for smithi159 completed
2023-07-16T11:30:31.843 INFO:teuthology.orchestra.console:Power on smithi195
2023-07-16T11:30:31.843 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-16T11:30:31.853 INFO:teuthology.orchestra.console:Power on smithi159
2023-07-16T11:30:31.854 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-16T11:30:31.867 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:30:31.878 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:30:35.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:30:35.906 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:30:40.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:30:40.022 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:30:40.225 INFO:teuthology.orchestra.console:Power on for smithi195 completed
2023-07-16T11:30:40.232 INFO:teuthology.orchestra.console:Power on for smithi159 completed
2023-07-16T11:30:40.326 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish
2023-07-16T11:30:40.327 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-07-16T11:30:40.333 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish
2023-07-16T11:30:40.333 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-07-16T11:30:55.416 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-07-16T11:30:55.417 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-07-16T11:31:10.500 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-07-16T11:31:10.502 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-07-16T11:31:25.588 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-07-16T11:31:25.589 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-07-16T11:31:40.684 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-07-16T11:31:40.686 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-07-16T11:31:55.780 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-07-16T11:31:55.782 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-07-16T11:32:10.868 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-07-16T11:32:10.869 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-07-16T11:32:25.944 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-07-16T11:32:25.946 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-07-16T11:32:41.018 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-07-16T11:32:41.019 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-07-16T11:32:56.088 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-07-16T11:32:56.090 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-07-16T11:33:11.167 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-07-16T11:33:11.169 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-07-16T11:33:11.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:33:26.228 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-07-16T11:33:26.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:33:29.360 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-07-16T11:33:35.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:33:38.416 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-07-16T11:33:44.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:33:47.472 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-07-16T11:33:53.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:33:56.528 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-07-16T11:34:02.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:34:05.588 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-07-16T11:34:11.347 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: Authentication timeout.
2023-07-16T11:34:11.349 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-16T11:34:11.350 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-16T11:34:11.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:34:14.708 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-07-16T11:34:20.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:34:23.760 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-07-16T11:34:29.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:34:32.816 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-07-16T11:34:38.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:34:57.136 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-07-16T11:35:01.488 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-16T11:35:01.491 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi195
2023-07-16T11:35:03.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:35:06.192 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-07-16T11:35:10.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com'
2023-07-16T11:35:10.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:35:10.740 DEBUG:teuthology.orchestra.run.smithi195:> true
2023-07-16T11:35:10.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com'
2023-07-16T11:35:10.979 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-16T11:35:10.979 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-16T11:35:10.997 INFO:teuthology.provision.fog.smithi195:Node is ready
2023-07-16T11:35:10.998 DEBUG:teuthology.orchestra.run.smithi195:> hostname
2023-07-16T11:35:11.060 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com
2023-07-16T11:35:11.060 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts
2023-07-16T11:35:11.116 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195
2023-07-16T11:35:11.117 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195
2023-07-16T11:35:11.221 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts
2023-07-16T11:35:11.251 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts
2023-07-16T11:35:11.319 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname
2023-07-16T11:35:11.387 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195
2023-07-16T11:35:11.454 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release
2023-07-16T11:35:11.512 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream"
2023-07-16T11:35:11.512 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8"
2023-07-16T11:35:11.512 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos"
2023-07-16T11:35:11.512 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora"
2023-07-16T11:35:11.512 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8"
2023-07-16T11:35:11.513 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8"
2023-07-16T11:35:11.513 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-16T11:35:11.513 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31"
2023-07-16T11:35:11.513 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-16T11:35:11.513 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/"
2023-07-16T11:35:11.513 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-16T11:35:11.513 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-16T11:35:11.514 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-16T11:35:11.514 INFO:teuthology.provision.fog.smithi195:Deploy complete!
2023-07-16T11:35:11.516 DEBUG:teuthology.parallel:result is None
2023-07-16T11:35:12.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:35:14.386 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-16T11:35:14.387 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-16T11:35:39.327 INFO:teuthology.provision.fog.smithi159:Node is ready
2023-07-16T11:35:39.328 DEBUG:teuthology.orchestra.run.smithi159:> hostname
2023-07-16T11:35:39.352 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com
2023-07-16T11:35:39.353 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts
2023-07-16T11:35:39.412 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159
2023-07-16T11:35:39.413 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-07-16T11:35:39.537 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts
2023-07-16T11:35:39.568 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts
2023-07-16T11:35:39.638 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname
2023-07-16T11:35:39.707 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-07-16T11:35:39.774 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-07-16T11:35:39.832 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream"
2023-07-16T11:35:39.832 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8"
2023-07-16T11:35:39.832 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos"
2023-07-16T11:35:39.833 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora"
2023-07-16T11:35:39.833 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8"
2023-07-16T11:35:39.833 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2023-07-16T11:35:39.833 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-16T11:35:39.833 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2023-07-16T11:35:39.833 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-16T11:35:39.833 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/"
2023-07-16T11:35:39.833 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-16T11:35:39.834 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-16T11:35:39.834 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-16T11:35:39.834 INFO:teuthology.provision.fog.smithi159:Deploy complete!
2023-07-16T11:35:39.835 DEBUG:teuthology.parallel:result is None
2023-07-16T11:35:39.993 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com
2023-07-16T11:35:39.993 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-16T11:35:40.018 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com
2023-07-16T11:35:40.019 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-16T11:35:40.046 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server
2023-07-16T11:35:40.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-07-16T11:35:40.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:35:40.112 DEBUG:teuthology.orchestra.run.smithi159:> true
2023-07-16T11:35:40.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-07-16T11:35:40.178 DEBUG:teuthology.orchestra.run.smithi159:> uname -m
2023-07-16T11:35:40.235 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64
2023-07-16T11:35:40.235 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-07-16T11:35:40.293 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream"
2023-07-16T11:35:40.293 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8"
2023-07-16T11:35:40.293 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos"
2023-07-16T11:35:40.293 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora"
2023-07-16T11:35:40.293 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8"
2023-07-16T11:35:40.294 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2023-07-16T11:35:40.294 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-16T11:35:40.294 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2023-07-16T11:35:40.294 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-16T11:35:40.294 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/"
2023-07-16T11:35:40.294 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-16T11:35:40.294 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-16T11:35:40.295 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-16T11:35:40.295 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-07-16T11:35:40.319 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server
2023-07-16T11:35:40.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com'
2023-07-16T11:35:40.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:35:40.392 DEBUG:teuthology.orchestra.run.smithi195:> true
2023-07-16T11:35:40.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com'
2023-07-16T11:35:40.531 DEBUG:teuthology.orchestra.run.smithi195:> uname -m
2023-07-16T11:35:40.590 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64
2023-07-16T11:35:40.590 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release
2023-07-16T11:35:40.647 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream"
2023-07-16T11:35:40.648 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8"
2023-07-16T11:35:40.648 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos"
2023-07-16T11:35:40.648 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora"
2023-07-16T11:35:40.648 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8"
2023-07-16T11:35:40.648 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8"
2023-07-16T11:35:40.648 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-16T11:35:40.648 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31"
2023-07-16T11:35:40.649 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-16T11:35:40.649 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/"
2023-07-16T11:35:40.649 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-16T11:35:40.649 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-16T11:35:40.649 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-16T11:35:40.650 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server
2023-07-16T11:35:40.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:35:40.669 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:35:40.759 INFO:teuthology.dispatcher.supervisor:Running job 7341072
2023-07-16T11:35:40.759 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-07-16_11:27:03-fs:verify-main-distro-default-smithi/7341072 --name matan-2023-07-16_11:27:03-fs:verify-main-distro-default-smithi --description fs:verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/matan-2023-07-16_11:27:03-fs:verify-main-distro-default-smithi/7341072/orig.config.yaml
2023-07-16T11:35:40.763 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-07-16_11:27:03-fs:verify-main-distro-default-smithi/7341072
2023-07-16T11:35:40.764 INFO:teuthology.dispatcher.supervisor:Job PID: 5931
2023-07-16T11:35:40.764 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-16T11:37:40.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:37:40.866 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:39:41.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:39:41.038 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:41:41.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:41:41.197 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:43:41.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:43:41.374 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:45:41.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:45:41.542 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:47:41.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:47:41.710 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:49:41.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:49:41.890 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:51:42.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:51:42.066 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:53:42.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:53:42.251 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:55:42.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:55:42.426 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:57:42.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:57:42.590 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:59:42.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:59:42.761 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:01:42.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:01:42.934 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:03:43.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:03:43.107 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:05:43.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:05:43.273 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:07:43.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:07:43.447 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:09:43.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:09:43.622 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:11:43.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:11:43.789 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:13:43.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:13:43.957 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:15:44.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:15:44.123 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:17:44.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:17:44.287 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:19:44.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:19:44.439 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:21:44.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:21:44.617 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:23:44.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:23:44.771 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:25:44.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:25:44.934 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:27:45.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:27:45.058 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:27:45.126 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-16T12:27:45.262 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-16T12:27:45.263 INFO:teuthology.nuke:Checking targets against current locks
2023-07-16T12:27:45.308 DEBUG:teuthology.nuke:shortname: smithi159
2023-07-16T12:27:45.309 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-16T12:27:45.333 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-07-16_11:27:03-fs:verify-main-distro-default-smithi/7341072', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-16 11:30:21.820772', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7057SYE7oL74tLryV/VviFpJThYUBCpp3MwAFjl8v5k1xjKtDvy8yoEIvaJcKN4jDEoSml0zAlDWJqYgCLXlZV+x1IG+b0AgKjvz1p9BWK3GgbFhT4bA4yJDDe3UpV48mhyENQQxJucESbMD1qH40kosVAJ2qlRFwTBhNG5VYJCQRysO1OIj+ZRvJZ87MAoYhS+dCuHbWDy9FOlc/NWtccEzg6y4io0/7g9jzgp6vSGtfBgM2Sdi1tTRWYciTsAZeSQRJaR9V9E/Oufc3OwQebB59PzIwJrKU1nc4q6V3feiFoojyfizD7dK00ZkzRceP5IC61JQRGpI4PheRriRqJF25Tn3P16AOrKa5SEwJZTAcRl3DguwaiXlEQHfntgXJoxF+y5arm+zsjAWl9Wm0b6Ujg9nyxzz7E3KJiCxVnYcfp/i2Ak4oFKjOcAQAbz6O9TBxPFrDao3G6IJ0z6Li69xKui1Pfi6KOJVgtZm6tP+g6bll48ywB2WiD9NTPus='}
2023-07-16T12:27:45.335 DEBUG:teuthology.nuke:shortname: smithi195
2023-07-16T12:27:45.336 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-16T12:27:45.359 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-07-16_11:27:03-fs:verify-main-distro-default-smithi/7341072', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-16 11:30:21.822247', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC39lL1fdnzo5TYashNy5b5IqZDnTIqE8azRfk9+N+/byMOBBgy93yln7V++dsa6PsYufIcZTgPDWxyoUxNaDrldxRl5Sg86uyBDWed+WP46TYaBAPHmyDmrSbXaL2vuyXTmWVNyOXa6kKjoqsH5bD/EFZX71l34+kvLQnd5tNoDPUz2qwn/Fxe81828x2ZKxSr56XenXWhqt6bLc5CmDAac69rHuTePS+llbP7MNbVo0sDpfr1INDCfyohGG3XrZyqzfqFQeHeVLYU9acnt9NmsII8WqkIghCLseTBuaCc4/kvkwKT7zz02ClkRsgDBVXoirmnW0Q2FtgHmgveiFg7QzP77fYRTlzVd8osHN485Af1bt5hEommsV+qPP5abW0GR0YZ4Z7GXUmcZqoRmZCxhR/zkS/OVNJc1FRNSqt1SFMCIhbNEdmuYTjQiAh7MOdgFzEqbc2O/EW5+XoZ42SSMPBS/DLbIPmX6Yp6S8PmfuouM2CcAPSd1WJx+/H+DWk='}
2023-07-16T12:27:45.394 INFO:teuthology.orchestra.console:Power off smithi159
2023-07-16T12:27:45.395 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-16T12:27:45.414 INFO:teuthology.orchestra.console:Power off smithi195
2023-07-16T12:27:45.415 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-16T12:27:45.425 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T12:27:45.437 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T12:27:45.547 INFO:teuthology.orchestra.console:Power off for smithi159 completed
2023-07-16T12:27:45.557 INFO:teuthology.orchestra.console:Power off for smithi195 completed
2023-07-16T12:27:45.701 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com
2023-07-16T12:27:45.709 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com