2023-07-06T15:18:46.532 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-06T15:18:46.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:18:46.534 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:18:46.681 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f7a78396610>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f7a795b28b0>, signals=[15])
2023-07-06T15:18:46.683 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging
2023-07-06T15:18:46.683 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server
2023-07-06T15:18:46.683 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2023-07-06T15:18:46.709 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging
2023-07-06T15:18:46.709 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server
2023-07-06T15:18:46.709 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2023-07-06T15:18:46.711 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /host {"name": "smithi037"}
2023-07-06T15:18:46.733 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /host {"name": "smithi164"}
2023-07-06T15:18:46.783 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-06T15:18:46.794 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-06T15:18:46.822 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_centos_8.stream (ID 3)
2023-07-06T15:18:46.822 DEBUG:teuthology.provision.fog.smithi037:FOG request: PUT /host/142 {"imageID": 3}
2023-07-06T15:18:46.835 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_centos_8.stream (ID 3)
2023-07-06T15:18:46.835 DEBUG:teuthology.provision.fog.smithi164:FOG request: PUT /host/269 {"imageID": 3}
2023-07-06T15:18:46.862 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 8.stream
2023-07-06T15:18:46.862 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-06T15:18:46.877 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of centos 8.stream
2023-07-06T15:18:46.877 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:18:46.917 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /tasktype {"name": "deploy"}
2023-07-06T15:18:46.925 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /tasktype {"name": "deploy"}
2023-07-06T15:18:46.949 DEBUG:teuthology.provision.fog.smithi037:FOG request: POST /host/142/task {"taskTypeID": 1}
2023-07-06T15:18:46.961 DEBUG:teuthology.provision.fog.smithi164:FOG request: POST /host/269/task {"taskTypeID": 1}
2023-07-06T15:18:46.996 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-06T15:18:47.033 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:18:47.080 INFO:teuthology.orchestra.console:Power off smithi037
2023-07-06T15:18:47.081 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-06T15:18:47.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T15:18:47.125 INFO:teuthology.orchestra.console:Power off smithi164
2023-07-06T15:18:47.125 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-06T15:18:47.147 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T15:18:51.136 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T15:18:51.177 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T15:18:55.250 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T15:18:55.287 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T15:18:55.461 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2023-07-06T15:18:55.562 INFO:teuthology.orchestra.console:Power on smithi037
2023-07-06T15:18:55.562 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-06T15:18:55.582 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T15:18:59.401 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T15:18:59.603 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T15:18:59.611 INFO:teuthology.orchestra.console:Power off for smithi164 completed
2023-07-06T15:18:59.712 INFO:teuthology.orchestra.console:Power on smithi164
2023-07-06T15:18:59.713 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-06T15:18:59.733 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T15:19:03.725 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T15:19:03.753 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T15:19:03.935 INFO:teuthology.orchestra.console:Power on for smithi037 completed
2023-07-06T15:19:03.964 INFO:teuthology.orchestra.console:Power on for smithi164 completed
2023-07-06T15:19:04.036 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish
2023-07-06T15:19:04.036 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-06T15:19:04.065 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish
2023-07-06T15:19:04.065 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:19:19.128 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-06T15:19:19.132 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:19:34.241 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-06T15:19:34.242 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:19:49.317 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-06T15:19:49.323 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:20:04.413 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:20:04.414 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-06T15:20:19.504 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-06T15:20:19.505 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:20:34.609 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:20:34.610 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-06T15:20:49.720 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:20:49.721 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-06T15:21:04.844 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-06T15:21:04.846 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:21:19.956 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-06T15:21:19.958 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:21:35.052 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:21:35.054 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-06T15:21:35.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T15:21:50.137 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:21:53.520 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2023-07-06T15:21:59.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T15:22:02.608 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2023-07-06T15:22:05.228 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:22:08.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T15:22:11.664 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2023-07-06T15:22:17.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T15:22:20.300 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:22:35.376 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-07-06T15:22:35.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T15:22:53.936 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-07-06T15:22:59.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T15:23:03.028 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-07-06T15:23:09.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T15:23:12.112 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-07-06T15:23:17.678 WARNING:teuthology.provision.fog.smithi037:timed out
2023-07-06T15:23:18.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T15:23:21.168 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-07-06T15:23:23.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T15:23:23.917 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-06T15:23:23.918 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-06T15:23:24.182 INFO:teuthology.provision.fog.smithi037:Node is ready
2023-07-06T15:23:24.182 DEBUG:teuthology.orchestra.run.smithi037:> hostname
2023-07-06T15:23:24.202 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com
2023-07-06T15:23:24.203 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts
2023-07-06T15:23:24.263 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037
2023-07-06T15:23:24.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037
2023-07-06T15:23:24.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts
2023-07-06T15:23:24.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts
2023-07-06T15:23:24.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname
2023-07-06T15:23:24.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037
2023-07-06T15:23:24.609 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release
2023-07-06T15:23:24.668 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream"
2023-07-06T15:23:24.668 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8"
2023-07-06T15:23:24.669 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos"
2023-07-06T15:23:24.669 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora"
2023-07-06T15:23:24.669 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8"
2023-07-06T15:23:24.669 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8"
2023-07-06T15:23:24.669 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-06T15:23:24.669 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2023-07-06T15:23:24.669 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-06T15:23:24.670 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/"
2023-07-06T15:23:24.670 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-06T15:23:24.670 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-06T15:23:24.670 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-06T15:23:24.671 INFO:teuthology.provision.fog.smithi037:Deploy complete!
2023-07-06T15:23:24.672 DEBUG:teuthology.parallel:result is None
2023-07-06T15:23:27.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T15:23:30.224 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-07-06T15:23:36.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T15:23:39.280 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-07-06T15:23:45.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T15:24:45.324 WARNING:teuthology.provision.fog.smithi164:timed out
2023-07-06T15:24:51.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T15:24:51.542 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-06T15:24:51.543 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-06T15:24:51.812 INFO:teuthology.provision.fog.smithi164:Node is ready
2023-07-06T15:24:51.813 DEBUG:teuthology.orchestra.run.smithi164:> hostname
2023-07-06T15:24:51.832 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com
2023-07-06T15:24:51.832 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts
2023-07-06T15:24:51.892 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164
2023-07-06T15:24:51.892 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164
2023-07-06T15:24:52.001 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts
2023-07-06T15:24:52.030 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts
2023-07-06T15:24:52.099 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname
2023-07-06T15:24:52.167 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164
2023-07-06T15:24:52.234 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release
2023-07-06T15:24:52.291 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream"
2023-07-06T15:24:52.291 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8"
2023-07-06T15:24:52.291 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos"
2023-07-06T15:24:52.291 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora"
2023-07-06T15:24:52.291 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8"
2023-07-06T15:24:52.292 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8"
2023-07-06T15:24:52.292 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-06T15:24:52.292 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31"
2023-07-06T15:24:52.292 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-06T15:24:52.292 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/"
2023-07-06T15:24:52.292 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-06T15:24:52.292 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-06T15:24:52.293 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-06T15:24:52.293 INFO:teuthology.provision.fog.smithi164:Deploy complete!
2023-07-06T15:24:52.293 DEBUG:teuthology.parallel:result is None
2023-07-06T15:24:52.475 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com
2023-07-06T15:24:52.476 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-06T15:24:52.500 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com
2023-07-06T15:24:52.500 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-06T15:24:52.517 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server
2023-07-06T15:24:52.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com'
2023-07-06T15:24:52.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T15:24:52.585 DEBUG:teuthology.orchestra.run.smithi037:> true
2023-07-06T15:24:52.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com'
2023-07-06T15:24:52.681 DEBUG:teuthology.orchestra.run.smithi037:> uname -m
2023-07-06T15:24:52.740 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64
2023-07-06T15:24:52.741 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release
2023-07-06T15:24:52.799 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream"
2023-07-06T15:24:52.799 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8"
2023-07-06T15:24:52.799 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos"
2023-07-06T15:24:52.799 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora"
2023-07-06T15:24:52.799 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8"
2023-07-06T15:24:52.799 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8"
2023-07-06T15:24:52.799 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-06T15:24:52.800 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2023-07-06T15:24:52.800 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-06T15:24:52.800 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/"
2023-07-06T15:24:52.800 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-06T15:24:52.800 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-06T15:24:52.800 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-06T15:24:52.801 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2023-07-06T15:24:52.825 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server
2023-07-06T15:24:52.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com'
2023-07-06T15:24:52.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T15:24:52.890 DEBUG:teuthology.orchestra.run.smithi164:> true
2023-07-06T15:24:52.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com'
2023-07-06T15:24:52.961 DEBUG:teuthology.orchestra.run.smithi164:> uname -m
2023-07-06T15:24:53.021 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64
2023-07-06T15:24:53.021 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release
2023-07-06T15:24:53.081 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream"
2023-07-06T15:24:53.081 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8"
2023-07-06T15:24:53.081 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos"
2023-07-06T15:24:53.082 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora"
2023-07-06T15:24:53.082 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8"
2023-07-06T15:24:53.082 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8"
2023-07-06T15:24:53.082 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-06T15:24:53.082 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31"
2023-07-06T15:24:53.082 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-06T15:24:53.082 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/"
2023-07-06T15:24:53.082 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-06T15:24:53.083 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-06T15:24:53.083 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-06T15:24:53.083 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2023-07-06T15:24:53.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:24:53.109 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:24:53.205 INFO:teuthology.dispatcher.supervisor:Running job 7328098
2023-07-06T15:24:53.206 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_akupczyk@teuthology --archive /home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328098 --name akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328098/orig.config.yaml
2023-07-06T15:24:53.209 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328098
2023-07-06T15:24:53.210 INFO:teuthology.dispatcher.supervisor:Job PID: 28966
2023-07-06T15:24:53.210 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-06T15:26:53.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:26:53.298 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:28:53.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:28:53.471 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:30:53.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:30:53.618 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:32:53.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:32:53.760 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:34:53.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:34:53.890 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:36:54.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:36:54.141 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:38:54.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:38:54.287 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:40:54.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:40:54.414 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:42:54.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:42:54.541 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:44:54.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:44:54.709 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:46:54.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:46:54.828 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:48:54.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:48:54.995 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:50:55.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:50:55.169 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:52:55.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:52:55.274 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:54:55.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:54:55.430 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:56:55.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:56:55.505 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T15:58:55.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T15:58:55.670 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T16:00:55.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T16:00:55.837 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T16:02:55.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T16:02:55.987 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T16:04:56.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T16:04:56.161 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T16:06:56.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T16:06:56.320 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T16:08:56.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T16:08:56.436 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T16:10:56.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T16:10:56.592 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T16:12:56.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T16:12:56.728 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T16:14:56.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T16:14:56.895 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T16:16:57.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T16:16:57.066 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T16:18:57.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T16:18:57.231 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T16:21:07.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T16:21:07.401 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T16:21:07.472 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-06T16:21:07.579 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-06T16:21:07.579 INFO:teuthology.nuke:Checking targets against current locks
2023-07-06T16:21:07.629 DEBUG:teuthology.nuke:shortname: smithi037
2023-07-06T16:21:07.629 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-06T16:21:07.652 DEBUG:teuthology.nuke:shortname: smithi164
2023-07-06T16:21:07.652 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-06T16:21:07.657 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328098', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 15:18:45.760117', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCa+nSQM/QcGG0p/sLpTngBIKvIr0RkeFvBu97fniIfw2tSqlKOdjyeu+s+BAAEEfz3uqNVPJS3ItjTDckYINfLv/U4wUTsLTRCBheAhRDSyzN5OUbiXtw1ErfDJU7d9Rc63J/vjCeSQRCgushll6kytx5xDuYrw4w+1pySaSK5B8kN/LXPEU5RfWebxJ6/Cjg8JZlFItgodqfnba/SMFVG+vMrvD6wWc43NfLDhH2LLOobgMprBFMZ/gTBbkk/2YtjDWGrYwUHpj844nIV/u5o3Dq0QNg8QDM5VusXM8eepa7dio5/ObGygiKBOoNKHp9B18jEEwJbkOw1oaxETcc/jsy2eizenbLIUcuRVd2OJjl3z3A5kV+EafdEKCaKTgi3rvlgDiz77Mk3z0B6ROs2JkZzOBeIa8rDTccR2Pp49X1kwHXwXLNuNK8ECHEA6BKhjgKsin7yUU5S7wtktEL71JT3hY7O/ALMms6HP7wtk/2Gjd2yZU4UPQgqlH75xlU='}
2023-07-06T16:21:07.676 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-07-06_15:17:23-rados-wip-aclamk-bs-esb-4-tests-enabled-distro-default-smithi/7328098', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 15:18:45.762049', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtA+zVTBKxq/157uTGFL4BUPq6Rb7wKB0kZpJchja6bvSqSpdhxAnK1v+pE19GddT9rfCml8U84lAn4uGgNvkxIku30+q5zxahD39iaXcVIi0SnGEvQqjtsRTFfxyF7BUZkB/z5HmaXnRWG1aBZ/Pmd/mbLnQfZVOpNmRj7Y7Htrpnc288aG295HVgkZYzZf1ITD5sZ4hxxHLy7m9zausrYFsedbWnhhGKz8FlZo9sNCbQtwIAhJbwepyUsQMZn/qXJKEIxMZmwr1JPduF1PH5oCUC+G5J23t4mWWsFOa2ohclkXUzixUB8dVgPI7ArU8/U3dIiZTdODoTyUGaeHAyr3Wyh424ZXFffYmKij56QOLMxzbLmtMwi+SaywoqLUvBh8T+jVqcVapAjxq+j4DShJxwIC4snofhHUyC9JVuhWGWSJb2tI6Jagcd6/GaxLtdU5Sj/qs10sVWCmG+VK7Ycp7pWsskxrtE+C46SL/XVfjsza8T+fRr3KKXv801Fwc='}
2023-07-06T16:21:07.705 INFO:teuthology.orchestra.console:Power off smithi037
2023-07-06T16:21:07.706 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-06T16:21:07.726 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T16:21:07.743 INFO:teuthology.orchestra.console:Power off smithi164
2023-07-06T16:21:07.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-06T16:21:07.763 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T16:21:07.853 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2023-07-06T16:21:07.885 INFO:teuthology.orchestra.console:Power off for smithi164 completed
2023-07-06T16:21:08.013 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com
2023-07-06T16:21:08.038 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com