2023-07-11T19:01:43.025 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-11T19:01:43.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T19:01:43.027 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T19:01:43.155 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3af983e5e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3af91c3d30>, signals=[15])
2023-07-11T19:01:43.156 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging
2023-07-11T19:01:43.157 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T19:01:43.157 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-07-11T19:01:43.172 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging
2023-07-11T19:01:43.172 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T19:01:43.173 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server
2023-07-11T19:01:43.174 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"}
2023-07-11T19:01:43.197 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /host {"name": "smithi160"}
2023-07-11T19:01:43.245 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-11T19:01:43.257 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-11T19:01:43.296 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_centos_8.stream (ID 3)
2023-07-11T19:01:43.297 DEBUG:teuthology.provision.fog.smithi160:FOG request: PUT /host/265 {"imageID": 3}
2023-07-11T19:01:43.299 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_8.stream (ID 3)
2023-07-11T19:01:43.299 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 3}
2023-07-11T19:01:43.337 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 8.stream
2023-07-11T19:01:43.337 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T19:01:43.339 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of centos 8.stream
2023-07-11T19:01:43.339 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None
2023-07-11T19:01:43.382 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T19:01:43.385 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T19:01:43.414 DEBUG:teuthology.provision.fog.smithi160:FOG request: POST /host/265/task {"taskTypeID": 1}
2023-07-11T19:01:43.416 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1}
2023-07-11T19:01:43.469 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None
2023-07-11T19:01:43.477 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T19:01:43.546 INFO:teuthology.orchestra.console:Power off smithi160
2023-07-11T19:01:43.547 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T19:01:43.564 INFO:teuthology.orchestra.console:Power off smithi062
2023-07-11T19:01:43.565 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T19:01:43.575 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T19:01:43.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T19:01:43.697 INFO:teuthology.orchestra.console:Power off for smithi160 completed
2023-07-11T19:01:43.707 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2023-07-11T19:01:43.798 INFO:teuthology.orchestra.console:Power on smithi160
2023-07-11T19:01:43.799 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T19:01:43.808 INFO:teuthology.orchestra.console:Power on smithi062
2023-07-11T19:01:43.809 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T19:01:43.820 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T19:01:43.832 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T19:01:47.848 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T19:01:47.873 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T19:01:48.058 INFO:teuthology.orchestra.console:Power on for smithi160 completed
2023-07-11T19:01:48.159 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish
2023-07-11T19:01:48.160 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None
2023-07-11T19:01:51.985 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T19:01:52.215 INFO:teuthology.orchestra.console:Power on for smithi062 completed
2023-07-11T19:01:52.316 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish
2023-07-11T19:01:52.317 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T19:02:03.252 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None
2023-07-11T19:02:07.396 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T19:02:18.327 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None
2023-07-11T19:02:22.478 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T19:02:33.426 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None
2023-07-11T19:02:37.555 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T19:02:48.506 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None
2023-07-11T19:02:52.628 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T19:03:03.593 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None
2023-07-11T19:03:07.701 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T19:03:18.681 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None
2023-07-11T19:03:22.783 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T19:03:33.772 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None
2023-07-11T19:03:37.916 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T19:03:48.869 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None
2023-07-11T19:03:53.004 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T19:04:03.964 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None
2023-07-11T19:04:08.097 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T19:04:19.068 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None
2023-07-11T19:04:23.181 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T19:04:34.157 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None
2023-07-11T19:04:34.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:04:37.296 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2023-07-11T19:04:38.253 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T19:04:38.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:04:41.392 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-11T19:04:43.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:04:46.352 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2023-07-11T19:04:47.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:04:50.448 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-11T19:04:52.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:04:55.408 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2023-07-11T19:04:56.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:04:59.504 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-11T19:05:01.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:05:04.464 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2023-07-11T19:05:05.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:05:08.564 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-11T19:05:10.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:05:13.520 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2023-07-11T19:05:14.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:05:17.648 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-11T19:05:19.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:05:22.580 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2023-07-11T19:05:23.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:05:26.704 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-11T19:05:28.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:05:31.664 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160
2023-07-11T19:05:32.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:05:37.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:06:32.760 WARNING:teuthology.provision.fog.smithi062:timed out
2023-07-11T19:06:37.671 WARNING:teuthology.provision.fog.smithi160:timed out
2023-07-11T19:06:38.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:06:39.007 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T19:06:39.008 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T19:06:39.271 INFO:teuthology.provision.fog.smithi062:Node is ready
2023-07-11T19:06:39.272 DEBUG:teuthology.orchestra.run.smithi062:> hostname
2023-07-11T19:06:39.292 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com
2023-07-11T19:06:39.293 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts
2023-07-11T19:06:39.352 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062
2023-07-11T19:06:39.352 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-07-11T19:06:39.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts
2023-07-11T19:06:39.493 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts
2023-07-11T19:06:39.563 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname
2023-07-11T19:06:39.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-07-11T19:06:39.700 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-07-11T19:06:39.758 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2023-07-11T19:06:39.759 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8"
2023-07-11T19:06:39.759 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2023-07-11T19:06:39.759 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2023-07-11T19:06:39.759 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8"
2023-07-11T19:06:39.759 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-07-11T19:06:39.760 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-11T19:06:39.760 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-07-11T19:06:39.760 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-11T19:06:39.760 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2023-07-11T19:06:39.760 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T19:06:39.760 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T19:06:39.760 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-11T19:06:39.761 INFO:teuthology.provision.fog.smithi062:Deploy complete!
2023-07-11T19:06:39.763 DEBUG:teuthology.parallel:result is None
2023-07-11T19:06:43.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:06:43.938 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T19:06:43.939 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T19:06:44.216 INFO:teuthology.provision.fog.smithi160:Node is ready
2023-07-11T19:06:44.217 DEBUG:teuthology.orchestra.run.smithi160:> hostname
2023-07-11T19:06:44.235 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com
2023-07-11T19:06:44.235 DEBUG:teuthology.orchestra.run.smithi160:> grep smithi160.front.sepia.ceph.com /etc/hosts
2023-07-11T19:06:44.293 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160
2023-07-11T19:06:44.293 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160
2023-07-11T19:06:44.405 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hosts
2023-07-11T19:06:44.435 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.160/172.21.15.160/g' /etc/hosts
2023-07-11T19:06:44.502 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hostname
2023-07-11T19:06:44.571 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160
2023-07-11T19:06:44.637 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release
2023-07-11T19:06:44.694 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream"
2023-07-11T19:06:44.695 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8"
2023-07-11T19:06:44.695 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos"
2023-07-11T19:06:44.695 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora"
2023-07-11T19:06:44.695 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8"
2023-07-11T19:06:44.695 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8"
2023-07-11T19:06:44.695 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-11T19:06:44.696 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31"
2023-07-11T19:06:44.696 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-11T19:06:44.696 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/"
2023-07-11T19:06:44.696 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T19:06:44.696 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T19:06:44.696 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-11T19:06:44.697 INFO:teuthology.provision.fog.smithi160:Deploy complete!
2023-07-11T19:06:44.697 DEBUG:teuthology.parallel:result is None
2023-07-11T19:06:44.898 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com
2023-07-11T19:06:44.899 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-11T19:06:44.956 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com
2023-07-11T19:06:44.956 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-11T19:06:44.985 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server
2023-07-11T19:06:44.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-07-11T19:06:44.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:06:45.054 DEBUG:teuthology.orchestra.run.smithi062:> true
2023-07-11T19:06:45.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-07-11T19:06:45.084 DEBUG:teuthology.orchestra.run.smithi062:> uname -m
2023-07-11T19:06:45.145 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64
2023-07-11T19:06:45.145 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-07-11T19:06:45.206 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2023-07-11T19:06:45.206 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8"
2023-07-11T19:06:45.206 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2023-07-11T19:06:45.206 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2023-07-11T19:06:45.207 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8"
2023-07-11T19:06:45.207 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-07-11T19:06:45.207 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-11T19:06:45.207 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-07-11T19:06:45.207 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-11T19:06:45.207 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2023-07-11T19:06:45.207 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T19:06:45.208 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T19:06:45.208 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-11T19:06:45.208 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-07-11T19:06:45.234 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server
2023-07-11T19:06:45.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com'
2023-07-11T19:06:45.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T19:06:45.301 DEBUG:teuthology.orchestra.run.smithi160:> true
2023-07-11T19:06:45.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com'
2023-07-11T19:06:45.366 DEBUG:teuthology.orchestra.run.smithi160:> uname -m
2023-07-11T19:06:45.423 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64
2023-07-11T19:06:45.424 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release
2023-07-11T19:06:45.481 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream"
2023-07-11T19:06:45.481 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8"
2023-07-11T19:06:45.481 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos"
2023-07-11T19:06:45.482 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora"
2023-07-11T19:06:45.482 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8"
2023-07-11T19:06:45.482 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8"
2023-07-11T19:06:45.482 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-11T19:06:45.482 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31"
2023-07-11T19:06:45.483 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-11T19:06:45.483 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/"
2023-07-11T19:06:45.483 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T19:06:45.483 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T19:06:45.483 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-11T19:06:45.484 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server
2023-07-11T19:06:45.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T19:06:45.510 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T19:06:45.614 INFO:teuthology.dispatcher.supervisor:Running job 7334120
2023-07-11T19:06:45.615 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_choffman@teuthology --archive /home/teuthworker/archive/choffman-2023-07-11_19:00:51-rbd:mirror-wip-choffman-61707-distro-default-smithi/7334120 --name choffman-2023-07-11_19:00:51-rbd:mirror-wip-choffman-61707-distro-default-smithi --description rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} -- /home/teuthworker/archive/choffman-2023-07-11_19:00:51-rbd:mirror-wip-choffman-61707-distro-default-smithi/7334120/orig.config.yaml
2023-07-11T19:06:45.618 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/choffman-2023-07-11_19:00:51-rbd:mirror-wip-choffman-61707-distro-default-smithi/7334120
2023-07-11T19:06:45.618 INFO:teuthology.dispatcher.supervisor:Job PID: 21577
2023-07-11T19:06:45.619 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-11T19:08:45.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T19:08:45.721 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T19:10:45.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T19:10:45.906 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T19:12:46.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T19:12:46.087 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T19:14:46.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T19:14:46.285 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T19:16:46.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T19:16:46.395 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T19:18:46.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T19:18:46.556 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T19:20:46.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T19:20:46.738 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T19:22:46.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T19:22:46.862 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T19:24:47.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T19:24:47.047 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T19:26:47.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T19:26:47.227 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T19:28:47.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T19:28:47.398 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T19:28:47.466 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-11T19:28:47.581 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-11T19:28:47.582 INFO:teuthology.nuke:Checking targets against current locks
2023-07-11T19:28:47.635 DEBUG:teuthology.nuke:shortname: smithi062
2023-07-11T19:28:47.635 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T19:28:47.658 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-07-11_19:00:51-rbd:mirror-wip-choffman-61707-distro-default-smithi/7334120', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 19:01:42.211157', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvRTF1LlVe2adrxWH6YqcwlKVWBQDOFraWNbT0xZ5gpeuu78YGKJF+inEtXK5ie90vBzNQCc6z2I9zkH8Z3kbhT+M65oJfWZBzDdWS33Wd8TYQRi/xIqNW3oT/Gl/axa8dDVG7gCI/W6QWHydt7RrpZ24crptsyyddb12u5AcfL5AG/tOU5Km9wP8nODej4U19zILttuNPCSjiClRS0o4zJnm0SRZcCqjRCEuRZSzlvNRCV7MpA1I/l0mqQBTwE1R8IpS8LhoPoZGYRjl9AW7mtn/ahdaUQEX/sDfEmtAkn/TngSpi+nVrQi3omwrlAjYSmgamwl0Mojb5IU6LamIE2Gi1KspnjrtxfGhr/JpV5E/8dZCcahoF7XSlmxT3EzbeW1ISAsE3IJ1OJeOajNBsG7Eoi6eFN5af7uL6ihmwlGm/a3E8uuUGKDBU9jcrtHcyUV+/fK4UyZAcsxOrXHBMX2P0NzYR4uPEqYSCwrDM+GMNdo4fpWtFr9MNpfT9DTc='}
2023-07-11T19:28:47.661 DEBUG:teuthology.nuke:shortname: smithi160
2023-07-11T19:28:47.661 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T19:28:47.685 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-07-11_19:00:51-rbd:mirror-wip-choffman-61707-distro-default-smithi/7334120', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 19:01:42.213102', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHSeGEvyX9x9DlJIknl/lnOBdXX0MjXXFxAWSVgheUS06asQLwQhyx4mB9geJ1pmoVG0tJZ4Kauj/ASq9olMW6E='}
2023-07-11T19:28:47.715 INFO:teuthology.orchestra.console:Power off smithi062
2023-07-11T19:28:47.716 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T19:28:47.735 INFO:teuthology.orchestra.console:Power off smithi160
2023-07-11T19:28:47.736 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T19:28:47.746 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T19:28:47.757 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T19:28:47.869 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2023-07-11T19:28:47.880 INFO:teuthology.orchestra.console:Power off for smithi160 completed
2023-07-11T19:28:48.022 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com
2023-07-11T19:28:48.030 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com