2023-07-11T15:30:42.309 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-11T15:30:42.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T15:30:42.311 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T15:30:42.447 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff7a1f115b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff7a1873790>, signals=[15])
2023-07-11T15:30:42.448 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging
2023-07-11T15:30:42.449 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T15:30:42.449 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server
2023-07-11T15:30:42.478 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging
2023-07-11T15:30:42.478 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T15:30:42.479 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2023-07-11T15:30:42.480 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /host {"name": "smithi007"}
2023-07-11T15:30:42.503 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /host {"name": "smithi097"}
2023-07-11T15:30:42.633 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-11T15:30:42.636 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-11T15:30:42.687 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_centos_8.stream (ID 3)
2023-07-11T15:30:42.688 DEBUG:teuthology.provision.fog.smithi007:FOG request: PUT /host/113 {"imageID": 3}
2023-07-11T15:30:42.696 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_centos_8.stream (ID 3)
2023-07-11T15:30:42.696 DEBUG:teuthology.provision.fog.smithi097:FOG request: PUT /host/202 {"imageID": 3}
2023-07-11T15:30:42.735 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of centos 8.stream
2023-07-11T15:30:42.735 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T15:30:42.741 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of centos 8.stream
2023-07-11T15:30:42.741 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-07-11T15:30:42.770 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T15:30:42.785 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T15:30:42.802 DEBUG:teuthology.provision.fog.smithi097:FOG request: POST /host/202/task {"taskTypeID": 1}
2023-07-11T15:30:42.813 DEBUG:teuthology.provision.fog.smithi007:FOG request: POST /host/113/task {"taskTypeID": 1}
2023-07-11T15:30:42.873 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T15:30:42.886 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-07-11T15:30:42.951 INFO:teuthology.orchestra.console:Power off smithi097
2023-07-11T15:30:42.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T15:30:42.967 INFO:teuthology.orchestra.console:Power off smithi007
2023-07-11T15:30:42.967 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T15:30:42.976 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T15:30:42.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T15:30:43.100 INFO:teuthology.orchestra.console:Power off for smithi097 completed
2023-07-11T15:30:43.201 INFO:teuthology.orchestra.console:Power on smithi097
2023-07-11T15:30:43.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T15:30:43.220 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T15:30:47.015 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T15:30:47.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T15:30:47.454 INFO:teuthology.orchestra.console:Power on for smithi097 completed
2023-07-11T15:30:47.555 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish
2023-07-11T15:30:47.556 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T15:30:51.128 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T15:30:51.338 INFO:teuthology.orchestra.console:Power off for smithi007 completed
2023-07-11T15:30:51.439 INFO:teuthology.orchestra.console:Power on smithi007
2023-07-11T15:30:51.439 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T15:30:51.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T15:30:55.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T15:30:59.597 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T15:30:59.806 INFO:teuthology.orchestra.console:Power on for smithi007 completed
2023-07-11T15:30:59.907 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish
2023-07-11T15:30:59.908 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-07-11T15:31:02.626 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T15:31:15.000 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-07-11T15:31:17.698 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T15:31:30.091 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-07-11T15:31:32.777 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T15:31:45.185 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-07-11T15:31:47.850 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T15:32:00.270 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-07-11T15:32:02.924 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T15:32:15.356 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-07-11T15:32:17.992 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T15:32:30.448 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-07-11T15:32:33.076 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T15:32:45.541 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-07-11T15:32:48.147 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T15:33:00.636 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-07-11T15:33:03.240 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T15:33:15.716 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-07-11T15:33:18.318 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T15:33:30.803 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-07-11T15:33:30.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:33:33.397 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-11T15:33:33.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:33:36.528 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-11T15:33:42.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:33:45.616 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-11T15:33:49.296 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-07-11T15:33:51.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:33:54.672 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-11T15:33:55.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:33:58.352 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-07-11T15:34:00.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:34:03.728 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-11T15:34:04.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:34:07.408 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-07-11T15:34:09.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:34:12.784 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-11T15:34:13.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:34:16.464 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-07-11T15:34:18.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:34:21.840 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-11T15:34:22.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:34:27.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:34:30.896 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-11T15:34:36.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:34:55.344 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-11T15:35:01.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:35:04.432 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-11T15:35:10.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:35:11.501 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T15:35:11.502 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T15:35:22.467 WARNING:teuthology.provision.fog.smithi007:timed out
2023-07-11T15:35:28.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:35:28.703 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T15:35:28.704 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T15:35:28.946 INFO:teuthology.provision.fog.smithi007:Node is ready
2023-07-11T15:35:28.946 DEBUG:teuthology.orchestra.run.smithi007:> hostname
2023-07-11T15:35:29.009 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com
2023-07-11T15:35:29.009 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi007.front.sepia.ceph.com /etc/hosts
2023-07-11T15:35:29.072 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007
2023-07-11T15:35:29.072 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007
2023-07-11T15:35:29.164 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hosts
2023-07-11T15:35:29.194 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/172.21.15.7/172.21.15.7/g' /etc/hosts
2023-07-11T15:35:29.267 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hostname
2023-07-11T15:35:29.338 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007
2023-07-11T15:35:29.409 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release
2023-07-11T15:35:29.471 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream"
2023-07-11T15:35:29.471 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8"
2023-07-11T15:35:29.471 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos"
2023-07-11T15:35:29.471 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora"
2023-07-11T15:35:29.472 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8"
2023-07-11T15:35:29.472 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8"
2023-07-11T15:35:29.472 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-11T15:35:29.472 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31"
2023-07-11T15:35:29.472 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-11T15:35:29.472 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/"
2023-07-11T15:35:29.472 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T15:35:29.473 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T15:35:29.473 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-11T15:35:29.473 INFO:teuthology.provision.fog.smithi007:Deploy complete!
2023-07-11T15:35:29.475 DEBUG:teuthology.parallel:result is None
2023-07-11T15:35:36.625 INFO:teuthology.provision.fog.smithi097:Node is ready
2023-07-11T15:35:36.625 DEBUG:teuthology.orchestra.run.smithi097:> hostname
2023-07-11T15:35:36.649 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com
2023-07-11T15:35:36.650 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts
2023-07-11T15:35:36.710 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097
2023-07-11T15:35:36.711 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2023-07-11T15:35:36.834 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts
2023-07-11T15:35:36.865 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts
2023-07-11T15:35:36.936 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname
2023-07-11T15:35:37.007 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2023-07-11T15:35:37.077 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2023-07-11T15:35:37.136 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream"
2023-07-11T15:35:37.136 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8"
2023-07-11T15:35:37.136 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos"
2023-07-11T15:35:37.136 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora"
2023-07-11T15:35:37.136 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8"
2023-07-11T15:35:37.137 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8"
2023-07-11T15:35:37.137 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-11T15:35:37.137 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2023-07-11T15:35:37.137 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-11T15:35:37.137 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/"
2023-07-11T15:35:37.137 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T15:35:37.137 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T15:35:37.138 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-11T15:35:37.138 INFO:teuthology.provision.fog.smithi097:Deploy complete!
2023-07-11T15:35:37.138 DEBUG:teuthology.parallel:result is None
2023-07-11T15:35:37.298 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com
2023-07-11T15:35:37.299 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-11T15:35:37.332 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com
2023-07-11T15:35:37.332 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-11T15:35:37.358 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server
2023-07-11T15:35:37.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com'
2023-07-11T15:35:37.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:35:37.426 DEBUG:teuthology.orchestra.run.smithi007:> true
2023-07-11T15:35:37.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com'
2023-07-11T15:35:37.498 DEBUG:teuthology.orchestra.run.smithi007:> uname -m
2023-07-11T15:35:37.558 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64
2023-07-11T15:35:37.558 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release
2023-07-11T15:35:37.620 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream"
2023-07-11T15:35:37.620 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8"
2023-07-11T15:35:37.620 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos"
2023-07-11T15:35:37.620 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora"
2023-07-11T15:35:37.621 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8"
2023-07-11T15:35:37.621 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8"
2023-07-11T15:35:37.621 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-11T15:35:37.621 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31"
2023-07-11T15:35:37.621 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-11T15:35:37.621 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/"
2023-07-11T15:35:37.621 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T15:35:37.622 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T15:35:37.622 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-11T15:35:37.622 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server
2023-07-11T15:35:37.649 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server
2023-07-11T15:35:37.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com'
2023-07-11T15:35:37.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T15:35:37.714 DEBUG:teuthology.orchestra.run.smithi097:> true
2023-07-11T15:35:37.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com'
2023-07-11T15:35:37.791 DEBUG:teuthology.orchestra.run.smithi097:> uname -m
2023-07-11T15:35:37.851 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64
2023-07-11T15:35:37.851 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2023-07-11T15:35:37.911 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream"
2023-07-11T15:35:37.911 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8"
2023-07-11T15:35:37.911 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos"
2023-07-11T15:35:37.911 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora"
2023-07-11T15:35:37.912 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8"
2023-07-11T15:35:37.912 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8"
2023-07-11T15:35:37.912 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-11T15:35:37.912 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2023-07-11T15:35:37.912 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-11T15:35:37.912 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/"
2023-07-11T15:35:37.912 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T15:35:37.913 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T15:35:37.913 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-11T15:35:37.913 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2023-07-11T15:35:37.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T15:35:37.932 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T15:35:38.021 INFO:teuthology.dispatcher.supervisor:Running job 7333905
2023-07-11T15:35:38.022 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_choffman@teuthology --archive /home/teuthworker/archive/choffman-2023-07-11_15:29:52-rbd:mirror-wip-choffman-61707-distro-default-smithi/7333905 --name choffman-2023-07-11_15:29:52-rbd:mirror-wip-choffman-61707-distro-default-smithi --description rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} -- /home/teuthworker/archive/choffman-2023-07-11_15:29:52-rbd:mirror-wip-choffman-61707-distro-default-smithi/7333905/orig.config.yaml
2023-07-11T15:35:38.025 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/choffman-2023-07-11_15:29:52-rbd:mirror-wip-choffman-61707-distro-default-smithi/7333905
2023-07-11T15:35:38.025 INFO:teuthology.dispatcher.supervisor:Job PID: 30560
2023-07-11T15:35:38.026 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-11T15:37:38.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T15:37:38.125 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T15:39:38.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T15:39:38.272 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T15:41:38.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T15:41:38.451 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T15:43:38.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T15:43:38.646 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T15:45:38.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T15:45:38.818 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T15:47:38.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T15:47:38.971 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T15:49:39.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T15:49:39.117 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T15:51:39.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T15:51:39.268 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T15:53:39.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T15:53:39.357 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T15:55:39.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T15:55:39.518 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T15:57:39.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T15:57:39.655 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T15:59:39.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T15:59:39.779 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T16:01:39.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T16:01:39.944 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T16:03:40.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T16:03:40.112 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T16:05:40.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T16:05:40.190 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T16:05:40.257 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-11T16:05:40.362 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-11T16:05:40.363 INFO:teuthology.nuke:Checking targets against current locks
2023-07-11T16:05:40.415 DEBUG:teuthology.nuke:shortname: smithi007
2023-07-11T16:05:40.416 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T16:05:40.437 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-07-11_15:29:52-rbd:mirror-wip-choffman-61707-distro-default-smithi/7333905', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 15:30:41.514303', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCp7A7bhrqUj0amFdxzVJsp2lFl53USUdSbGp5IEaf9ZHjEbfMq63StzOuo81lhIVyqT4W5uh64uKVlPLO/GN9XOmNxaK52V7OAYbRw7YYavPgXA0Qxq0ZxTyOHAsWqJW3qtaEEFfpKfJ//1heg/zQHuBABYgnAvmeBuze2aOxLQT1LXfn5NcXkp6oB8IZXoRfPy7bIv1i4aY4O2Md7CCh66m1S4S22FRQwNcFtMB4Qb7HIYpvixYVrFLkHUTuL540bex8EOOnBWtrdCcEwxo8BgkmR3wC6HyPMx2UxUanoReraTQ3t7LCgBhvLwsrWxBy9f11npkX5c4iNZ7quoOkxM09m6pbhitxl7ure3nkE8yxYBXjkmhRy1pK7i04PeVf9WmY32OZuZ0EBOK5ptSigVcDve4gKCnZsf+5vejzSE6j9b0a5cmwD1q5+Zn0jDwvB/lh9xuJWURUusNyhb9uuAWmOVNVdmHYPzkCZUZdgBGtBTunhaMsyMh2c7iDVdqE='}
2023-07-11T16:05:40.439 DEBUG:teuthology.nuke:shortname: smithi097
2023-07-11T16:05:40.439 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T16:05:40.462 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-07-11_15:29:52-rbd:mirror-wip-choffman-61707-distro-default-smithi/7333905', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 15:30:41.512612', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKPQ1MavN/6AzXNpKw68SVyuzhHMR6CV62D6W9iNyDa3nActiXEnwASTNwpMhm+iHnOBS72Rosz7jD+unaJeSwc='}
2023-07-11T16:05:40.491 INFO:teuthology.orchestra.console:Power off smithi007
2023-07-11T16:05:40.492 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T16:05:40.506 INFO:teuthology.orchestra.console:Power off smithi097
2023-07-11T16:05:40.507 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T16:05:40.515 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T16:05:40.525 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T16:05:40.636 INFO:teuthology.orchestra.console:Power off for smithi007 completed
2023-07-11T16:05:40.644 INFO:teuthology.orchestra.console:Power off for smithi097 completed
2023-07-11T16:05:40.789 INFO:teuthology.lock.ops:unlocked: smithi007.front.sepia.ceph.com
2023-07-11T16:05:40.815 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com