2023-06-23T11:07:32.962 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-23T11:07:32.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:07:32.964 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:07:33.139 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb1fa199700>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb1f9b3d430>, signals=[15])
2023-06-23T11:07:33.140 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging
2023-06-23T11:07:33.141 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server
2023-06-23T11:07:33.141 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2023-06-23T11:07:33.169 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging
2023-06-23T11:07:33.170 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server
2023-06-23T11:07:33.170 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2023-06-23T11:07:33.172 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /host {"name": "smithi067"}
2023-06-23T11:07:33.193 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /host {"name": "smithi150"}
2023-06-23T11:07:33.247 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-23T11:07:33.264 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-23T11:07:33.291 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_centos_8.stream (ID 3)
2023-06-23T11:07:33.292 DEBUG:teuthology.provision.fog.smithi067:FOG request: PUT /host/172 {"imageID": 3}
2023-06-23T11:07:33.306 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_centos_8.stream (ID 3)
2023-06-23T11:07:33.306 DEBUG:teuthology.provision.fog.smithi150:FOG request: PUT /host/255 {"imageID": 3}
2023-06-23T11:07:33.341 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of centos 8.stream
2023-06-23T11:07:33.341 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T11:07:33.348 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 8.stream
2023-06-23T11:07:33.348 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-06-23T11:07:33.399 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /tasktype {"name": "deploy"}
2023-06-23T11:07:33.403 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /tasktype {"name": "deploy"}
2023-06-23T11:07:33.437 DEBUG:teuthology.provision.fog.smithi067:FOG request: POST /host/172/task {"taskTypeID": 1}
2023-06-23T11:07:33.440 DEBUG:teuthology.provision.fog.smithi150:FOG request: POST /host/255/task {"taskTypeID": 1}
2023-06-23T11:07:33.487 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-06-23T11:07:33.494 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T11:07:33.573 INFO:teuthology.orchestra.console:Power off smithi150
2023-06-23T11:07:33.574 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T11:07:33.592 INFO:teuthology.orchestra.console:Power off smithi067
2023-06-23T11:07:33.592 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T11:07:33.601 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T11:07:33.613 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T11:07:37.628 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T11:07:37.640 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T11:07:41.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T11:07:41.759 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T11:07:41.962 INFO:teuthology.orchestra.console:Power off for smithi150 completed
2023-06-23T11:07:41.973 INFO:teuthology.orchestra.console:Power off for smithi067 completed
2023-06-23T11:07:42.064 INFO:teuthology.orchestra.console:Power on smithi150
2023-06-23T11:07:42.065 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-23T11:07:42.075 INFO:teuthology.orchestra.console:Power on smithi067
2023-06-23T11:07:42.075 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-23T11:07:42.095 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T11:07:42.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T11:07:46.122 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T11:07:46.132 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T11:07:50.236 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T11:07:50.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T11:07:50.447 INFO:teuthology.orchestra.console:Power on for smithi067 completed
2023-06-23T11:07:50.457 INFO:teuthology.orchestra.console:Power on for smithi150 completed
2023-06-23T11:07:50.549 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish
2023-06-23T11:07:50.550 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T11:07:50.558 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish
2023-06-23T11:07:50.558 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-06-23T11:08:05.632 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T11:08:05.634 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-06-23T11:08:20.716 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-06-23T11:08:20.718 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T11:08:35.804 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-06-23T11:08:35.806 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T11:08:50.880 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-06-23T11:08:50.882 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T11:09:05.952 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-06-23T11:09:05.954 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T11:09:21.040 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-06-23T11:09:21.042 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T11:09:36.124 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-06-23T11:09:36.126 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T11:09:51.195 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T11:09:51.197 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-06-23T11:10:06.278 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-06-23T11:10:06.279 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T11:10:21.360 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T11:10:21.361 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-06-23T11:10:36.436 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None
2023-06-23T11:10:36.438 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T11:10:36.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:10:36.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:10:54.832 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-06-23T11:10:54.833 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-06-23T11:11:00.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:11:00.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:11:03.888 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-06-23T11:11:03.920 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-06-23T11:11:09.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:11:09.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:11:12.944 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-06-23T11:11:12.976 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-06-23T11:11:18.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:11:18.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:11:22.032 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-06-23T11:11:22.033 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-06-23T11:11:28.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:11:28.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:11:31.088 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-06-23T11:11:31.089 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-06-23T11:11:37.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:11:37.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:12:37.152 WARNING:teuthology.provision.fog.smithi150:timed out
2023-06-23T11:12:37.154 WARNING:teuthology.provision.fog.smithi067:timed out
2023-06-23T11:12:43.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:12:43.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:12:43.384 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-23T11:12:43.385 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-23T11:12:43.396 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-23T11:12:43.396 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-23T11:12:43.637 INFO:teuthology.provision.fog.smithi067:Node is ready
2023-06-23T11:12:43.638 DEBUG:teuthology.orchestra.run.smithi067:> hostname
2023-06-23T11:12:43.654 INFO:teuthology.provision.fog.smithi150:Node is ready
2023-06-23T11:12:43.654 DEBUG:teuthology.orchestra.run.smithi150:> hostname
2023-06-23T11:12:43.656 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com
2023-06-23T11:12:43.657 DEBUG:teuthology.orchestra.run.smithi067:> grep smithi067.front.sepia.ceph.com /etc/hosts
2023-06-23T11:12:43.714 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com
2023-06-23T11:12:43.714 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts
2023-06-23T11:12:43.717 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067
2023-06-23T11:12:43.717 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067
2023-06-23T11:12:43.774 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150
2023-06-23T11:12:43.774 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2023-06-23T11:12:43.827 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hosts
2023-06-23T11:12:43.858 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts
2023-06-23T11:12:43.868 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts
2023-06-23T11:12:43.898 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts
2023-06-23T11:12:43.927 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hostname
2023-06-23T11:12:43.968 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname
2023-06-23T11:12:43.997 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067
2023-06-23T11:12:44.036 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2023-06-23T11:12:44.066 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release
2023-06-23T11:12:44.103 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2023-06-23T11:12:44.124 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream"
2023-06-23T11:12:44.124 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8"
2023-06-23T11:12:44.124 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos"
2023-06-23T11:12:44.125 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora"
2023-06-23T11:12:44.125 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8"
2023-06-23T11:12:44.125 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8"
2023-06-23T11:12:44.125 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 8"
2023-06-23T11:12:44.125 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31"
2023-06-23T11:12:44.125 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-06-23T11:12:44.125 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/"
2023-06-23T11:12:44.126 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T11:12:44.126 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T11:12:44.126 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-23T11:12:44.126 INFO:teuthology.provision.fog.smithi067:Deploy complete!
2023-06-23T11:12:44.128 DEBUG:teuthology.parallel:result is None
2023-06-23T11:12:44.161 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2023-06-23T11:12:44.162 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8"
2023-06-23T11:12:44.162 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2023-06-23T11:12:44.162 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2023-06-23T11:12:44.162 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8"
2023-06-23T11:12:44.162 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8"
2023-06-23T11:12:44.162 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 8"
2023-06-23T11:12:44.162 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2023-06-23T11:12:44.163 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-06-23T11:12:44.163 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2023-06-23T11:12:44.163 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T11:12:44.163 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T11:12:44.163 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-23T11:12:44.163 INFO:teuthology.provision.fog.smithi150:Deploy complete!
2023-06-23T11:12:44.164 DEBUG:teuthology.parallel:result is None
2023-06-23T11:12:44.311 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com
2023-06-23T11:12:44.312 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-23T11:12:44.339 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com
2023-06-23T11:12:44.339 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-23T11:12:44.357 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server
2023-06-23T11:12:44.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com'
2023-06-23T11:12:44.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:12:44.423 DEBUG:teuthology.orchestra.run.smithi067:> true
2023-06-23T11:12:44.490 DEBUG:teuthology.orchestra.run.smithi067:> uname -m
2023-06-23T11:12:44.548 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64
2023-06-23T11:12:44.548 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release
2023-06-23T11:12:44.606 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream"
2023-06-23T11:12:44.607 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8"
2023-06-23T11:12:44.607 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos"
2023-06-23T11:12:44.607 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora"
2023-06-23T11:12:44.607 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8"
2023-06-23T11:12:44.607 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8"
2023-06-23T11:12:44.607 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 8"
2023-06-23T11:12:44.607 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31"
2023-06-23T11:12:44.608 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-06-23T11:12:44.608 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/"
2023-06-23T11:12:44.608 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T11:12:44.608 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T11:12:44.608 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-23T11:12:44.609 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2023-06-23T11:12:44.631 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server
2023-06-23T11:12:44.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com'
2023-06-23T11:12:44.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T11:12:44.697 DEBUG:teuthology.orchestra.run.smithi150:> true
2023-06-23T11:12:44.721 DEBUG:teuthology.orchestra.run.smithi150:> uname -m
2023-06-23T11:12:44.779 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64
2023-06-23T11:12:44.780 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2023-06-23T11:12:44.837 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2023-06-23T11:12:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8"
2023-06-23T11:12:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2023-06-23T11:12:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2023-06-23T11:12:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8"
2023-06-23T11:12:44.838 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8"
2023-06-23T11:12:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 8"
2023-06-23T11:12:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2023-06-23T11:12:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-06-23T11:12:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2023-06-23T11:12:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T11:12:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T11:12:44.839 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-23T11:12:44.840 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2023-06-23T11:12:44.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:12:44.864 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:12:44.965 INFO:teuthology.dispatcher.supervisor:Running job 7313032
2023-06-23T11:12:44.965 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-22_20:29:56-rados-wip-yuri3-testing-2023-06-22-0812-reef-distro-default-smithi/7313032 --name yuriw-2023-06-22_20:29:56-rados-wip-yuri3-testing-2023-06-22-0812-reef-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-06-22_20:29:56-rados-wip-yuri3-testing-2023-06-22-0812-reef-distro-default-smithi/7313032/orig.config.yaml
2023-06-23T11:12:44.968 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-22_20:29:56-rados-wip-yuri3-testing-2023-06-22-0812-reef-distro-default-smithi/7313032
2023-06-23T11:12:44.969 INFO:teuthology.dispatcher.supervisor:Job PID: 11574
2023-06-23T11:12:44.969 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-06-23T11:14:45.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:14:45.070 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:16:45.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:16:45.263 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:18:45.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:18:45.441 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:20:45.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:20:45.626 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:22:45.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:22:45.800 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:24:45.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:24:45.969 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:26:46.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:26:46.138 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:28:46.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:28:46.318 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:30:46.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:30:46.502 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:32:46.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:32:46.694 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:34:46.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:34:46.866 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:36:47.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:36:47.046 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:38:47.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:38:47.218 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:40:47.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:40:47.402 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:42:47.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:42:47.577 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:44:47.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:44:47.754 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:46:47.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:46:47.931 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:48:48.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:48:48.097 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:50:48.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:50:48.274 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:52:48.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:52:48.450 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:54:48.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:54:48.618 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:56:48.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:56:48.798 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T11:58:48.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T11:58:48.970 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T12:00:49.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T12:00:49.150 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T12:02:49.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T12:02:49.330 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T12:04:49.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T12:04:49.501 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T12:06:49.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T12:06:49.682 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T12:08:49.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T12:08:49.855 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T12:10:50.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T12:10:50.049 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T12:10:50.140 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-06-23T12:10:50.378 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-06-23T12:10:50.379 INFO:teuthology.nuke:Checking targets against current locks
2023-06-23T12:10:50.440 DEBUG:teuthology.nuke:shortname: smithi067
2023-06-23T12:10:50.440 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-23T12:10:50.462 DEBUG:teuthology.nuke:shortname: smithi150
2023-06-23T12:10:50.463 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-23T12:10:50.472 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_20:29:56-rados-wip-yuri3-testing-2023-06-22-0812-reef-distro-default-smithi/7313032', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 11:07:32.071793', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGIO0jHIDg3GWENU09ennh5fEdNTSC99uBGIaW9nzQ1MboWKrKy1NnRL5MqdWlwBS1IQd3tmH4Bwa0jZk8t/EUnny9p0Cza3+uXJiMYSjUIW8ugRcBaAicA/RXiH1X8yzFW04/m8L6VshvdjBTZKsG0g8nY79QnP3tODsKgOjr68f+zbokUdvG2OR7UDHjZwsuC7dloCnBQOYKd/9nI/jcVPojusrFs2fUHtWu/7SYvw8WtZHZhPpBLK4zcfBODoOSQznSdo2OGpW8hP9aRSdyiDXzF2pN3NxIEs8gxNY9V8RE/wxYp0T4oxVE/5v+ISTn61Pp2lDgIXJJvcVwiCe+LNwR90gP17KxSy9Mmqab19GmEbNP127nlK+3x/NaQAgw5icWMMZgp7ZopEthbRG2MOL7CBN2UBdoCXK/U1/IDvGjep7hq9MeoChvqCQpiQvZuM2o2yhGCiXQwDg80wrmloWlge6BOYXKGTBZTxalS8vMHePQhWgoXAppd+GjzOU='}
2023-06-23T12:10:50.505 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_20:29:56-rados-wip-yuri3-testing-2023-06-22-0812-reef-distro-default-smithi/7313032', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 11:07:32.073554', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPLn9V0hubU1PpoFvtEj2H3J8ipNMqW/bQkWVcgfioHC/47I2xQQb1f48ZwVMLntsqERCImrxZ0HQE4+t89KslEKqMVDeHm0QV+tDIFdVGWPk5R2xwZ/5Be/BO70id5sUKBWKE3sgiEp9GT1FqNPlHbqqDuKf9Vr16448tn5zWUKMPrbLw8C6c0mgjCNdMFlIXGg0mdIyncSPjwHe+Z+gf7BRBHVxTZ6OtXUB2es5wMrV2TAaJV9kXwaD477AmvbJ8Og325GRUf9N8NV/AADR+Qoty/gFw0ZSdQNYQIZa390wsK4+WS2bxqo8NtoXkPKxMBazdj527q8SRqPCBiL+lI3kEQ8rLfdKF6/x2m7FIFV9HWHx4//0pBCqS7cYQLc/F5Vyhxhhc6K4wZFneZaXkVsQb3k1SsJmpwrMTFayiGjqq1ivHctX4dJxbrhd8lHkau62NL3wOiJ9tMKHeB6IU6HmUyOZswlZbQYvR3nfygZeH3X8DjcVwYpCaF6ZSGEU='}
2023-06-23T12:10:50.585 INFO:teuthology.orchestra.console:Power off smithi067
2023-06-23T12:10:50.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T12:10:50.614 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T12:10:50.639 INFO:teuthology.orchestra.console:Power off smithi150
2023-06-23T12:10:50.640 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T12:10:50.672 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T12:10:50.763 INFO:teuthology.orchestra.console:Power off for smithi067 completed
2023-06-23T12:10:50.804 INFO:teuthology.orchestra.console:Power off for smithi150 completed
2023-06-23T12:10:50.929 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com
2023-06-23T12:10:50.973 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com