2023-08-26T13:09:24.985 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-26T13:09:24.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T13:09:25.116 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6926ff81f0>, signals=[15]) 2023-08-26T13:09:25.118 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging 2023-08-26T13:09:25.118 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server 2023-08-26T13:09:25.118 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-08-26T13:09:25.142 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2023-08-26T13:09:25.142 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2023-08-26T13:09:25.142 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-08-26T13:09:25.144 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /host {"name": "smithi053"} 2023-08-26T13:09:25.167 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /host {"name": "smithi059"} 2023-08-26T13:09:25.218 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-26T13:09:25.239 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-26T13:09:25.257 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_centos_9.stream (ID 10) 2023-08-26T13:09:25.258 DEBUG:teuthology.provision.fog.smithi053:FOG request: PUT /host/158 {"imageID": 10} 2023-08-26T13:09:25.282 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_centos_9.stream (ID 10) 2023-08-26T13:09:25.282 DEBUG:teuthology.provision.fog.smithi059:FOG request: PUT /host/164 {"imageID": 10} 2023-08-26T13:09:25.313 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of centos 9.stream 2023-08-26T13:09:25.313 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-26T13:09:25.331 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 9.stream 2023-08-26T13:09:25.332 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-26T13:09:25.376 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /tasktype {"name": "deploy"} 2023-08-26T13:09:25.386 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /tasktype {"name": "deploy"} 2023-08-26T13:09:25.408 DEBUG:teuthology.provision.fog.smithi053:FOG request: POST /host/158/task {"taskTypeID": 1} 2023-08-26T13:09:25.420 DEBUG:teuthology.provision.fog.smithi059:FOG request: POST /host/164/task {"taskTypeID": 1} 2023-08-26T13:09:25.464 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-26T13:09:25.467 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-26T13:09:25.558 INFO:teuthology.orchestra.console.smithi059:Power off 2023-08-26T13:09:25.559 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T13:09:25.571 INFO:teuthology.orchestra.console.smithi053:Power off 2023-08-26T13:09:25.571 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T13:09:25.580 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-08-26T13:09:25.580 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T13:09:25.591 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-08-26T13:09:25.592 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T13:09:25.604 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-08-26T13:09:25.612 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-08-26T13:09:29.608 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T13:09:29.614 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T13:09:29.717 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-08-26T13:09:29.723 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-08-26T13:09:33.720 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T13:09:33.727 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T13:09:33.830 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-08-26T13:09:33.836 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-08-26T13:09:33.932 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-08-26T13:09:33.937 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-08-26T13:09:34.033 INFO:teuthology.orchestra.console.smithi059:Power on 2023-08-26T13:09:34.033 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-26T13:09:34.040 INFO:teuthology.orchestra.console.smithi053:Power on 2023-08-26T13:09:34.041 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-26T13:09:34.053 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2023-08-26T13:09:34.054 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T13:09:34.062 DEBUG:teuthology.orchestra.console.smithi053:power on output: Chassis Power Control: Up/On 2023-08-26T13:09:34.063 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T13:09:34.073 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-08-26T13:09:34.082 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-08-26T13:09:38.076 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T13:09:38.083 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T13:09:38.185 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-08-26T13:09:38.191 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-08-26T13:09:38.287 INFO:teuthology.orchestra.console.smithi059:Power on completed 2023-08-26T13:09:38.388 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2023-08-26T13:09:38.388 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-26T13:09:42.196 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T13:09:42.304 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-08-26T13:09:42.405 INFO:teuthology.orchestra.console.smithi053:Power on completed 2023-08-26T13:09:42.506 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish 2023-08-26T13:09:42.506 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-26T13:09:53.464 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-26T13:09:57.596 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-26T13:10:08.547 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-26T13:10:12.680 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-26T13:10:23.621 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-26T13:10:27.752 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-26T13:10:38.692 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-26T13:10:42.820 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-26T13:10:53.764 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-26T13:10:57.888 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-26T13:11:08.844 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-26T13:11:12.964 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-26T13:11:23.917 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-26T13:11:28.032 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-26T13:11:38.993 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-26T13:11:43.104 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-26T13:11:54.072 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-26T13:11:58.172 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-08-26T13:11:58.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T13:12:09.146 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-26T13:12:09.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T13:12:16.788 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-08-26T13:12:22.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T13:12:25.872 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-08-26T13:12:27.536 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-08-26T13:12:31.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T13:12:33.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T13:12:34.928 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-08-26T13:12:36.596 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-08-26T13:12:40.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T13:12:42.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T13:12:45.648 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-08-26T13:12:51.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T13:13:40.980 WARNING:teuthology.provision.fog.smithi053:timed out 2023-08-26T13:13:46.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T13:13:47.203 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-26T13:13:47.204 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-26T13:13:47.521 INFO:teuthology.provision.fog.smithi053:Node is ready 2023-08-26T13:13:47.521 DEBUG:teuthology.orchestra.run.smithi053:> hostname 2023-08-26T13:13:47.536 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com 2023-08-26T13:13:47.537 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts 2023-08-26T13:13:47.592 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053 2023-08-26T13:13:47.592 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-08-26T13:13:47.723 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts 2023-08-26T13:13:47.755 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts 2023-08-26T13:13:47.826 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname 2023-08-26T13:13:47.897 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-08-26T13:13:47.967 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-08-26T13:13:48.022 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2023-08-26T13:13:48.023 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2023-08-26T13:13:48.023 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2023-08-26T13:13:48.023 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2023-08-26T13:13:48.023 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2023-08-26T13:13:48.024 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2023-08-26T13:13:48.024 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-26T13:13:48.024 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-08-26T13:13:48.024 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2023-08-26T13:13:48.025 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-26T13:13:48.025 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2023-08-26T13:13:48.025 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T13:13:48.025 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-26T13:13:48.025 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T13:13:48.026 INFO:teuthology.provision.fog.smithi053:Deploy complete! 2023-08-26T13:13:48.027 DEBUG:teuthology.parallel:result is None 2023-08-26T13:13:51.657 WARNING:teuthology.provision.fog.smithi059:timed out 2023-08-26T13:13:57.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T13:13:57.880 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-26T13:13:57.880 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-26T13:13:58.222 INFO:teuthology.provision.fog.smithi059:Node is ready 2023-08-26T13:13:58.223 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2023-08-26T13:13:58.238 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2023-08-26T13:13:58.239 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2023-08-26T13:13:58.295 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2023-08-26T13:13:58.296 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-08-26T13:13:58.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2023-08-26T13:13:58.454 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2023-08-26T13:13:58.526 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2023-08-26T13:13:58.597 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-08-26T13:13:58.668 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-08-26T13:13:58.724 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2023-08-26T13:13:58.725 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2023-08-26T13:13:58.725 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2023-08-26T13:13:58.725 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2023-08-26T13:13:58.725 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2023-08-26T13:13:58.725 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2023-08-26T13:13:58.726 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-26T13:13:58.726 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-08-26T13:13:58.726 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2023-08-26T13:13:58.726 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-26T13:13:58.726 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2023-08-26T13:13:58.727 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T13:13:58.727 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-26T13:13:58.727 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T13:13:58.727 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2023-08-26T13:13:58.728 DEBUG:teuthology.parallel:result is None 2023-08-26T13:13:58.911 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com 2023-08-26T13:13:58.912 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-26T13:13:58.933 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2023-08-26T13:13:58.933 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-26T13:13:58.950 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server 2023-08-26T13:13:58.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-08-26T13:13:58.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T13:13:59.051 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-08-26T13:13:59.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-08-26T13:13:59.235 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2023-08-26T13:13:59.289 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2023-08-26T13:13:59.290 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-08-26T13:13:59.344 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2023-08-26T13:13:59.344 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2023-08-26T13:13:59.345 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2023-08-26T13:13:59.345 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2023-08-26T13:13:59.345 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2023-08-26T13:13:59.345 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2023-08-26T13:13:59.345 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-26T13:13:59.346 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-08-26T13:13:59.346 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2023-08-26T13:13:59.346 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-26T13:13:59.346 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2023-08-26T13:13:59.346 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T13:13:59.346 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-26T13:13:59.347 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T13:13:59.347 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-08-26T13:13:59.375 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2023-08-26T13:13:59.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-08-26T13:13:59.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T13:13:59.474 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-08-26T13:13:59.543 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-08-26T13:13:59.543 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-08-26T13:13:59.598 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-08-26T13:13:59.598 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-08-26T13:13:59.653 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2023-08-26T13:13:59.653 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2023-08-26T13:13:59.653 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2023-08-26T13:13:59.653 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2023-08-26T13:13:59.654 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2023-08-26T13:13:59.654 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2023-08-26T13:13:59.654 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-26T13:13:59.654 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-08-26T13:13:59.654 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2023-08-26T13:13:59.655 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-26T13:13:59.655 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2023-08-26T13:13:59.655 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T13:13:59.655 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-26T13:13:59.656 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T13:13:59.656 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-08-26T13:13:59.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T13:13:59.765 INFO:teuthology.dispatcher.supervisor:Running job 7380428 2023-08-26T13:13:59.766 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-25_17:40:36-rbd-main-distro-default-smithi/7380428 --name yuriw-2023-08-25_17:40:36-rbd-main-distro-default-smithi --description rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_latest} workloads/rbd-mirror-snapshot-workunit-minimum} -- /home/teuthworker/archive/yuriw-2023-08-25_17:40:36-rbd-main-distro-default-smithi/7380428/orig.config.yaml 2023-08-26T13:13:59.769 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-25_17:40:36-rbd-main-distro-default-smithi/7380428 2023-08-26T13:13:59.769 INFO:teuthology.dispatcher.supervisor:Job PID: 3498114 2023-08-26T13:13:59.770 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-26T13:15:59.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T13:15:59.937 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-26T13:16:00.047 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-26T13:16:00.047 INFO:teuthology.nuke:Checking targets against current locks 2023-08-26T13:16:00.099 DEBUG:teuthology.nuke:shortname: smithi053 2023-08-26T13:16:00.100 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-26T13:16:00.119 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-25_17:40:36-rbd-main-distro-default-smithi/7380428', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-26 13:09:24.198207', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBTWU7hD1SFqvyyfeMZ0aKIONVDrSRrdGo0hwMZ1kxmkacmBGfSdhuAMifFQkuzRfKKmIbFFpvjVWMlrGNHrRIk='} 2023-08-26T13:16:00.123 DEBUG:teuthology.nuke:shortname: smithi059 2023-08-26T13:16:00.123 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-26T13:16:00.141 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-25_17:40:36-rbd-main-distro-default-smithi/7380428', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-26 13:09:24.200197', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGnw4AD2U/6r5hS2qZJ0vC12Gt9g7ib6zp9DSAl9UtQTkIu6JJf650WSwjBCfeQ2SMtdrJcUZobtBJMhTgccMGA='} 2023-08-26T13:16:00.163 INFO:teuthology.orchestra.console.smithi053:Power off 2023-08-26T13:16:00.164 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T13:16:00.185 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-08-26T13:16:00.186 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T13:16:00.200 INFO:teuthology.orchestra.console.smithi059:Power off 2023-08-26T13:16:00.200 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T13:16:00.210 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-08-26T13:16:00.225 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-08-26T13:16:00.225 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T13:16:00.246 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-08-26T13:16:00.311 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-08-26T13:16:00.348 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-08-26T13:16:00.462 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com 2023-08-26T13:16:00.502 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com