2023-08-26T12:15:13.634 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-26T12:15:13.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T12:15:13.771 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f399dbc01f0>, signals=[15]) 2023-08-26T12:15:13.772 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging 2023-08-26T12:15:13.773 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server 2023-08-26T12:15:13.773 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-08-26T12:15:13.796 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-08-26T12:15:13.796 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-08-26T12:15:13.796 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-08-26T12:15:13.798 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /host {"name": "smithi077"} 2023-08-26T12:15:13.820 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"} 2023-08-26T12:15:13.868 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-26T12:15:13.884 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-26T12:15:13.912 DEBUG:teuthology.provision.fog.smithi077:Requesting image smithi_centos_9.stream (ID 10) 2023-08-26T12:15:13.912 DEBUG:teuthology.provision.fog.smithi077:FOG request: PUT /host/182 {"imageID": 10} 2023-08-26T12:15:13.925 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_9.stream (ID 10) 2023-08-26T12:15:13.925 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 10} 2023-08-26T12:15:13.961 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of centos 9.stream 2023-08-26T12:15:13.962 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-26T12:15:13.965 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 9.stream 2023-08-26T12:15:13.965 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-26T12:15:14.026 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /tasktype {"name": "deploy"} 2023-08-26T12:15:14.029 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"} 2023-08-26T12:15:14.066 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1} 2023-08-26T12:15:14.071 DEBUG:teuthology.provision.fog.smithi077:FOG request: POST /host/182/task {"taskTypeID": 1} 2023-08-26T12:15:14.122 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-26T12:15:14.125 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-26T12:15:14.224 INFO:teuthology.orchestra.console.smithi077:Power off 2023-08-26T12:15:14.225 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T12:15:14.237 INFO:teuthology.orchestra.console.smithi169:Power off 2023-08-26T12:15:14.237 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T12:15:14.246 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2023-08-26T12:15:14.247 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T12:15:14.256 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-08-26T12:15:14.256 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T12:15:14.265 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-08-26T12:15:14.278 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-08-26T12:15:14.367 INFO:teuthology.orchestra.console.smithi077:Power off completed 2023-08-26T12:15:14.379 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-08-26T12:15:14.468 INFO:teuthology.orchestra.console.smithi077:Power on 2023-08-26T12:15:14.469 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-26T12:15:14.481 INFO:teuthology.orchestra.console.smithi169:Power on 2023-08-26T12:15:14.481 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-26T12:15:14.490 DEBUG:teuthology.orchestra.console.smithi077:power on output: Chassis Power Control: Up/On 2023-08-26T12:15:14.491 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T12:15:14.501 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2023-08-26T12:15:14.502 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T12:15:14.511 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-08-26T12:15:14.521 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-08-26T12:15:18.512 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T12:15:18.522 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T12:15:18.620 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-08-26T12:15:18.629 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-08-26T12:15:22.622 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T12:15:22.630 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T12:15:22.730 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2023-08-26T12:15:22.737 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2023-08-26T12:15:22.832 INFO:teuthology.orchestra.console.smithi077:Power on completed 2023-08-26T12:15:22.838 INFO:teuthology.orchestra.console.smithi169:Power on completed 2023-08-26T12:15:22.933 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish 2023-08-26T12:15:22.933 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-26T12:15:22.939 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-08-26T12:15:22.940 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-26T12:15:38.032 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-26T12:15:38.033 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-26T12:15:53.119 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-26T12:15:53.121 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-26T12:16:08.212 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-26T12:16:08.213 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-26T12:16:23.303 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-26T12:16:23.304 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-26T12:16:38.392 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-26T12:16:38.393 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-26T12:16:53.483 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-26T12:16:53.485 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-26T12:17:08.568 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-26T12:17:08.569 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-26T12:17:23.652 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-26T12:17:23.654 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-26T12:17:38.738 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-26T12:17:38.739 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-26T12:17:53.813 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-08-26T12:17:53.815 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-26T12:17:53.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T12:17:53.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T12:17:56.980 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-08-26T12:18:02.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T12:18:06.032 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-08-26T12:18:12.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T12:18:15.088 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-08-26T12:18:21.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T12:18:24.144 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-08-26T12:18:30.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T12:18:33.200 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-08-26T12:18:39.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T12:18:42.256 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-08-26T12:18:48.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T12:18:51.312 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-08-26T12:18:53.932 ERROR:teuthology.orchestra.connection:Error authenticating with smithi169.front.sepia.ceph.com: No SSH private key found! 2023-08-26T12:18:53.933 WARNING:teuthology.provision.fog.smithi169:No existing session 2023-08-26T12:18:57.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T12:18:59.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T12:19:57.317 WARNING:teuthology.provision.fog.smithi077:timed out 2023-08-26T12:19:59.937 WARNING:teuthology.provision.fog.smithi169:timed out 2023-08-26T12:20:03.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T12:20:03.511 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-26T12:20:03.512 DEBUG:teuthology.orchestra.run.smithi077:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-26T12:20:03.871 INFO:teuthology.provision.fog.smithi077:Node is ready 2023-08-26T12:20:03.872 DEBUG:teuthology.orchestra.run.smithi077:> hostname 2023-08-26T12:20:03.886 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com 2023-08-26T12:20:03.887 DEBUG:teuthology.orchestra.run.smithi077:> grep smithi077.front.sepia.ceph.com /etc/hosts 2023-08-26T12:20:03.942 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077 2023-08-26T12:20:03.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2023-08-26T12:20:04.045 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hosts 2023-08-26T12:20:04.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/172.21.15.77/172.21.15.77/g' /etc/hosts 2023-08-26T12:20:04.140 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hostname 2023-08-26T12:20:04.207 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2023-08-26T12:20:04.272 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-08-26T12:20:04.326 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2023-08-26T12:20:04.327 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2023-08-26T12:20:04.327 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2023-08-26T12:20:04.327 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2023-08-26T12:20:04.327 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2023-08-26T12:20:04.327 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2023-08-26T12:20:04.328 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-26T12:20:04.328 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2023-08-26T12:20:04.328 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2023-08-26T12:20:04.328 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-26T12:20:04.328 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2023-08-26T12:20:04.329 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T12:20:04.329 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-26T12:20:04.329 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T12:20:04.329 INFO:teuthology.provision.fog.smithi077:Deploy complete! 2023-08-26T12:20:04.330 DEBUG:teuthology.parallel:result is None 2023-08-26T12:20:05.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T12:20:06.159 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-26T12:20:06.159 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-26T12:20:06.450 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-08-26T12:20:06.451 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-08-26T12:20:06.465 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2023-08-26T12:20:06.465 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2023-08-26T12:20:06.520 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-08-26T12:20:06.521 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-08-26T12:20:06.643 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2023-08-26T12:20:06.672 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-08-26T12:20:06.740 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2023-08-26T12:20:06.808 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-08-26T12:20:06.874 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-08-26T12:20:06.928 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-08-26T12:20:06.929 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2023-08-26T12:20:06.929 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-08-26T12:20:06.929 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-08-26T12:20:06.929 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2023-08-26T12:20:06.929 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2023-08-26T12:20:06.930 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-26T12:20:06.930 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-08-26T12:20:06.930 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2023-08-26T12:20:06.930 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-26T12:20:06.930 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-08-26T12:20:06.931 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T12:20:06.931 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-26T12:20:06.931 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T12:20:06.931 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2023-08-26T12:20:06.932 DEBUG:teuthology.parallel:result is None 2023-08-26T12:20:07.076 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com 2023-08-26T12:20:07.077 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-26T12:20:07.111 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2023-08-26T12:20:07.111 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-26T12:20:07.128 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server 2023-08-26T12:20:07.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-08-26T12:20:07.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T12:20:07.211 DEBUG:teuthology.orchestra.run.smithi077:> true 2023-08-26T12:20:07.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-08-26T12:20:07.279 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2023-08-26T12:20:07.334 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2023-08-26T12:20:07.334 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-08-26T12:20:07.389 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2023-08-26T12:20:07.389 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2023-08-26T12:20:07.389 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2023-08-26T12:20:07.389 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2023-08-26T12:20:07.389 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2023-08-26T12:20:07.390 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2023-08-26T12:20:07.390 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-26T12:20:07.390 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2023-08-26T12:20:07.390 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2023-08-26T12:20:07.390 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-26T12:20:07.391 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2023-08-26T12:20:07.391 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T12:20:07.391 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-26T12:20:07.391 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T12:20:07.392 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-08-26T12:20:07.411 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2023-08-26T12:20:07.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-08-26T12:20:07.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-26T12:20:07.492 DEBUG:teuthology.orchestra.run.smithi169:> true 2023-08-26T12:20:07.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2023-08-26T12:20:07.561 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2023-08-26T12:20:07.615 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2023-08-26T12:20:07.616 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-08-26T12:20:07.669 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2023-08-26T12:20:07.669 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2023-08-26T12:20:07.669 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2023-08-26T12:20:07.670 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2023-08-26T12:20:07.670 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2023-08-26T12:20:07.670 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2023-08-26T12:20:07.670 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-26T12:20:07.671 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2023-08-26T12:20:07.671 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2023-08-26T12:20:07.671 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-26T12:20:07.671 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2023-08-26T12:20:07.672 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-26T12:20:07.672 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-26T12:20:07.672 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-26T12:20:07.672 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-08-26T12:20:07.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T12:20:07.775 INFO:teuthology.dispatcher.supervisor:Running job 7380330 2023-08-26T12:20:07.775 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-25_17:36:25-rados-main-distro-default-smithi/7380330 --name yuriw-2023-08-25_17:36:25-rados-main-distro-default-smithi --description rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} -- /home/teuthworker/archive/yuriw-2023-08-25_17:36:25-rados-main-distro-default-smithi/7380330/orig.config.yaml 2023-08-26T12:20:07.778 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-25_17:36:25-rados-main-distro-default-smithi/7380330 2023-08-26T12:20:07.779 INFO:teuthology.dispatcher.supervisor:Job PID: 2916474 2023-08-26T12:20:07.779 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-26T12:22:07.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-26T12:22:07.837 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-26T12:22:07.925 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-26T12:22:07.925 INFO:teuthology.nuke:Checking targets against current locks 2023-08-26T12:22:07.973 DEBUG:teuthology.nuke:shortname: smithi077 2023-08-26T12:22:07.973 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-26T12:22:07.992 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-25_17:36:25-rados-main-distro-default-smithi/7380330', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-26 12:15:12.867642', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJi04/p7jLa4lWNtuuzhI+bPYzxl8o0rQm5cGilZISamYbiB9Pw+ZbfEMK4o5huv1jDSxJtegxE6DHY3scGPPVo='} 2023-08-26T12:22:07.995 DEBUG:teuthology.nuke:shortname: smithi169 2023-08-26T12:22:07.995 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-26T12:22:08.015 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-25_17:36:25-rados-main-distro-default-smithi/7380330', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-26 12:15:12.866300', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK6HPi+ioAQjL/BWHjMSox9e6PgFQRFk5xLp28Zf9EVW8fvI+UWHzbT5wB/rjls+s8sgJcwd28MeKq9JvZ08I1Y='} 2023-08-26T12:22:08.048 INFO:teuthology.orchestra.console.smithi077:Power off 2023-08-26T12:22:08.048 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T12:22:08.069 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2023-08-26T12:22:08.070 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T12:22:08.083 INFO:teuthology.orchestra.console.smithi169:Power off 2023-08-26T12:22:08.084 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-26T12:22:08.093 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-08-26T12:22:08.104 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2023-08-26T12:22:08.105 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-26T12:22:08.126 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2023-08-26T12:22:08.195 INFO:teuthology.orchestra.console.smithi077:Power off completed 2023-08-26T12:22:08.227 INFO:teuthology.orchestra.console.smithi169:Power off completed 2023-08-26T12:22:08.379 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com 2023-08-26T12:22:08.381 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com