2023-10-21T08:23:30.414 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-21T08:23:30.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:23:30.553 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f63c5daa670>, signals=[15]) 2023-10-21T08:23:30.554 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2023-10-21T08:23:30.555 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T08:23:30.555 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-10-21T08:23:32.189 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2023-10-21T08:23:32.190 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T08:23:32.190 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-10-21T08:23:32.192 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"} 2023-10-21T08:23:32.214 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"} 2023-10-21T08:23:32.271 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-21T08:23:32.295 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-21T08:23:32.325 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_centos_9.stream (ID 10) 2023-10-21T08:23:32.325 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 10} 2023-10-21T08:23:32.340 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_centos_9.stream (ID 10) 2023-10-21T08:23:32.340 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 10} 2023-10-21T08:23:32.373 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 9.stream 2023-10-21T08:23:32.373 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-21T08:23:32.386 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 9.stream 2023-10-21T08:23:32.386 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-21T08:23:32.471 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T08:23:32.479 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T08:23:32.523 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1} 2023-10-21T08:23:32.528 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1} 2023-10-21T08:23:32.578 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-21T08:23:32.582 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-21T08:23:32.720 INFO:teuthology.orchestra.console.smithi031:Power off 2023-10-21T08:23:32.721 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T08:23:32.733 INFO:teuthology.orchestra.console.smithi125:Power off 2023-10-21T08:23:32.733 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T08:23:32.742 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-10-21T08:23:32.743 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:23:32.755 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-10-21T08:23:32.756 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:23:32.776 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-21T08:23:32.777 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-10-21T08:23:36.778 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:23:36.786 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:23:36.888 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-21T08:23:36.894 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-10-21T08:23:40.894 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:23:40.901 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:23:41.004 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-21T08:23:41.009 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-10-21T08:23:45.006 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:23:45.013 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:23:45.115 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-21T08:23:45.121 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-10-21T08:23:45.217 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-10-21T08:23:45.222 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-10-21T08:23:45.318 INFO:teuthology.orchestra.console.smithi125:Power on 2023-10-21T08:23:45.318 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T08:23:45.325 INFO:teuthology.orchestra.console.smithi031:Power on 2023-10-21T08:23:45.326 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T08:23:45.338 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On 2023-10-21T08:23:45.339 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:23:45.346 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On 2023-10-21T08:23:45.346 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:23:45.360 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-21T08:23:45.368 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-10-21T08:23:49.362 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:23:49.369 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:23:49.472 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-21T08:23:49.479 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-10-21T08:23:49.573 INFO:teuthology.orchestra.console.smithi125:Power on completed 2023-10-21T08:23:49.581 INFO:teuthology.orchestra.console.smithi031:Power on completed 2023-10-21T08:23:49.675 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2023-10-21T08:23:49.675 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-21T08:23:49.682 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2023-10-21T08:23:49.682 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-21T08:24:04.804 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-21T08:24:04.805 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-21T08:24:19.926 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-21T08:24:19.927 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-21T08:24:35.064 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-21T08:24:35.066 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-21T08:24:50.202 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-21T08:24:50.204 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-21T08:25:05.318 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-21T08:25:05.320 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-21T08:25:20.427 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-21T08:25:20.428 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-21T08:25:35.542 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-21T08:25:35.544 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-21T08:25:50.654 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-21T08:25:50.657 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-21T08:26:05.762 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-10-21T08:26:05.764 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-21T08:26:05.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:26:06.161 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-21T08:26:20.861 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-21T08:26:20.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:26:39.354 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-21T08:26:45.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:26:48.410 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-21T08:26:54.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:26:57.470 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-21T08:27:03.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:27:06.526 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-21T08:27:10.166 WARNING:teuthology.provision.fog.smithi031:timed out 2023-10-21T08:27:12.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:27:15.579 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-21T08:27:16.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:27:21.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:27:34.650 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-10-21T08:27:40.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:27:40.911 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T08:27:40.912 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T08:27:57.108 INFO:teuthology.provision.fog.smithi031:Node is ready 2023-10-21T08:27:57.109 DEBUG:teuthology.orchestra.run.smithi031:> hostname 2023-10-21T08:27:57.128 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com 2023-10-21T08:27:57.129 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts 2023-10-21T08:27:57.187 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031 2023-10-21T08:27:57.187 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-10-21T08:27:57.306 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts 2023-10-21T08:27:57.342 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts 2023-10-21T08:27:57.415 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname 2023-10-21T08:27:57.489 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-10-21T08:27:57.561 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-10-21T08:27:57.617 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2023-10-21T08:27:57.617 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9" 2023-10-21T08:27:57.618 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2023-10-21T08:27:57.618 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2023-10-21T08:27:57.618 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9" 2023-10-21T08:27:57.618 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9" 2023-10-21T08:27:57.618 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T08:27:57.619 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-10-21T08:27:57.619 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon" 2023-10-21T08:27:57.619 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T08:27:57.619 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2023-10-21T08:27:57.619 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T08:27:57.620 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T08:27:57.620 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T08:27:57.621 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2023-10-21T08:27:57.622 DEBUG:teuthology.parallel:result is None 2023-10-21T08:28:21.584 WARNING:teuthology.provision.fog.smithi125:timed out 2023-10-21T08:28:27.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:28:27.840 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T08:28:27.840 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T08:28:28.169 INFO:teuthology.provision.fog.smithi125:Node is ready 2023-10-21T08:28:28.169 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2023-10-21T08:28:28.184 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2023-10-21T08:28:28.184 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts 2023-10-21T08:28:28.239 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2023-10-21T08:28:28.240 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-10-21T08:28:28.348 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts 2023-10-21T08:28:28.376 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts 2023-10-21T08:28:28.444 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname 2023-10-21T08:28:28.511 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-10-21T08:28:28.578 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-10-21T08:28:28.632 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2023-10-21T08:28:28.633 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="9" 2023-10-21T08:28:28.633 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2023-10-21T08:28:28.633 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2023-10-21T08:28:28.633 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="9" 2023-10-21T08:28:28.633 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el9" 2023-10-21T08:28:28.634 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T08:28:28.634 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-10-21T08:28:28.634 INFO:teuthology.orchestra.run.smithi125.stdout:LOGO="fedora-logo-icon" 2023-10-21T08:28:28.634 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T08:28:28.635 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2023-10-21T08:28:28.635 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T08:28:28.635 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T08:28:28.635 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T08:28:28.636 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2023-10-21T08:28:28.636 DEBUG:teuthology.parallel:result is None 2023-10-21T08:28:28.845 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2023-10-21T08:28:28.847 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T08:28:28.909 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2023-10-21T08:28:28.909 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T08:28:28.940 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2023-10-21T08:28:28.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-21T08:28:28.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:28:29.041 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-10-21T08:28:29.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-10-21T08:28:29.226 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-10-21T08:28:29.280 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-10-21T08:28:29.281 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-10-21T08:28:29.336 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2023-10-21T08:28:29.336 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9" 2023-10-21T08:28:29.337 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2023-10-21T08:28:29.337 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2023-10-21T08:28:29.337 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9" 2023-10-21T08:28:29.338 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9" 2023-10-21T08:28:29.338 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T08:28:29.338 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-10-21T08:28:29.338 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon" 2023-10-21T08:28:29.339 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T08:28:29.339 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2023-10-21T08:28:29.339 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T08:28:29.339 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T08:28:29.339 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T08:28:29.340 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-10-21T08:28:29.363 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2023-10-21T08:28:29.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-21T08:28:29.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T08:28:29.447 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-10-21T08:28:29.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-21T08:28:29.514 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-10-21T08:28:29.569 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-10-21T08:28:29.570 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-10-21T08:28:29.625 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2023-10-21T08:28:29.626 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="9" 2023-10-21T08:28:29.626 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2023-10-21T08:28:29.626 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2023-10-21T08:28:29.626 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="9" 2023-10-21T08:28:29.627 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el9" 2023-10-21T08:28:29.627 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-21T08:28:29.627 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-10-21T08:28:29.627 INFO:teuthology.orchestra.run.smithi125.stdout:LOGO="fedora-logo-icon" 2023-10-21T08:28:29.627 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-21T08:28:29.628 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2023-10-21T08:28:29.628 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T08:28:29.628 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-21T08:28:29.628 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T08:28:29.629 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-10-21T08:28:29.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:28:29.742 INFO:teuthology.dispatcher.supervisor:Running job 7434521 2023-10-21T08:28:29.742 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_vallariag@teuthology --archive /home/teuthworker/archive/vallariag-2023-10-21_08:03:06-rbd:nvmeof-main-distro-default-smithi/7434521 --name vallariag-2023-10-21_08:03:06-rbd:nvmeof-main-distro-default-smithi --description rbd:nvmeof/{base/install centos_latest cluster/{fixed-3 openstack} workloads/cephadm_nvmeof} -- /home/teuthworker/archive/vallariag-2023-10-21_08:03:06-rbd:nvmeof-main-distro-default-smithi/7434521/orig.config.yaml 2023-10-21T08:28:29.745 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vallariag-2023-10-21_08:03:06-rbd:nvmeof-main-distro-default-smithi/7434521 2023-10-21T08:28:29.746 INFO:teuthology.dispatcher.supervisor:Job PID: 1276505 2023-10-21T08:28:29.747 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-21T08:30:29.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:32:29.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:34:29.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:36:29.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:38:30.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:40:30.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:42:30.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:44:30.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:46:30.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:48:30.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:50:30.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:52:30.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:54:30.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:56:30.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:58:30.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T08:58:30.857 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-21T08:58:30.964 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-21T08:58:30.965 INFO:teuthology.nuke:Checking targets against current locks 2023-10-21T08:58:31.014 DEBUG:teuthology.nuke:shortname: smithi031 2023-10-21T08:58:31.014 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T08:58:31.040 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2023-10-21_08:03:06-rbd:nvmeof-main-distro-default-smithi/7434521', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 08:23:29.602640', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGdIY8c69iF9i/bq9HC8f+3MJ9uFt/MZyt4crhXW6SloRSJflHedU3O3BLsanRVCmexrRTUcIIjYsck2sVe4Mcc='} 2023-10-21T08:58:31.044 DEBUG:teuthology.nuke:shortname: smithi125 2023-10-21T08:58:31.044 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T08:58:31.070 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2023-10-21_08:03:06-rbd:nvmeof-main-distro-default-smithi/7434521', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 08:23:29.604192', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQVd1x6L2Pdtc8pJPOYPteTGISe/t7h3BpLriuw59iLBuLOhcUYuGuFGykAho7lBNm4dGitmDjGvSOCucdq7u4='} 2023-10-21T08:58:31.089 INFO:teuthology.orchestra.console.smithi031:Power off 2023-10-21T08:58:31.090 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T08:58:31.113 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-10-21T08:58:31.113 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:58:31.128 INFO:teuthology.orchestra.console.smithi125:Power off 2023-10-21T08:58:31.128 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T08:58:31.137 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-10-21T08:58:31.149 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-10-21T08:58:31.150 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T08:58:31.171 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-21T08:58:31.238 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-10-21T08:58:31.272 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-10-21T08:58:31.400 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com 2023-10-21T08:58:31.415 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com