2023-10-16T11:27:57.785 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T11:27:57.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T11:27:57.918 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fac32306f70>, signals=[15]) 2023-10-16T11:27:57.919 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2023-10-16T11:27:57.919 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T11:27:57.919 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-10-16T11:27:57.942 INFO:teuthology.lock.ops:Start node 'smithi061.front.sepia.ceph.com' reimaging 2023-10-16T11:27:57.943 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T11:27:57.943 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-10-16T11:27:57.944 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /host {"name": "smithi008"} 2023-10-16T11:27:57.967 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /host {"name": "smithi061"} 2023-10-16T11:27:58.018 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-16T11:27:58.038 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-16T11:27:58.060 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_centos_8.stream (ID 3) 2023-10-16T11:27:58.060 DEBUG:teuthology.provision.fog.smithi008:FOG request: PUT /host/114 {"imageID": 3} 2023-10-16T11:27:58.085 DEBUG:teuthology.provision.fog.smithi061:Requesting image smithi_centos_8.stream (ID 3) 2023-10-16T11:27:58.086 DEBUG:teuthology.provision.fog.smithi061:FOG request: PUT /host/166 {"imageID": 3} 2023-10-16T11:27:58.107 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 8.stream 2023-10-16T11:27:58.107 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-16T11:27:58.131 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of centos 8.stream 2023-10-16T11:27:58.132 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-16T11:27:58.155 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T11:27:58.174 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T11:27:58.194 DEBUG:teuthology.provision.fog.smithi008:FOG request: POST /host/114/task {"taskTypeID": 1} 2023-10-16T11:27:58.209 DEBUG:teuthology.provision.fog.smithi061:FOG request: POST /host/166/task {"taskTypeID": 1} 2023-10-16T11:27:58.244 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-16T11:27:58.254 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-16T11:27:58.335 INFO:teuthology.orchestra.console.smithi008:Power off 2023-10-16T11:27:58.336 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T11:27:58.348 INFO:teuthology.orchestra.console.smithi061:Power off 2023-10-16T11:27:58.349 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T11:27:58.356 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-10-16T11:27:58.357 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T11:27:58.368 DEBUG:teuthology.orchestra.console.smithi061:power off output: Chassis Power Control: Down/Off 2023-10-16T11:27:58.368 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T11:27:58.376 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-10-16T11:27:58.386 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-10-16T11:27:58.477 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-10-16T11:27:58.487 INFO:teuthology.orchestra.console.smithi061:Power off completed 2023-10-16T11:27:58.579 INFO:teuthology.orchestra.console.smithi008:Power on 2023-10-16T11:27:58.579 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T11:27:58.589 INFO:teuthology.orchestra.console.smithi061:Power on 2023-10-16T11:27:58.589 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T11:27:58.598 DEBUG:teuthology.orchestra.console.smithi008:power on output: Chassis Power Control: Up/On 2023-10-16T11:27:58.599 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T11:27:58.609 DEBUG:teuthology.orchestra.console.smithi061:power on output: Chassis Power Control: Up/On 2023-10-16T11:27:58.609 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T11:27:58.618 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-10-16T11:27:58.627 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-10-16T11:28:02.623 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T11:28:02.630 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T11:28:02.732 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-10-16T11:28:02.738 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-10-16T11:28:02.834 INFO:teuthology.orchestra.console.smithi008:Power on completed 2023-10-16T11:28:02.839 INFO:teuthology.orchestra.console.smithi061:Power on completed 2023-10-16T11:28:02.935 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2023-10-16T11:28:02.936 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-16T11:28:02.939 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish 2023-10-16T11:28:02.940 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-16T11:28:17.997 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-16T11:28:18.001 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-16T11:28:33.065 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-16T11:28:33.066 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-16T11:28:48.138 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-16T11:28:48.140 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-16T11:29:03.211 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-16T11:29:03.212 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-16T11:29:18.294 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-16T11:29:18.296 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-16T11:29:33.378 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-16T11:29:33.379 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-16T11:29:48.454 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-16T11:29:48.456 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-16T11:30:03.530 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-16T11:30:03.532 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-16T11:30:18.607 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-16T11:30:18.608 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-16T11:30:33.686 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-10-16T11:30:33.688 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-16T11:30:33.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:30:48.774 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-10-16T11:30:48.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:30:52.154 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-10-16T11:30:58.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:31:01.210 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-10-16T11:31:07.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:31:07.258 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-10-16T11:31:10.302 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-10-16T11:31:13.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:31:16.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:31:16.318 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-10-16T11:31:19.386 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-10-16T11:31:22.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:31:25.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:31:25.402 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-10-16T11:31:28.442 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-10-16T11:31:31.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:31:34.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:31:34.458 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-10-16T11:31:40.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:31:43.518 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-10-16T11:31:49.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:31:52.602 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-10-16T11:31:52.826 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-10-16T11:31:58.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:31:58.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:32:01.882 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-10-16T11:32:07.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:32:10.938 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-10-16T11:32:16.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:32:17.631 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T11:32:17.631 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T11:32:28.375 INFO:teuthology.provision.fog.smithi008:Node is ready 2023-10-16T11:32:28.375 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2023-10-16T11:32:28.440 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2023-10-16T11:32:28.441 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2023-10-16T11:32:28.502 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2023-10-16T11:32:28.502 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-10-16T11:32:28.627 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2023-10-16T11:32:28.662 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2023-10-16T11:32:28.734 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2023-10-16T11:32:28.807 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-10-16T11:32:28.878 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-10-16T11:32:28.937 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-10-16T11:32:28.937 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8" 2023-10-16T11:32:28.937 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-10-16T11:32:28.938 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-10-16T11:32:28.938 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8" 2023-10-16T11:32:28.938 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-10-16T11:32:28.939 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-16T11:32:28.939 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-10-16T11:32:28.939 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-16T11:32:28.939 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-10-16T11:32:28.939 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T11:32:28.940 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T11:32:28.940 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T11:32:28.941 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2023-10-16T11:32:28.942 DEBUG:teuthology.parallel:result is None 2023-10-16T11:32:58.639 WARNING:teuthology.provision.fog.smithi061:timed out 2023-10-16T11:33:04.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:33:04.881 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T11:33:04.882 DEBUG:teuthology.orchestra.run.smithi061:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T11:33:05.151 INFO:teuthology.provision.fog.smithi061:Node is ready 2023-10-16T11:33:05.151 DEBUG:teuthology.orchestra.run.smithi061:> hostname 2023-10-16T11:33:05.175 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com 2023-10-16T11:33:05.176 DEBUG:teuthology.orchestra.run.smithi061:> grep smithi061.front.sepia.ceph.com /etc/hosts 2023-10-16T11:33:05.235 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061 2023-10-16T11:33:05.235 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-10-16T11:33:05.347 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hosts 2023-10-16T11:33:05.378 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/172.21.15.61/172.21.15.61/g' /etc/hosts 2023-10-16T11:33:05.447 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hostname 2023-10-16T11:33:05.516 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-10-16T11:33:05.586 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-10-16T11:33:05.644 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="CentOS Stream" 2023-10-16T11:33:05.644 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8" 2023-10-16T11:33:05.645 INFO:teuthology.orchestra.run.smithi061.stdout:ID="centos" 2023-10-16T11:33:05.645 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="rhel fedora" 2023-10-16T11:33:05.645 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8" 2023-10-16T11:33:05.645 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2023-10-16T11:33:05.645 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-16T11:33:05.645 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2023-10-16T11:33:05.646 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-16T11:33:05.646 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://centos.org/" 2023-10-16T11:33:05.646 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T11:33:05.646 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T11:33:05.646 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T11:33:05.647 INFO:teuthology.provision.fog.smithi061:Deploy complete! 2023-10-16T11:33:05.647 DEBUG:teuthology.parallel:result is None 2023-10-16T11:33:05.798 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2023-10-16T11:33:05.799 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T11:33:05.830 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com 2023-10-16T11:33:05.831 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T11:33:05.856 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2023-10-16T11:33:05.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-16T11:33:05.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:33:05.925 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-10-16T11:33:06.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-10-16T11:33:06.067 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-10-16T11:33:06.126 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-10-16T11:33:06.127 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-10-16T11:33:06.186 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2023-10-16T11:33:06.186 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8" 2023-10-16T11:33:06.187 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2023-10-16T11:33:06.187 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2023-10-16T11:33:06.187 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8" 2023-10-16T11:33:06.187 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-10-16T11:33:06.187 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-16T11:33:06.188 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-10-16T11:33:06.188 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-16T11:33:06.188 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2023-10-16T11:33:06.188 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T11:33:06.188 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T11:33:06.188 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T11:33:06.189 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-10-16T11:33:06.213 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server 2023-10-16T11:33:06.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-10-16T11:33:06.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T11:33:06.281 DEBUG:teuthology.orchestra.run.smithi061:> true 2023-10-16T11:33:06.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-10-16T11:33:06.350 DEBUG:teuthology.orchestra.run.smithi061:> uname -m 2023-10-16T11:33:06.409 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2023-10-16T11:33:06.410 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-10-16T11:33:06.468 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="CentOS Stream" 2023-10-16T11:33:06.468 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8" 2023-10-16T11:33:06.468 INFO:teuthology.orchestra.run.smithi061.stdout:ID="centos" 2023-10-16T11:33:06.469 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="rhel fedora" 2023-10-16T11:33:06.469 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8" 2023-10-16T11:33:06.469 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2023-10-16T11:33:06.469 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-16T11:33:06.469 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2023-10-16T11:33:06.469 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-16T11:33:06.470 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://centos.org/" 2023-10-16T11:33:06.470 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T11:33:06.470 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T11:33:06.470 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T11:33:06.471 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-10-16T11:33:06.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T11:33:06.599 INFO:teuthology.dispatcher.supervisor:Running job 7427541 2023-10-16T11:33:06.599 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427541 --name teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427541/orig.config.yaml 2023-10-16T11:33:06.603 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427541 2023-10-16T11:33:06.603 INFO:teuthology.dispatcher.supervisor:Job PID: 1647371 2023-10-16T11:33:06.604 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-16T11:35:06.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T11:37:06.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T11:39:07.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T11:41:07.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T11:43:07.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T11:45:07.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T11:47:07.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T11:49:07.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T11:51:07.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T11:53:08.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T11:55:08.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T11:57:08.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T11:59:08.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:01:08.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:03:08.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:05:09.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:07:09.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:09:09.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:11:09.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:13:09.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:15:09.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:17:10.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:19:10.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:21:10.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:23:10.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:25:10.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:27:10.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:29:11.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:31:11.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:33:11.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:35:11.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:37:11.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:39:11.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:41:12.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:43:12.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:45:12.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:47:12.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:49:12.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:51:12.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:53:12.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:55:13.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:57:13.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T12:59:13.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T13:01:13.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T13:03:13.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T13:03:13.856 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-16T13:03:14.069 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-16T13:03:14.070 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T13:03:14.118 DEBUG:teuthology.nuke:shortname: smithi008 2023-10-16T13:03:14.119 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T13:03:14.143 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427541', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 11:27:57.051461', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA/HQniZij9UUPU8kRo0g9tRxnDo22YR2G7CpJ61Cp0fMHNscopM6G2QPIDClZRRyZ0t9ObKV23wa1cLbTsdZos='} 2023-10-16T13:03:14.146 DEBUG:teuthology.nuke:shortname: smithi061 2023-10-16T13:03:14.146 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T13:03:14.169 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427541', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 11:27:57.052549', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHVMRZHh+JhdV32xWl7aW1twF9SaEULd8kp57d5zS3rvGI4Dvyr0wmsjxc45seoeM/VudFT/GTjwhuxUePtufCM='} 2023-10-16T13:03:14.191 INFO:teuthology.orchestra.console.smithi008:Power off 2023-10-16T13:03:14.192 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T13:03:14.218 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-10-16T13:03:14.219 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:03:14.239 INFO:teuthology.orchestra.console.smithi061:Power off 2023-10-16T13:03:14.240 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T13:03:14.248 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-10-16T13:03:14.261 DEBUG:teuthology.orchestra.console.smithi061:power off output: Chassis Power Control: Down/Off 2023-10-16T13:03:14.261 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T13:03:14.288 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-10-16T13:03:14.350 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-10-16T13:03:14.390 INFO:teuthology.orchestra.console.smithi061:Power off completed 2023-10-16T13:03:14.505 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com 2023-10-16T13:03:14.539 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com