2023-10-27T12:24:05.749 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-27T12:24:05.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:24:05.876 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe780c40b80>, signals=[15]) 2023-10-27T12:24:05.878 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging 2023-10-27T12:24:05.879 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server 2023-10-27T12:24:05.879 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-10-27T12:24:05.901 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2023-10-27T12:24:05.902 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2023-10-27T12:24:05.902 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-10-27T12:24:05.904 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /host {"name": "smithi017"} 2023-10-27T12:24:05.926 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /host {"name": "smithi057"} 2023-10-27T12:24:05.966 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-27T12:24:06.000 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-27T12:24:06.003 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_centos_9.stream (ID 10) 2023-10-27T12:24:06.003 DEBUG:teuthology.provision.fog.smithi017:FOG request: PUT /host/123 {"imageID": 10} 2023-10-27T12:24:06.042 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_centos_9.stream (ID 10) 2023-10-27T12:24:06.042 DEBUG:teuthology.provision.fog.smithi057:FOG request: PUT /host/162 {"imageID": 10} 2023-10-27T12:24:06.050 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 9.stream 2023-10-27T12:24:06.050 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-27T12:24:06.089 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of centos 9.stream 2023-10-27T12:24:06.089 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-27T12:24:06.119 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /tasktype {"name": "deploy"} 2023-10-27T12:24:06.150 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /tasktype {"name": "deploy"} 2023-10-27T12:24:06.158 DEBUG:teuthology.provision.fog.smithi017:FOG request: POST /host/123/task {"taskTypeID": 1} 2023-10-27T12:24:06.188 DEBUG:teuthology.provision.fog.smithi057:FOG request: POST /host/162/task {"taskTypeID": 1} 2023-10-27T12:24:06.213 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-27T12:24:06.248 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-27T12:24:06.313 INFO:teuthology.orchestra.console.smithi017:Power off 2023-10-27T12:24:06.313 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-27T12:24:06.335 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-10-27T12:24:06.335 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T12:24:06.353 INFO:teuthology.orchestra.console.smithi057:Power off 2023-10-27T12:24:06.354 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-27T12:24:06.363 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-10-27T12:24:06.376 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-10-27T12:24:06.376 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T12:24:06.397 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-27T12:24:06.498 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-10-27T12:24:06.599 INFO:teuthology.orchestra.console.smithi057:Power on 2023-10-27T12:24:06.599 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-27T12:24:06.620 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On 2023-10-27T12:24:06.621 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T12:24:06.641 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-27T12:24:10.366 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T12:24:10.475 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-10-27T12:24:10.642 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T12:24:10.752 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-27T12:24:10.853 INFO:teuthology.orchestra.console.smithi057:Power on completed 2023-10-27T12:24:10.954 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2023-10-27T12:24:10.954 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-27T12:24:14.480 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T12:24:14.589 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-10-27T12:24:14.690 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-10-27T12:24:14.790 INFO:teuthology.orchestra.console.smithi017:Power on 2023-10-27T12:24:14.791 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-27T12:24:14.814 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On 2023-10-27T12:24:14.815 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T12:24:14.837 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-10-27T12:24:18.842 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T12:24:18.952 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-10-27T12:24:22.954 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T12:24:23.063 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-10-27T12:24:23.164 INFO:teuthology.orchestra.console.smithi017:Power on completed 2023-10-27T12:24:23.265 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2023-10-27T12:24:23.265 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-27T12:24:26.042 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-27T12:24:38.340 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-27T12:24:41.122 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-27T12:24:53.431 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-27T12:24:56.202 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-27T12:25:08.522 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-27T12:25:11.277 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-27T12:25:23.606 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-27T12:25:26.346 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-27T12:25:38.680 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-27T12:25:41.421 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-27T12:25:53.751 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-27T12:25:56.490 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-27T12:26:08.830 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-27T12:26:11.562 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-27T12:26:23.910 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-27T12:26:26.639 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-27T12:26:38.982 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-27T12:26:41.705 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-27T12:26:54.054 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-27T12:26:54.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T12:26:56.773 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-27T12:26:56.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T12:27:12.639 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-10-27T12:27:15.194 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-27T12:27:18.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T12:27:21.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T12:27:21.722 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-10-27T12:27:24.250 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-27T12:27:27.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T12:27:30.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T12:27:30.782 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-10-27T12:27:33.310 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-27T12:27:36.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T12:27:39.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T12:27:42.394 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-27T12:27:48.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T12:27:51.450 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-27T12:27:57.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T12:28:36.807 WARNING:teuthology.provision.fog.smithi017:timed out 2023-10-27T12:28:42.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T12:28:43.040 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-27T12:28:43.041 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-27T12:28:43.405 INFO:teuthology.provision.fog.smithi017:Node is ready 2023-10-27T12:28:43.405 DEBUG:teuthology.orchestra.run.smithi017:> hostname 2023-10-27T12:28:43.420 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2023-10-27T12:28:43.420 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts 2023-10-27T12:28:43.476 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2023-10-27T12:28:43.477 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-10-27T12:28:43.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts 2023-10-27T12:28:43.758 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts 2023-10-27T12:28:43.830 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname 2023-10-27T12:28:43.900 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-10-27T12:28:43.970 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-10-27T12:28:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2023-10-27T12:28:44.025 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2023-10-27T12:28:44.026 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2023-10-27T12:28:44.026 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2023-10-27T12:28:44.026 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2023-10-27T12:28:44.026 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2023-10-27T12:28:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-27T12:28:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-10-27T12:28:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2023-10-27T12:28:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-27T12:28:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2023-10-27T12:28:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-27T12:28:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-27T12:28:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-27T12:28:44.029 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2023-10-27T12:28:44.030 DEBUG:teuthology.parallel:result is None 2023-10-27T12:28:57.470 WARNING:teuthology.provision.fog.smithi057:timed out 2023-10-27T12:29:03.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T12:29:03.742 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-27T12:29:03.743 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-27T12:29:04.095 INFO:teuthology.provision.fog.smithi057:Node is ready 2023-10-27T12:29:04.096 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2023-10-27T12:29:04.112 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2023-10-27T12:29:04.112 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2023-10-27T12:29:04.167 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2023-10-27T12:29:04.168 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-10-27T12:29:04.266 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2023-10-27T12:29:04.298 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2023-10-27T12:29:04.370 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2023-10-27T12:29:04.442 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-10-27T12:29:04.514 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-10-27T12:29:04.568 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2023-10-27T12:29:04.569 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2023-10-27T12:29:04.569 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2023-10-27T12:29:04.569 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2023-10-27T12:29:04.570 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2023-10-27T12:29:04.570 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2023-10-27T12:29:04.570 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-27T12:29:04.570 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-10-27T12:29:04.571 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2023-10-27T12:29:04.571 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-27T12:29:04.571 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2023-10-27T12:29:04.571 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-27T12:29:04.571 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-27T12:29:04.572 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-27T12:29:04.572 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2023-10-27T12:29:04.573 DEBUG:teuthology.parallel:result is None 2023-10-27T12:29:04.749 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2023-10-27T12:29:04.750 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-27T12:29:04.784 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2023-10-27T12:29:04.784 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-27T12:29:04.818 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2023-10-27T12:29:04.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-27T12:29:04.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T12:29:04.917 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-10-27T12:29:05.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-27T12:29:05.105 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2023-10-27T12:29:05.160 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2023-10-27T12:29:05.161 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-10-27T12:29:05.215 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2023-10-27T12:29:05.216 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2023-10-27T12:29:05.216 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2023-10-27T12:29:05.216 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2023-10-27T12:29:05.216 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2023-10-27T12:29:05.216 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2023-10-27T12:29:05.217 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-27T12:29:05.217 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-10-27T12:29:05.217 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2023-10-27T12:29:05.217 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-27T12:29:05.217 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2023-10-27T12:29:05.218 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-27T12:29:05.218 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-27T12:29:05.218 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-27T12:29:05.219 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-10-27T12:29:05.251 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2023-10-27T12:29:05.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-27T12:29:05.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T12:29:05.350 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-10-27T12:29:05.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-27T12:29:05.423 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-10-27T12:29:05.478 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-10-27T12:29:05.479 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-10-27T12:29:05.535 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2023-10-27T12:29:05.535 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2023-10-27T12:29:05.535 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2023-10-27T12:29:05.535 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2023-10-27T12:29:05.535 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2023-10-27T12:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2023-10-27T12:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-27T12:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-10-27T12:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2023-10-27T12:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-27T12:29:05.537 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2023-10-27T12:29:05.537 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-27T12:29:05.537 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-27T12:29:05.537 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-27T12:29:05.538 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-10-27T12:29:05.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:29:05.645 INFO:teuthology.dispatcher.supervisor:Running job 7436867 2023-10-27T12:29:05.646 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2023-10-25_07:56:00-rados:verify-main-distro-default-smithi/7436867 --name amathuri-2023-10-25_07:56:00-rados:verify-main-distro-default-smithi --description rados:verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/valgrind} -- /home/teuthworker/archive/amathuri-2023-10-25_07:56:00-rados:verify-main-distro-default-smithi/7436867/orig.config.yaml 2023-10-27T12:29:05.649 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2023-10-25_07:56:00-rados:verify-main-distro-default-smithi/7436867 2023-10-27T12:29:05.650 INFO:teuthology.dispatcher.supervisor:Job PID: 755402 2023-10-27T12:29:05.650 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-27T12:31:05.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:33:05.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:35:06.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:37:06.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:39:06.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:41:06.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:43:06.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:45:06.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:47:07.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:49:07.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:51:07.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:53:07.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:55:07.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:57:07.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T12:59:08.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T13:01:08.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T13:03:08.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T13:05:08.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T13:07:08.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T13:09:08.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T13:09:08.859 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-27T13:09:08.960 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-27T13:09:08.960 INFO:teuthology.nuke:Checking targets against current locks 2023-10-27T13:09:09.007 DEBUG:teuthology.nuke:shortname: smithi017 2023-10-27T13:09:09.008 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-27T13:09:09.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amathuri-2023-10-25_07:56:00-rados:verify-main-distro-default-smithi/7436867', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-27 12:24:04.982738', 'locked_by': 'scheduled_amathuri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4+ZXWCLThIVJ5Fjqf+AvqW4pk0x+iDmmcvvSYT9Pcb29R4GthbE+3zbXKQ/PVWBhw1ILVJbXeCUxveskr6MpE='} 2023-10-27T13:09:09.040 DEBUG:teuthology.nuke:shortname: smithi057 2023-10-27T13:09:09.040 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-27T13:09:09.066 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amathuri-2023-10-25_07:56:00-rados:verify-main-distro-default-smithi/7436867', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-27 12:24:04.985606', 'locked_by': 'scheduled_amathuri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAZZ76TGmkQRVMAjvx5KnO1FKQq3jlhN1fO7XtfwaHd2KbMk3UG6pfheSXfLtBF9VmEvy1caXwEK+Owhf6uQ1WI='} 2023-10-27T13:09:09.099 INFO:teuthology.orchestra.console.smithi017:Power off 2023-10-27T13:09:09.100 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-27T13:09:09.126 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-10-27T13:09:09.126 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T13:09:09.140 INFO:teuthology.orchestra.console.smithi057:Power off 2023-10-27T13:09:09.141 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-27T13:09:09.150 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-10-27T13:09:09.162 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-10-27T13:09:09.162 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T13:09:09.184 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-27T13:09:09.251 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-10-27T13:09:09.286 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-10-27T13:09:09.407 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com 2023-10-27T13:09:09.431 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com