2023-09-16T18:29:13.118 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-16T18:29:13.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:29:13.255 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5690c84ee0>, signals=[15]) 2023-09-16T18:29:13.256 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-09-16T18:29:13.257 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-09-16T18:29:13.257 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-09-16T18:29:13.283 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging 2023-09-16T18:29:13.283 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server 2023-09-16T18:29:13.284 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-09-16T18:29:13.285 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"} 2023-09-16T18:29:13.308 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /host {"name": "smithi096"} 2023-09-16T18:29:13.358 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-16T18:29:13.381 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-16T18:29:13.403 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-16T18:29:13.403 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 5} 2023-09-16T18:29:13.420 DEBUG:teuthology.provision.fog.smithi096:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-16T18:29:13.420 DEBUG:teuthology.provision.fog.smithi096:FOG request: PUT /host/201 {"imageID": 5} 2023-09-16T18:29:13.462 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of rhel 8.6 2023-09-16T18:29:13.463 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-16T18:29:13.472 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of rhel 8.6 2023-09-16T18:29:13.473 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-16T18:29:13.509 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"} 2023-09-16T18:29:13.525 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /tasktype {"name": "deploy"} 2023-09-16T18:29:13.545 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1} 2023-09-16T18:29:13.561 DEBUG:teuthology.provision.fog.smithi096:FOG request: POST /host/201/task {"taskTypeID": 1} 2023-09-16T18:29:13.598 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-16T18:29:13.618 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-16T18:29:13.679 INFO:teuthology.orchestra.console.smithi033:Power off 2023-09-16T18:29:13.680 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T18:29:13.703 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-09-16T18:29:13.704 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T18:29:13.717 INFO:teuthology.orchestra.console.smithi096:Power off 2023-09-16T18:29:13.718 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T18:29:13.733 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-09-16T18:29:13.741 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2023-09-16T18:29:13.742 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T18:29:13.763 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-09-16T18:29:17.738 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T18:29:17.764 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T18:29:17.846 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-09-16T18:29:17.873 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-09-16T18:29:21.852 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T18:29:21.875 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T18:29:21.962 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-09-16T18:29:21.984 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-16T18:29:22.063 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-09-16T18:29:22.085 INFO:teuthology.orchestra.console.smithi096:Power off completed 2023-09-16T18:29:22.164 INFO:teuthology.orchestra.console.smithi033:Power on 2023-09-16T18:29:22.165 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-16T18:29:22.186 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2023-09-16T18:29:22.187 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T18:29:22.194 INFO:teuthology.orchestra.console.smithi096:Power on 2023-09-16T18:29:22.195 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-16T18:29:22.209 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-09-16T18:29:22.216 DEBUG:teuthology.orchestra.console.smithi096:power on output: Chassis Power Control: Up/On 2023-09-16T18:29:22.217 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T18:29:22.239 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-16T18:29:26.214 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T18:29:26.241 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T18:29:26.323 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-09-16T18:29:26.349 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-16T18:29:30.326 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T18:29:30.351 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T18:29:30.462 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-09-16T18:29:30.478 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-09-16T18:29:30.563 INFO:teuthology.orchestra.console.smithi096:Power on completed 2023-09-16T18:29:30.579 INFO:teuthology.orchestra.console.smithi033:Power on completed 2023-09-16T18:29:30.666 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish 2023-09-16T18:29:30.667 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-16T18:29:30.680 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-09-16T18:29:30.680 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-16T18:29:45.742 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-16T18:29:45.743 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-16T18:30:00.802 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-16T18:30:00.805 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-16T18:30:15.873 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-16T18:30:15.875 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-16T18:30:30.942 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-16T18:30:30.944 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-16T18:30:46.005 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-16T18:30:46.007 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-16T18:31:01.074 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-16T18:31:01.075 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-16T18:31:16.152 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-16T18:31:16.153 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-16T18:31:31.221 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-16T18:31:31.223 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-16T18:31:46.298 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-16T18:31:46.299 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-09-16T18:31:46.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T18:31:46.442 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: Authentication failed. 2023-09-16T18:31:46.444 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-16T18:31:46.444 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-16T18:31:46.445 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-16T18:31:47.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-16T18:31:48.461 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-16T18:32:01.361 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-16T18:32:16.419 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-09-16T18:32:16.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T18:32:19.546 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-16T18:32:25.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T18:32:28.602 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-16T18:32:34.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T18:32:37.658 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-16T18:32:43.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T18:32:46.714 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-16T18:32:52.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T18:32:55.774 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-16T18:33:01.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T18:33:04.826 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-09-16T18:33:10.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T18:33:36.410 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-09-16T18:33:36.411 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi033 2023-09-16T18:33:45.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-09-16T18:33:45.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T18:33:45.770 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-09-16T18:33:46.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-09-16T18:33:46.065 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-16T18:33:46.065 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-16T18:33:46.082 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-09-16T18:33:46.083 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-09-16T18:33:46.139 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-09-16T18:33:46.140 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-09-16T18:33:46.197 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-09-16T18:33:46.197 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-09-16T18:33:46.314 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-09-16T18:33:46.343 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-09-16T18:33:46.411 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-09-16T18:33:46.478 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-09-16T18:33:46.546 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-09-16T18:33:46.603 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux" 2023-09-16T18:33:46.603 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)" 2023-09-16T18:33:46.603 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel" 2023-09-16T18:33:46.603 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora" 2023-09-16T18:33:46.604 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6" 2023-09-16T18:33:46.604 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-09-16T18:33:46.604 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-16T18:33:46.604 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-09-16T18:33:46.604 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-16T18:33:46.604 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/" 2023-09-16T18:33:46.605 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-16T18:33:46.605 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T18:33:46.605 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-09-16T18:33:46.605 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T18:33:46.605 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-16T18:33:46.606 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-16T18:33:46.606 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-16T18:33:46.607 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2023-09-16T18:33:46.608 DEBUG:teuthology.parallel:result is None 2023-09-16T18:34:10.844 WARNING:teuthology.provision.fog.smithi096:timed out 2023-09-16T18:34:16.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T18:34:17.177 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-16T18:34:17.177 DEBUG:teuthology.orchestra.run.smithi096:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-16T18:34:17.488 INFO:teuthology.provision.fog.smithi096:Node is ready 2023-09-16T18:34:17.489 DEBUG:teuthology.orchestra.run.smithi096:> hostname 2023-09-16T18:34:17.507 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com 2023-09-16T18:34:17.507 DEBUG:teuthology.orchestra.run.smithi096:> grep smithi096.front.sepia.ceph.com /etc/hosts 2023-09-16T18:34:17.565 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096 2023-09-16T18:34:17.566 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2023-09-16T18:34:17.696 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hosts 2023-09-16T18:34:17.726 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/172.21.15.96/172.21.15.96/g' /etc/hosts 2023-09-16T18:34:17.795 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hostname 2023-09-16T18:34:17.863 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2023-09-16T18:34:17.929 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-09-16T18:34:17.986 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Red Hat Enterprise Linux" 2023-09-16T18:34:17.986 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8.6 (Ootpa)" 2023-09-16T18:34:17.987 INFO:teuthology.orchestra.run.smithi096.stdout:ID="rhel" 2023-09-16T18:34:17.987 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="fedora" 2023-09-16T18:34:17.987 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8.6" 2023-09-16T18:34:17.987 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2023-09-16T18:34:17.987 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-16T18:34:17.988 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-09-16T18:34:17.988 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-16T18:34:17.988 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.redhat.com/" 2023-09-16T18:34:17.988 INFO:teuthology.orchestra.run.smithi096.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-16T18:34:17.988 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T18:34:17.989 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-09-16T18:34:17.989 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T18:34:17.989 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-16T18:34:17.989 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-16T18:34:17.989 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-16T18:34:17.990 INFO:teuthology.provision.fog.smithi096:Deploy complete! 2023-09-16T18:34:17.990 DEBUG:teuthology.parallel:result is None 2023-09-16T18:34:18.140 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2023-09-16T18:34:18.141 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-16T18:34:18.161 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com 2023-09-16T18:34:18.162 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-16T18:34:18.187 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2023-09-16T18:34:18.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-09-16T18:34:18.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T18:34:18.256 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-09-16T18:34:18.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-09-16T18:34:18.392 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-09-16T18:34:18.450 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-09-16T18:34:18.450 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-09-16T18:34:18.508 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux" 2023-09-16T18:34:18.508 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)" 2023-09-16T18:34:18.509 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel" 2023-09-16T18:34:18.509 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora" 2023-09-16T18:34:18.509 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6" 2023-09-16T18:34:18.509 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-09-16T18:34:18.509 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-16T18:34:18.510 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-09-16T18:34:18.510 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-16T18:34:18.510 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/" 2023-09-16T18:34:18.510 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-16T18:34:18.511 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T18:34:18.511 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-09-16T18:34:18.511 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T18:34:18.511 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-16T18:34:18.511 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-16T18:34:18.512 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-16T18:34:18.512 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-09-16T18:34:18.537 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server 2023-09-16T18:34:18.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-09-16T18:34:18.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T18:34:18.602 DEBUG:teuthology.orchestra.run.smithi096:> true 2023-09-16T18:34:18.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-09-16T18:34:18.668 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2023-09-16T18:34:18.724 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2023-09-16T18:34:18.724 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-09-16T18:34:18.781 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Red Hat Enterprise Linux" 2023-09-16T18:34:18.781 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8.6 (Ootpa)" 2023-09-16T18:34:18.782 INFO:teuthology.orchestra.run.smithi096.stdout:ID="rhel" 2023-09-16T18:34:18.782 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="fedora" 2023-09-16T18:34:18.782 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8.6" 2023-09-16T18:34:18.782 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2023-09-16T18:34:18.783 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-16T18:34:18.783 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-09-16T18:34:18.783 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-16T18:34:18.783 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.redhat.com/" 2023-09-16T18:34:18.784 INFO:teuthology.orchestra.run.smithi096.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-16T18:34:18.784 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T18:34:18.784 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-09-16T18:34:18.784 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T18:34:18.784 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-16T18:34:18.785 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-16T18:34:18.785 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-16T18:34:18.785 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-09-16T18:34:18.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:34:18.898 INFO:teuthology.dispatcher.supervisor:Running job 7397381 2023-09-16T18:34:18.899 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi/7397381 --name teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/rhel_8.6_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi/7397381/orig.config.yaml 2023-09-16T18:34:18.901 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi/7397381 2023-09-16T18:34:18.902 INFO:teuthology.dispatcher.supervisor:Job PID: 1032178 2023-09-16T18:34:18.902 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-16T18:36:19.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:38:19.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:40:19.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:42:19.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:44:19.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:46:19.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:48:19.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:50:20.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:52:20.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:54:20.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:56:20.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T18:58:20.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T19:00:20.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T19:00:21.062 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-16T19:00:21.244 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-16T19:00:21.244 INFO:teuthology.nuke:Checking targets against current locks 2023-09-16T19:00:21.291 DEBUG:teuthology.nuke:shortname: smithi033 2023-09-16T19:00:21.292 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-16T19:00:21.320 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi/7397381', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-16 18:29:12.317663', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-16T19:00:21.324 DEBUG:teuthology.nuke:shortname: smithi096 2023-09-16T19:00:21.325 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-16T19:00:21.348 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi/7397381', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-16 18:29:12.316304', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-16T19:00:21.379 INFO:teuthology.orchestra.console.smithi033:Power off 2023-09-16T19:00:21.381 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T19:00:21.406 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-09-16T19:00:21.407 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T19:00:21.423 INFO:teuthology.orchestra.console.smithi096:Power off 2023-09-16T19:00:21.424 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T19:00:21.432 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-09-16T19:00:21.445 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2023-09-16T19:00:21.445 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T19:00:21.470 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-09-16T19:00:21.534 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-09-16T19:00:21.572 INFO:teuthology.orchestra.console.smithi096:Power off completed 2023-09-16T19:00:21.684 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2023-09-16T19:00:21.725 INFO:teuthology.lock.ops:unlocked: smithi096.front.sepia.ceph.com