2023-09-16T16:08:04.299 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-16T16:08:04.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:08:04.451 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4071ab9ee0>, signals=[15]) 2023-09-16T16:08:04.452 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging 2023-09-16T16:08:04.453 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server 2023-09-16T16:08:04.453 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-09-16T16:08:04.473 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2023-09-16T16:08:04.474 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2023-09-16T16:08:04.474 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-09-16T16:08:04.475 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /host {"name": "smithi017"} 2023-09-16T16:08:04.498 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /host {"name": "smithi158"} 2023-09-16T16:08:04.546 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-16T16:08:04.570 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-16T16:08:04.592 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-16T16:08:04.593 DEBUG:teuthology.provision.fog.smithi017:FOG request: PUT /host/123 {"imageID": 5} 2023-09-16T16:08:04.610 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-16T16:08:04.611 DEBUG:teuthology.provision.fog.smithi158:FOG request: PUT /host/263 {"imageID": 5} 2023-09-16T16:08:04.639 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of rhel 8.6 2023-09-16T16:08:04.639 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-16T16:08:04.657 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of rhel 8.6 2023-09-16T16:08:04.657 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-16T16:08:04.693 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /tasktype {"name": "deploy"} 2023-09-16T16:08:04.707 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /tasktype {"name": "deploy"} 2023-09-16T16:08:04.732 DEBUG:teuthology.provision.fog.smithi017:FOG request: POST /host/123/task {"taskTypeID": 1} 2023-09-16T16:08:04.738 DEBUG:teuthology.provision.fog.smithi158:FOG request: POST /host/263/task {"taskTypeID": 1} 2023-09-16T16:08:04.788 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-16T16:08:04.794 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-16T16:08:04.895 INFO:teuthology.orchestra.console.smithi017:Power off 2023-09-16T16:08:04.896 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T16:08:04.911 INFO:teuthology.orchestra.console.smithi158:Power off 2023-09-16T16:08:04.912 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T16:08:04.921 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-09-16T16:08:04.921 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:08:04.934 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-09-16T16:08:04.935 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:08:04.949 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-09-16T16:08:04.964 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-09-16T16:08:05.053 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-09-16T16:08:05.065 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-09-16T16:08:05.155 INFO:teuthology.orchestra.console.smithi017:Power on 2023-09-16T16:08:05.155 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-16T16:08:05.166 INFO:teuthology.orchestra.console.smithi158:Power on 2023-09-16T16:08:05.167 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-16T16:08:05.190 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On 2023-09-16T16:08:05.191 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:08:05.202 DEBUG:teuthology.orchestra.console.smithi158:power on output: Chassis Power Control: Up/On 2023-09-16T16:08:05.204 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:08:05.227 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-09-16T16:08:05.229 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-09-16T16:08:09.230 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:08:09.237 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:08:09.339 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-09-16T16:08:09.345 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-09-16T16:08:09.441 INFO:teuthology.orchestra.console.smithi017:Power on completed 2023-09-16T16:08:09.541 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2023-09-16T16:08:09.542 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-16T16:08:13.350 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:08:13.526 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-09-16T16:08:13.627 INFO:teuthology.orchestra.console.smithi158:Power on completed 2023-09-16T16:08:13.728 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2023-09-16T16:08:13.729 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-16T16:08:24.612 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-16T16:08:28.802 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-16T16:08:39.686 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-16T16:08:43.874 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-16T16:08:54.766 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-16T16:08:58.946 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-16T16:09:09.846 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-16T16:09:14.030 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-16T16:09:24.923 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-16T16:09:29.123 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-16T16:09:40.002 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-16T16:09:44.202 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-16T16:09:55.086 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-16T16:09:59.286 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-16T16:10:10.178 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-16T16:10:14.382 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-16T16:10:25.278 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-16T16:10:29.474 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-16T16:10:40.374 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-09-16T16:10:40.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:10:40.754 ERROR:teuthology.orchestra.connection:Error authenticating with smithi017.front.sepia.ceph.com: Authentication failed. 2023-09-16T16:10:40.756 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-16T16:10:40.757 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-16T16:10:40.758 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-09-16T16:10:44.568 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-16T16:10:59.659 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-16T16:11:14.742 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-09-16T16:11:14.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:11:33.153 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-16T16:11:39.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:11:42.234 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-16T16:11:48.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:11:51.290 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-16T16:11:57.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:12:00.346 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-16T16:12:06.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:12:09.402 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-16T16:12:15.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:12:18.462 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-16T16:12:24.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:12:27.518 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-09-16T16:12:33.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:12:40.222 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-09-16T16:12:40.223 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi017 2023-09-16T16:12:49.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-09-16T16:12:49.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:12:49.553 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-09-16T16:12:49.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-09-16T16:12:49.874 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-16T16:12:49.874 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-16T16:12:49.893 INFO:teuthology.provision.fog.smithi017:Node is ready 2023-09-16T16:12:49.893 DEBUG:teuthology.orchestra.run.smithi017:> hostname 2023-09-16T16:12:49.953 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2023-09-16T16:12:49.954 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts 2023-09-16T16:12:50.012 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2023-09-16T16:12:50.013 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-09-16T16:12:50.132 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts 2023-09-16T16:12:50.162 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts 2023-09-16T16:12:50.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname 2023-09-16T16:12:50.300 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-09-16T16:12:50.368 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-09-16T16:12:50.426 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Red Hat Enterprise Linux" 2023-09-16T16:12:50.427 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8.6 (Ootpa)" 2023-09-16T16:12:50.427 INFO:teuthology.orchestra.run.smithi017.stdout:ID="rhel" 2023-09-16T16:12:50.428 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="fedora" 2023-09-16T16:12:50.428 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8.6" 2023-09-16T16:12:50.428 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-09-16T16:12:50.429 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-16T16:12:50.429 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-09-16T16:12:50.429 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-16T16:12:50.430 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.redhat.com/" 2023-09-16T16:12:50.430 INFO:teuthology.orchestra.run.smithi017.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-16T16:12:50.430 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T16:12:50.431 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-09-16T16:12:50.431 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T16:12:50.431 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-16T16:12:50.431 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-16T16:12:50.431 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-16T16:12:50.432 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2023-09-16T16:12:50.433 DEBUG:teuthology.parallel:result is None 2023-09-16T16:13:33.563 WARNING:teuthology.provision.fog.smithi158:timed out 2023-09-16T16:13:39.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:13:39.905 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-16T16:13:39.906 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-16T16:13:40.662 INFO:teuthology.provision.fog.smithi158:Node is ready 2023-09-16T16:13:40.662 DEBUG:teuthology.orchestra.run.smithi158:> hostname 2023-09-16T16:13:40.681 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158 2023-09-16T16:13:40.681 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158 /etc/hosts 2023-09-16T16:13:40.740 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2023-09-16T16:13:40.741 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-09-16T16:13:40.867 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158/smithi158/g' /etc/hosts 2023-09-16T16:13:40.897 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2023-09-16T16:13:40.965 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158/smithi158/g' /etc/hostname 2023-09-16T16:13:41.032 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-09-16T16:13:41.099 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-09-16T16:13:41.156 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Red Hat Enterprise Linux" 2023-09-16T16:13:41.156 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8.6 (Ootpa)" 2023-09-16T16:13:41.157 INFO:teuthology.orchestra.run.smithi158.stdout:ID="rhel" 2023-09-16T16:13:41.157 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="fedora" 2023-09-16T16:13:41.157 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8.6" 2023-09-16T16:13:41.157 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-09-16T16:13:41.157 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-16T16:13:41.158 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-09-16T16:13:41.158 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-16T16:13:41.158 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.redhat.com/" 2023-09-16T16:13:41.158 INFO:teuthology.orchestra.run.smithi158.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-16T16:13:41.158 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T16:13:41.159 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-16T16:13:41.159 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T16:13:41.159 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-16T16:13:41.159 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-16T16:13:41.159 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-16T16:13:41.160 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2023-09-16T16:13:41.160 DEBUG:teuthology.parallel:result is None 2023-09-16T16:13:41.314 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2023-09-16T16:13:41.314 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2023-09-16T16:13:41.316 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2023-09-16T16:13:41.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-09-16T16:13:41.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:13:41.385 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-09-16T16:13:41.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-09-16T16:13:41.516 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2023-09-16T16:13:41.572 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2023-09-16T16:13:41.573 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-09-16T16:13:41.630 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Red Hat Enterprise Linux" 2023-09-16T16:13:41.630 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8.6 (Ootpa)" 2023-09-16T16:13:41.630 INFO:teuthology.orchestra.run.smithi017.stdout:ID="rhel" 2023-09-16T16:13:41.630 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="fedora" 2023-09-16T16:13:41.631 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8.6" 2023-09-16T16:13:41.631 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-09-16T16:13:41.631 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-16T16:13:41.631 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-09-16T16:13:41.631 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-16T16:13:41.632 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.redhat.com/" 2023-09-16T16:13:41.632 INFO:teuthology.orchestra.run.smithi017.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-16T16:13:41.632 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T16:13:41.633 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-09-16T16:13:41.633 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T16:13:41.633 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-16T16:13:41.633 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-16T16:13:41.633 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-16T16:13:41.634 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-09-16T16:13:41.662 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2023-09-16T16:13:41.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-09-16T16:13:41.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T16:13:41.729 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-09-16T16:13:41.799 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-09-16T16:13:41.799 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-09-16T16:13:41.857 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-09-16T16:13:41.857 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-09-16T16:13:41.915 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Red Hat Enterprise Linux" 2023-09-16T16:13:41.915 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8.6 (Ootpa)" 2023-09-16T16:13:41.915 INFO:teuthology.orchestra.run.smithi158.stdout:ID="rhel" 2023-09-16T16:13:41.916 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="fedora" 2023-09-16T16:13:41.916 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8.6" 2023-09-16T16:13:41.916 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-09-16T16:13:41.916 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-16T16:13:41.916 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-09-16T16:13:41.917 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-16T16:13:41.917 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.redhat.com/" 2023-09-16T16:13:41.917 INFO:teuthology.orchestra.run.smithi158.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-16T16:13:41.917 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T16:13:41.917 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-09-16T16:13:41.918 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T16:13:41.918 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-16T16:13:41.918 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-16T16:13:41.918 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-16T16:13:41.919 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-09-16T16:13:41.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:13:42.057 INFO:teuthology.dispatcher.supervisor:Running job 7397282 2023-09-16T16:13:42.058 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi/7397282 --name teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi/7397282/orig.config.yaml 2023-09-16T16:13:42.060 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi/7397282 2023-09-16T16:13:42.061 INFO:teuthology.dispatcher.supervisor:Job PID: 19901 2023-09-16T16:13:42.061 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-16T16:15:42.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:17:42.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:19:44.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:21:44.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:23:44.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:25:44.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:27:44.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:29:45.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:31:45.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:33:45.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:35:45.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:37:45.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:39:45.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:41:46.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:43:46.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:45:46.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:47:46.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:49:46.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:51:46.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:53:46.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:55:47.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:57:47.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:59:47.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:01:47.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:03:47.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:05:47.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:07:48.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:09:48.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:11:48.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:13:48.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:15:48.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:17:48.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:19:49.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:21:49.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:23:49.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:25:49.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:27:49.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:29:49.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:31:50.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T17:31:50.164 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-16T17:31:50.381 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-16T17:31:50.382 INFO:teuthology.nuke:Checking targets against current locks 2023-09-16T17:31:50.431 DEBUG:teuthology.nuke:shortname: smithi017 2023-09-16T17:31:50.432 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-16T17:31:50.459 DEBUG:teuthology.nuke:shortname: smithi158 2023-09-16T17:31:50.459 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-16T17:31:50.463 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi/7397282', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-16 16:08:03.477002', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-16T17:31:50.487 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi/7397282', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-16 16:08:03.478359', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-16T17:31:50.515 INFO:teuthology.orchestra.console.smithi017:Power off 2023-09-16T17:31:50.516 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T17:31:50.538 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-09-16T17:31:50.539 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T17:31:50.551 INFO:teuthology.orchestra.console.smithi158:Power off 2023-09-16T17:31:50.552 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T17:31:50.565 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-09-16T17:31:50.573 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-09-16T17:31:50.574 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T17:31:50.598 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-09-16T17:31:50.667 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-09-16T17:31:50.700 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-09-16T17:31:50.822 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com 2023-09-16T17:31:50.846 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com