2023-08-02T02:57:00.008 INFO:root:teuthology version: 0.0.1.dev174+g10753fd 2023-08-02T02:57:00.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T02:57:00.142 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd4270f8ee0>, signals=[15]) 2023-08-02T02:57:00.144 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging 2023-08-02T02:57:00.144 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server 2023-08-02T02:57:00.144 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2023-08-02T02:57:00.163 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2023-08-02T02:57:00.163 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2023-08-02T02:57:00.163 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-08-02T02:57:00.165 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /host {"name": "smithi162"} 2023-08-02T02:57:00.187 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /host {"name": "smithi181"} 2023-08-02T02:57:00.228 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-02T02:57:00.249 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-02T02:57:00.263 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-02T02:57:00.263 DEBUG:teuthology.provision.fog.smithi162:FOG request: PUT /host/267 {"imageID": 5} 2023-08-02T02:57:00.298 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-02T02:57:00.299 DEBUG:teuthology.provision.fog.smithi181:FOG request: PUT /host/286 {"imageID": 5} 2023-08-02T02:57:00.310 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of rhel 8.6 2023-08-02T02:57:00.311 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T02:57:00.342 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of rhel 8.6 2023-08-02T02:57:00.343 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T02:57:00.490 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /tasktype {"name": "deploy"} 2023-08-02T02:57:00.516 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /tasktype {"name": "deploy"} 2023-08-02T02:57:00.534 DEBUG:teuthology.provision.fog.smithi162:FOG request: POST /host/267/task {"taskTypeID": 1} 2023-08-02T02:57:00.549 DEBUG:teuthology.provision.fog.smithi181:FOG request: POST /host/286/task {"taskTypeID": 1} 2023-08-02T02:57:00.595 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T02:57:00.601 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T02:57:00.785 INFO:teuthology.orchestra.console.smithi162:Power off 2023-08-02T02:57:00.786 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-02T02:57:00.802 INFO:teuthology.orchestra.console.smithi181:Power off 2023-08-02T02:57:00.803 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-02T02:57:00.812 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2023-08-02T02:57:00.812 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T02:57:00.823 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-08-02T02:57:00.823 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T02:57:00.832 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-08-02T02:57:00.843 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-08-02T02:57:00.934 INFO:teuthology.orchestra.console.smithi162:Power off completed 2023-08-02T02:57:00.944 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-08-02T02:57:01.035 INFO:teuthology.orchestra.console.smithi162:Power on 2023-08-02T02:57:01.035 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-02T02:57:01.045 INFO:teuthology.orchestra.console.smithi181:Power on 2023-08-02T02:57:01.046 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-02T02:57:01.057 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On 2023-08-02T02:57:01.058 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T02:57:01.069 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On 2023-08-02T02:57:01.069 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T02:57:01.081 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-08-02T02:57:01.090 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-08-02T02:57:05.084 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T02:57:05.092 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T02:57:05.194 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2023-08-02T02:57:05.202 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-08-02T02:57:05.296 INFO:teuthology.orchestra.console.smithi162:Power on completed 2023-08-02T02:57:05.397 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2023-08-02T02:57:05.398 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T02:57:09.204 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T02:57:09.315 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2023-08-02T02:57:09.416 INFO:teuthology.orchestra.console.smithi181:Power on completed 2023-08-02T02:57:09.517 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2023-08-02T02:57:09.517 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T02:57:20.646 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T02:57:24.704 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T02:57:35.844 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T02:57:39.879 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T02:57:51.084 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T02:57:55.072 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T02:58:06.284 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T02:58:10.264 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T02:58:21.500 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T02:58:25.504 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T02:58:36.785 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T02:58:40.782 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T02:58:52.016 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T02:58:56.022 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T02:59:07.356 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T02:59:11.268 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T02:59:22.652 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T02:59:26.888 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T02:59:37.980 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T02:59:42.273 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T02:59:53.260 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T02:59:57.600 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:00:08.524 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T03:00:12.908 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:00:23.852 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T03:00:28.252 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:00:39.119 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T03:00:43.568 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:00:54.382 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T03:00:58.846 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:01:09.659 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T03:01:14.139 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:01:24.912 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T03:01:29.444 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:01:40.176 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T03:01:44.736 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:01:55.434 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T03:02:00.085 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:02:10.684 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T03:02:15.492 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:02:25.989 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T03:02:30.815 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:02:41.285 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T03:02:46.082 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:02:56.591 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T03:03:01.375 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:03:11.856 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-02T03:03:12.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:03:15.184 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-02T03:03:16.593 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:03:21.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:03:24.244 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-02T03:03:30.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:03:31.808 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:03:33.328 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-02T03:03:39.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:03:42.388 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-02T03:03:46.985 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:03:48.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:03:51.440 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-02T03:03:57.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:04:00.496 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-02T03:04:02.188 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:04:06.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:04:09.552 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-02T03:04:15.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:04:17.413 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:04:32.624 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:04:47.860 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:05:03.056 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:05:15.564 WARNING:teuthology.provision.fog.smithi162:timed out 2023-08-02T03:05:18.257 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:05:21.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:05:21.938 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-02T03:05:21.939 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-02T03:05:22.227 INFO:teuthology.provision.fog.smithi162:Node is ready 2023-08-02T03:05:22.227 DEBUG:teuthology.orchestra.run.smithi162:> hostname 2023-08-02T03:05:22.245 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162 2023-08-02T03:05:22.245 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162 /etc/hosts 2023-08-02T03:05:22.303 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2023-08-02T03:05:22.303 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2023-08-02T03:05:22.432 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162/smithi162/g' /etc/hosts 2023-08-02T03:05:22.461 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts 2023-08-02T03:05:22.529 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162/smithi162/g' /etc/hostname 2023-08-02T03:05:22.597 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2023-08-02T03:05:22.664 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2023-08-02T03:05:22.721 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Red Hat Enterprise Linux" 2023-08-02T03:05:22.721 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8.6 (Ootpa)" 2023-08-02T03:05:22.721 INFO:teuthology.orchestra.run.smithi162.stdout:ID="rhel" 2023-08-02T03:05:22.721 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="fedora" 2023-08-02T03:05:22.722 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8.6" 2023-08-02T03:05:22.722 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8" 2023-08-02T03:05:22.722 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-02T03:05:22.722 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2023-08-02T03:05:22.722 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-02T03:05:22.722 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.redhat.com/" 2023-08-02T03:05:22.722 INFO:teuthology.orchestra.run.smithi162.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-02T03:05:22.722 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-02T03:05:22.723 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-08-02T03:05:22.723 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-02T03:05:22.723 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-02T03:05:22.723 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-02T03:05:22.723 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-02T03:05:22.724 INFO:teuthology.provision.fog.smithi162:Deploy complete! 2023-08-02T03:05:22.725 DEBUG:teuthology.parallel:result is None 2023-08-02T03:05:33.447 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:05:48.605 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-08-02T03:05:48.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:05:51.792 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-08-02T03:05:57.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:06:00.880 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-08-02T03:06:06.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:06:09.936 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-08-02T03:06:15.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:06:19.024 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-08-02T03:06:25.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:06:28.080 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-08-02T03:06:34.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:06:37.136 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-08-02T03:06:43.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:07:43.201 WARNING:teuthology.provision.fog.smithi181:timed out 2023-08-02T03:07:49.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:07:49.561 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-02T03:07:49.561 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-02T03:07:49.866 INFO:teuthology.provision.fog.smithi181:Node is ready 2023-08-02T03:07:49.866 DEBUG:teuthology.orchestra.run.smithi181:> hostname 2023-08-02T03:07:49.884 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181 2023-08-02T03:07:49.884 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181 /etc/hosts 2023-08-02T03:07:49.941 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2023-08-02T03:07:49.941 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-08-02T03:07:50.065 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181/smithi181/g' /etc/hosts 2023-08-02T03:07:50.092 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts 2023-08-02T03:07:50.159 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181/smithi181/g' /etc/hostname 2023-08-02T03:07:50.225 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181 2023-08-02T03:07:50.290 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-08-02T03:07:50.346 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Red Hat Enterprise Linux" 2023-08-02T03:07:50.347 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8.6 (Ootpa)" 2023-08-02T03:07:50.347 INFO:teuthology.orchestra.run.smithi181.stdout:ID="rhel" 2023-08-02T03:07:50.347 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="fedora" 2023-08-02T03:07:50.347 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8.6" 2023-08-02T03:07:50.347 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2023-08-02T03:07:50.347 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-02T03:07:50.347 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-08-02T03:07:50.347 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-02T03:07:50.348 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.redhat.com/" 2023-08-02T03:07:50.348 INFO:teuthology.orchestra.run.smithi181.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-02T03:07:50.348 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-02T03:07:50.348 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-08-02T03:07:50.348 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-02T03:07:50.348 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-02T03:07:50.348 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-02T03:07:50.349 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-02T03:07:50.349 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2023-08-02T03:07:50.349 DEBUG:teuthology.parallel:result is None 2023-08-02T03:07:50.487 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com 2023-08-02T03:07:50.488 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-02T03:07:50.508 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2023-08-02T03:07:50.508 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-02T03:07:50.525 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server 2023-08-02T03:07:50.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-08-02T03:07:50.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:07:50.592 DEBUG:teuthology.orchestra.run.smithi162:> true 2023-08-02T03:07:50.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-08-02T03:07:50.717 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2023-08-02T03:07:50.773 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2023-08-02T03:07:50.773 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2023-08-02T03:07:50.829 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Red Hat Enterprise Linux" 2023-08-02T03:07:50.830 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8.6 (Ootpa)" 2023-08-02T03:07:50.830 INFO:teuthology.orchestra.run.smithi162.stdout:ID="rhel" 2023-08-02T03:07:50.830 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="fedora" 2023-08-02T03:07:50.830 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8.6" 2023-08-02T03:07:50.830 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8" 2023-08-02T03:07:50.830 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-02T03:07:50.831 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2023-08-02T03:07:50.831 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-02T03:07:50.831 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.redhat.com/" 2023-08-02T03:07:50.831 INFO:teuthology.orchestra.run.smithi162.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-02T03:07:50.831 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-02T03:07:50.831 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-08-02T03:07:50.831 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-02T03:07:50.831 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-02T03:07:50.832 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-02T03:07:50.832 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-02T03:07:50.832 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2023-08-02T03:07:50.849 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2023-08-02T03:07:50.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-08-02T03:07:50.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:07:50.914 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-08-02T03:07:50.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-08-02T03:07:50.984 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2023-08-02T03:07:51.039 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2023-08-02T03:07:51.040 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2023-08-02T03:07:51.095 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Red Hat Enterprise Linux" 2023-08-02T03:07:51.095 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8.6 (Ootpa)" 2023-08-02T03:07:51.096 INFO:teuthology.orchestra.run.smithi181.stdout:ID="rhel" 2023-08-02T03:07:51.096 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="fedora" 2023-08-02T03:07:51.096 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8.6" 2023-08-02T03:07:51.096 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2023-08-02T03:07:51.096 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-02T03:07:51.096 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-08-02T03:07:51.096 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-02T03:07:51.097 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.redhat.com/" 2023-08-02T03:07:51.097 INFO:teuthology.orchestra.run.smithi181.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-02T03:07:51.097 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-02T03:07:51.097 INFO:teuthology.orchestra.run.smithi181.stdout: 2023-08-02T03:07:51.097 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-02T03:07:51.097 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-02T03:07:51.097 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-02T03:07:51.098 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-02T03:07:51.098 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-08-02T03:07:51.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:07:51.191 INFO:teuthology.dispatcher.supervisor:Running job 7358097 2023-08-02T03:07:51.192 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-08-02_02:56:22-orch:cephadm-main-testing-default-smithi/7358097 --name vshankar-2023-08-02_02:56:22-orch:cephadm-main-testing-default-smithi --description orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} -- /home/teuthworker/archive/vshankar-2023-08-02_02:56:22-orch:cephadm-main-testing-default-smithi/7358097/orig.config.yaml 2023-08-02T03:07:51.195 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-08-02_02:56:22-orch:cephadm-main-testing-default-smithi/7358097 2023-08-02T03:07:51.195 INFO:teuthology.dispatcher.supervisor:Job PID: 20201 2023-08-02T03:07:51.196 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-02T03:09:51.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:11:51.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:13:51.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:15:51.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:17:51.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:19:52.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:21:52.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:23:52.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:25:52.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:27:52.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:29:52.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:31:53.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:31:53.241 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-02T03:31:53.338 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-02T03:31:53.339 INFO:teuthology.nuke:Checking targets against current locks 2023-08-02T03:31:53.392 DEBUG:teuthology.nuke:shortname: smithi162 2023-08-02T03:31:53.394 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-02T03:31:53.418 DEBUG:teuthology.nuke:shortname: smithi181 2023-08-02T03:31:53.419 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-02T03:31:53.426 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-02_02:56:22-orch:cephadm-main-testing-default-smithi/7358097', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-02 02:56:59.242901', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-02T03:31:53.454 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-02_02:56:22-orch:cephadm-main-testing-default-smithi/7358097', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-02 02:56:59.244774', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-02T03:31:53.505 INFO:teuthology.orchestra.console.smithi162:Power off 2023-08-02T03:31:53.506 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-02T03:31:53.541 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2023-08-02T03:31:53.542 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T03:31:53.561 INFO:teuthology.orchestra.console.smithi181:Power off 2023-08-02T03:31:53.562 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-02T03:31:53.579 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-08-02T03:31:53.594 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2023-08-02T03:31:53.594 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T03:31:53.626 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2023-08-02T03:31:53.681 INFO:teuthology.orchestra.console.smithi162:Power off completed 2023-08-02T03:31:53.728 INFO:teuthology.orchestra.console.smithi181:Power off completed 2023-08-02T03:31:53.840 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com 2023-08-02T03:31:53.873 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com