2023-07-28T06:50:07.171 INFO:root:teuthology version: 0.0.1.dev165+g3117e89 2023-07-28T06:50:07.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T06:50:07.173 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T06:50:07.363 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f71858601f0>, signals=[15]) 2023-07-28T06:50:07.365 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2023-07-28T06:50:07.365 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2023-07-28T06:50:07.365 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-07-28T06:50:07.392 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2023-07-28T06:50:07.393 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2023-07-28T06:50:07.393 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-28T06:50:07.394 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /host {"name": "smithi022"} 2023-07-28T06:50:07.417 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-07-28T06:50:07.417 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-07-28T06:50:07.418 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-07-28T06:50:07.419 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /host {"name": "smithi026"} 2023-07-28T06:50:07.434 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-07-28T06:50:07.472 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-28T06:50:07.489 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-28T06:50:07.497 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-28T06:50:07.513 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-28T06:50:07.514 DEBUG:teuthology.provision.fog.smithi022:FOG request: PUT /host/128 {"imageID": 5} 2023-07-28T06:50:07.539 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-28T06:50:07.539 DEBUG:teuthology.provision.fog.smithi026:FOG request: PUT /host/131 {"imageID": 5} 2023-07-28T06:50:07.541 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-28T06:50:07.541 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 5} 2023-07-28T06:50:07.559 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of rhel 8.6 2023-07-28T06:50:07.559 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:50:07.599 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6 2023-07-28T06:50:07.599 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:50:07.601 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of rhel 8.6 2023-07-28T06:50:07.601 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-28T06:50:07.621 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /tasktype {"name": "deploy"} 2023-07-28T06:50:07.665 DEBUG:teuthology.provision.fog.smithi022:FOG request: POST /host/128/task {"taskTypeID": 1} 2023-07-28T06:50:07.674 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-07-28T06:50:07.683 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /tasktype {"name": "deploy"} 2023-07-28T06:50:07.709 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-07-28T06:50:07.725 DEBUG:teuthology.provision.fog.smithi026:FOG request: POST /host/131/task {"taskTypeID": 1} 2023-07-28T06:50:07.734 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:50:07.772 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:50:07.783 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-28T06:50:07.857 INFO:teuthology.orchestra.console.smithi022:Power off 2023-07-28T06:50:07.858 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T06:50:07.875 INFO:teuthology.orchestra.console.smithi140:Power off 2023-07-28T06:50:07.876 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T06:50:07.885 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-07-28T06:50:07.886 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:07.898 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-07-28T06:50:07.899 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:07.912 INFO:teuthology.orchestra.console.smithi026:Power off 2023-07-28T06:50:07.913 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T06:50:07.922 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-07-28T06:50:07.923 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-07-28T06:50:07.934 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-07-28T06:50:07.934 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:07.955 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-07-28T06:50:08.024 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-07-28T06:50:08.125 INFO:teuthology.orchestra.console.smithi140:Power on 2023-07-28T06:50:08.125 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-28T06:50:08.146 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On 2023-07-28T06:50:08.146 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:08.168 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-07-28T06:50:11.924 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:11.956 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:12.035 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-07-28T06:50:12.067 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-07-28T06:50:12.169 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:12.280 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-07-28T06:50:16.040 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:16.069 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:16.151 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-07-28T06:50:16.179 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-07-28T06:50:16.280 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-07-28T06:50:16.281 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:16.381 INFO:teuthology.orchestra.console.smithi026:Power on 2023-07-28T06:50:16.381 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-28T06:50:16.391 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-07-28T06:50:16.404 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On 2023-07-28T06:50:16.404 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:16.424 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-07-28T06:50:16.493 INFO:teuthology.orchestra.console.smithi140:Power on completed 2023-07-28T06:50:16.594 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-07-28T06:50:16.594 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:50:20.152 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:20.262 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-07-28T06:50:20.363 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-07-28T06:50:20.426 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:20.464 INFO:teuthology.orchestra.console.smithi022:Power on 2023-07-28T06:50:20.464 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-28T06:50:20.485 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On 2023-07-28T06:50:20.486 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:20.505 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-07-28T06:50:20.534 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-07-28T06:50:20.635 INFO:teuthology.orchestra.console.smithi026:Power on completed 2023-07-28T06:50:20.735 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2023-07-28T06:50:20.736 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-28T06:50:24.508 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:24.617 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-07-28T06:50:28.620 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T06:50:28.729 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-07-28T06:50:28.830 INFO:teuthology.orchestra.console.smithi022:Power on completed 2023-07-28T06:50:28.930 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2023-07-28T06:50:28.931 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:50:31.787 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:50:35.920 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-28T06:50:44.102 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:50:46.960 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:50:51.090 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-28T06:50:59.261 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:51:02.146 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:51:06.252 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-28T06:51:14.435 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:51:17.313 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:51:21.442 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-28T06:51:29.624 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:51:32.496 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:51:36.612 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-28T06:51:44.812 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:51:47.708 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:51:51.787 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-28T06:51:59.982 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:52:02.914 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:52:07.000 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-28T06:52:15.224 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:52:18.154 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:52:22.232 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-28T06:52:30.549 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:52:33.412 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:52:37.478 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-28T06:52:45.766 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:52:48.627 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:52:52.680 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-28T06:52:52.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:52:55.984 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-28T06:53:00.984 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:53:01.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:53:03.849 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:53:05.040 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-28T06:53:11.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:53:14.096 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-28T06:53:16.219 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:53:19.080 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:53:20.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:53:23.152 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-28T06:53:29.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:53:31.431 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:53:32.208 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-28T06:53:34.267 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:53:38.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:53:46.662 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:53:49.470 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:54:01.865 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:54:04.678 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:54:10.033 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-28T06:54:10.034 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-28T06:54:10.349 INFO:teuthology.provision.fog.smithi026:Node is ready 2023-07-28T06:54:10.349 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2023-07-28T06:54:10.367 INFO:teuthology.orchestra.run.smithi026.stdout:smithi022 2023-07-28T06:54:10.367 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi022 /etc/hosts 2023-07-28T06:54:10.424 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-07-28T06:54:10.425 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-28T06:54:10.658 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi022/smithi026/g' /etc/hosts 2023-07-28T06:54:10.699 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.22/172.21.15.26/g' /etc/hosts 2023-07-28T06:54:10.765 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi022/smithi026/g' /etc/hostname 2023-07-28T06:54:10.831 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-28T06:54:10.897 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-28T06:54:10.954 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2023-07-28T06:54:10.954 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)" 2023-07-28T06:54:10.954 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2023-07-28T06:54:10.954 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2023-07-28T06:54:10.954 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6" 2023-07-28T06:54:10.955 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-07-28T06:54:10.955 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-28T06:54:10.955 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-07-28T06:54:10.955 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-28T06:54:10.955 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2023-07-28T06:54:10.955 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-28T06:54:10.955 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-28T06:54:10.956 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-07-28T06:54:10.956 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-28T06:54:10.956 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-28T06:54:10.956 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-28T06:54:10.956 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-28T06:54:10.957 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2023-07-28T06:54:10.958 DEBUG:teuthology.parallel:result is None 2023-07-28T06:54:17.072 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:54:19.877 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:54:32.289 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:54:35.084 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:54:47.477 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:54:50.274 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:55:02.648 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:55:05.467 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:55:17.858 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:55:20.638 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:55:33.020 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:55:35.822 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:55:48.204 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:55:51.004 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:56:03.349 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:56:06.199 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:56:18.522 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:56:21.379 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:56:33.701 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:56:36.552 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:56:48.868 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:56:51.723 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:57:04.044 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:57:06.904 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:57:19.227 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:57:22.048 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:57:34.404 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:57:37.216 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:57:49.564 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-07-28T06:57:49.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:57:52.347 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:58:07.483 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-28T06:58:07.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:58:08.112 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-07-28T06:58:10.675 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T06:58:14.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:58:16.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:58:17.168 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-07-28T06:58:19.760 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T06:58:23.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:58:25.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:58:26.224 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-07-28T06:58:28.819 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T06:58:32.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:58:34.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:58:37.904 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T06:58:43.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:58:46.960 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T06:58:52.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:58:56.016 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T06:59:02.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:59:05.108 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T06:59:11.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:59:29.520 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T06:59:32.231 WARNING:teuthology.provision.fog.smithi022:timed out 2023-07-28T06:59:35.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:59:38.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:59:38.463 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-28T06:59:38.464 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-28T06:59:38.576 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T06:59:38.795 INFO:teuthology.provision.fog.smithi022:Node is ready 2023-07-28T06:59:38.796 DEBUG:teuthology.orchestra.run.smithi022:> hostname 2023-07-28T06:59:38.816 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2023-07-28T06:59:38.816 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2023-07-28T06:59:38.875 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-07-28T06:59:38.876 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-07-28T06:59:39.003 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2023-07-28T06:59:39.035 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2023-07-28T06:59:39.106 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2023-07-28T06:59:39.176 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-07-28T06:59:39.245 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-07-28T06:59:39.303 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2023-07-28T06:59:39.304 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.6 (Ootpa)" 2023-07-28T06:59:39.304 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2023-07-28T06:59:39.304 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2023-07-28T06:59:39.304 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.6" 2023-07-28T06:59:39.305 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-07-28T06:59:39.305 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-28T06:59:39.305 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-07-28T06:59:39.305 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-28T06:59:39.305 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2023-07-28T06:59:39.305 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-28T06:59:39.305 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-28T06:59:39.306 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-07-28T06:59:39.306 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-28T06:59:39.306 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-28T06:59:39.306 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-28T06:59:39.306 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-28T06:59:39.306 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2023-07-28T06:59:39.307 DEBUG:teuthology.parallel:result is None 2023-07-28T06:59:44.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:59:47.664 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T06:59:53.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T06:59:56.720 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:00:02.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:00:05.776 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:00:11.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:00:14.832 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:00:20.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:00:23.888 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:00:29.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:00:32.944 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:00:38.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:00:42.000 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:00:48.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:00:51.060 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:00:57.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:01:00.144 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:01:06.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:01:09.200 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:01:15.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:01:18.260 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:01:24.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:01:27.344 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:01:33.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:01:36.400 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:01:42.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:01:45.456 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:01:51.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:01:54.548 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:02:00.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:02:03.632 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:02:09.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:02:12.692 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:02:18.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:02:21.780 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:02:27.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:02:30.868 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:02:36.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:02:39.952 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:02:45.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:02:49.012 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:02:55.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:02:58.096 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:03:04.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:03:07.152 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:03:13.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:03:16.208 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:03:22.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:03:25.264 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:03:31.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:03:34.320 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:03:40.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:03:43.376 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:03:49.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:03:52.432 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:03:58.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:04:01.492 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:04:07.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:04:10.580 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:04:16.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:04:19.668 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:04:25.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:04:28.752 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:04:34.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:04:37.808 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:04:43.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:04:46.864 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:04:52.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:04:55.924 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:05:01.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:05:05.012 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:05:11.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:05:14.100 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:05:20.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:05:23.188 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:05:29.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:05:32.272 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:05:38.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:05:41.328 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:05:47.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:05:50.384 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:05:56.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:05:59.440 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:06:05.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:06:08.500 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:06:14.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:06:17.584 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:06:23.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:06:26.640 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:06:32.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:06:35.707 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:06:41.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:06:44.784 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:06:50.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:06:53.872 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:06:59.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:07:02.928 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:07:08.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:07:12.020 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:07:18.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:07:21.104 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:07:27.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:07:30.164 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:07:36.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:07:39.248 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:07:45.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:07:48.304 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:07:54.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:07:57.364 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:08:03.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:08:06.448 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:08:12.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:08:15.504 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:08:21.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:08:24.560 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:08:30.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:08:33.623 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:08:39.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:08:42.704 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:08:48.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:08:51.760 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:08:57.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:09:00.820 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:09:06.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:09:09.904 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:09:15.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:09:18.992 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:09:24.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:09:28.048 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:09:34.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:09:37.104 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:09:43.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:09:46.160 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:09:52.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:09:55.252 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:10:01.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:10:04.336 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:10:10.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:10:13.392 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:10:19.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:10:22.480 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:10:28.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:10:31.536 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:10:37.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:10:40.592 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:10:46.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:10:49.653 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:10:55.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:10:58.736 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:11:04.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:11:07.796 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:11:13.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:11:16.880 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:11:22.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:11:25.936 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:11:31.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:11:34.992 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:11:40.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:11:44.048 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:11:50.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:11:53.136 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:11:59.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:12:02.192 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:12:08.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:12:11.248 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:12:17.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:12:20.304 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:12:26.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:12:29.364 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:12:35.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:12:38.448 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:12:44.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:12:47.504 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:12:53.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:12:56.560 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:13:02.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:13:05.616 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:13:11.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:13:14.672 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:13:20.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-28T07:13:23.764 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-28T07:13:23.766 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-07-28T07:13:23.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-28T07:13:23.769 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-28T07:13:23.851 INFO:teuthology.nuke:Checking targets against current locks 2023-07-28T07:13:23.903 DEBUG:teuthology.nuke:shortname: smithi022 2023-07-28T07:13:23.903 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-28T07:13:23.929 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-28_06:48:51-fs-wip-vshankar-testing-20230727.111459-testing-default-smithi/7354921', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-28 06:50:04.454950', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAII4U6ItCfOdoN1WdROC3KO40lcw/kzXeIM8M8q950kfL'} 2023-07-28T07:13:23.935 DEBUG:teuthology.nuke:shortname: smithi026 2023-07-28T07:13:23.935 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-28T07:13:23.959 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-28_06:48:51-fs-wip-vshankar-testing-20230727.111459-testing-default-smithi/7354921', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-28 06:50:04.457058', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4g+WaEN8bWQpvokAzwYKlvZFdknzbJQu2ci/95MENIBsukaEmiqMrkU4DWSL0xwMyfvPWUg0sr7ygVP/vQC1hxddCwiZWGHq+tFFpT1EDfaWq7E+EkytWMnQtoTZ3ouxIhsdRz4nKFeSuawrGZTLqtVkXch+UtOe7vEd/6cJNZV0ny1O+EqWtD9er+duiEIVyMZHYmLkZ2tehvKulnJxbx4GhdNeVvATFOmnQhVjVRUOAdsDe2alYalTFtWAuyrtln4HCThUicsUDeQOufJ4LWWzYzK/hs6W0zXaiAD8oI1TcuSNp60FGtZ2+b8F7xmUsVFf57XY0icYWZMBMzDrzWVOaEPSMATMFSx+kV+qQplQvS/KJCEg9sAPFAYFh9F2QeFzQtN5IMSXTGirSxwCD2rOwiR5C8kU+fRKs5vqWsWOxLHtuP2A2bURs7CSkn+YL4cOgr918PC79t3r0Z5j9QwRve9IQmn9WqpO9uJqYHWVnLVYc6PQtHNSYATPPKF8='} 2023-07-28T07:13:23.963 DEBUG:teuthology.nuke:shortname: smithi140 2023-07-28T07:13:23.963 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-28T07:13:23.984 INFO:teuthology.orchestra.console.smithi022:Power off 2023-07-28T07:13:23.985 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T07:13:23.996 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-28_06:48:51-fs-wip-vshankar-testing-20230727.111459-testing-default-smithi/7354921', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-28 06:50:04.459003', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF0nNb1nH5XjZpJ8YQCrYVFxOSaX/bhMdJHp1YgLSSfg'} 2023-07-28T07:13:24.011 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-07-28T07:13:24.012 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T07:13:24.030 INFO:teuthology.orchestra.console.smithi026:Power off 2023-07-28T07:13:24.031 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T07:13:24.045 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-07-28T07:13:24.054 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-07-28T07:13:24.055 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T07:13:24.077 INFO:teuthology.orchestra.console.smithi140:Power off 2023-07-28T07:13:24.077 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-28T07:13:24.087 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-07-28T07:13:24.100 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-07-28T07:13:24.101 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T07:13:24.126 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-07-28T07:13:28.049 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T07:13:28.089 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T07:13:28.127 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T07:13:28.161 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-07-28T07:13:28.206 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-07-28T07:13:28.238 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-07-28T07:13:32.164 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T07:13:32.207 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T07:13:32.240 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T07:13:32.277 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-07-28T07:13:32.318 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-07-28T07:13:32.350 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-07-28T07:13:32.378 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-07-28T07:13:32.419 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-07-28T07:13:32.547 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com 2023-07-28T07:13:32.572 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com 2023-07-28T07:13:36.354 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-28T07:13:36.467 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-07-28T07:13:36.568 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-07-28T07:13:36.730 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-07-28T07:13:37.151 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds