2023-09-16T14:24:38.291 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-16T14:24:38.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T14:24:38.410 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe6047ffee0>, signals=[15]) 2023-09-16T14:24:38.411 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-09-16T14:24:38.411 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-09-16T14:24:38.412 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-09-16T14:24:38.435 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging 2023-09-16T14:24:38.435 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server 2023-09-16T14:24:38.436 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-09-16T14:24:38.437 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"} 2023-09-16T14:24:38.460 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /host {"name": "smithi184"} 2023-09-16T14:24:38.504 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-16T14:24:38.519 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-16T14:24:38.555 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_8.stream (ID 3) 2023-09-16T14:24:38.555 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 3} 2023-09-16T14:24:38.559 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_centos_8.stream (ID 3) 2023-09-16T14:24:38.559 DEBUG:teuthology.provision.fog.smithi184:FOG request: PUT /host/289 {"imageID": 3} 2023-09-16T14:24:38.604 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 8.stream 2023-09-16T14:24:38.605 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:24:38.608 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of centos 8.stream 2023-09-16T14:24:38.608 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:24:38.734 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"} 2023-09-16T14:24:38.739 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /tasktype {"name": "deploy"} 2023-09-16T14:24:38.784 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1} 2023-09-16T14:24:38.787 DEBUG:teuthology.provision.fog.smithi184:FOG request: POST /host/289/task {"taskTypeID": 1} 2023-09-16T14:24:38.839 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:24:38.850 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:24:39.018 INFO:teuthology.orchestra.console.smithi184:Power off 2023-09-16T14:24:39.019 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T14:24:39.029 INFO:teuthology.orchestra.console.smithi064:Power off 2023-09-16T14:24:39.030 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T14:24:39.038 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-09-16T14:24:39.038 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T14:24:39.050 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-09-16T14:24:39.051 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T14:24:39.061 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-09-16T14:24:39.070 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-09-16T14:24:43.066 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T14:24:43.072 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T14:24:43.174 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-09-16T14:24:43.180 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-09-16T14:24:47.180 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T14:24:47.186 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T14:24:47.289 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-09-16T14:24:47.294 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-09-16T14:24:47.390 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-09-16T14:24:47.491 INFO:teuthology.orchestra.console.smithi184:Power on 2023-09-16T14:24:47.492 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-16T14:24:47.512 DEBUG:teuthology.orchestra.console.smithi184:power on output: Chassis Power Control: Up/On 2023-09-16T14:24:47.512 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T14:24:47.532 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-09-16T14:24:51.298 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T14:24:51.406 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-09-16T14:24:51.506 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-09-16T14:24:51.534 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T14:24:51.609 INFO:teuthology.orchestra.console.smithi064:Power on 2023-09-16T14:24:51.609 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-16T14:24:51.631 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2023-09-16T14:24:51.632 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T14:24:51.642 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-09-16T14:24:51.651 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-09-16T14:24:55.646 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T14:24:55.652 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T14:24:55.754 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-09-16T14:24:55.759 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-09-16T14:24:55.856 INFO:teuthology.orchestra.console.smithi184:Power on completed 2023-09-16T14:24:55.861 INFO:teuthology.orchestra.console.smithi064:Power on completed 2023-09-16T14:24:55.957 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2023-09-16T14:24:55.958 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:24:55.961 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-09-16T14:24:55.961 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:25:11.182 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:25:11.183 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:25:26.410 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:25:26.414 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:25:41.611 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:25:41.613 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:25:56.888 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:25:56.890 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:26:12.100 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:26:12.102 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:26:27.354 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:26:27.360 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:26:42.611 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:26:42.612 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:26:57.911 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:26:57.913 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:27:13.247 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:27:13.251 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:27:29.398 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:27:29.399 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:27:45.595 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:27:45.605 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:28:00.896 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:28:00.900 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:28:16.191 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:28:16.193 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:28:31.547 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:28:31.549 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-09-16T14:28:31.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:28:35.034 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-09-16T14:28:41.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:28:44.122 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-09-16T14:28:47.020 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:28:50.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:28:53.178 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-09-16T14:28:59.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:29:02.234 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-09-16T14:29:02.374 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:29:08.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:29:11.322 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-09-16T14:29:17.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:29:17.767 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:29:20.410 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-09-16T14:29:26.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:29:33.142 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:29:48.462 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:30:03.725 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:30:19.026 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:30:26.426 WARNING:teuthology.provision.fog.smithi184:timed out 2023-09-16T14:30:32.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:30:32.679 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-16T14:30:32.679 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-16T14:30:32.917 INFO:teuthology.provision.fog.smithi184:Node is ready 2023-09-16T14:30:32.918 DEBUG:teuthology.orchestra.run.smithi184:> hostname 2023-09-16T14:30:32.977 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com 2023-09-16T14:30:32.977 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184.front.sepia.ceph.com /etc/hosts 2023-09-16T14:30:33.037 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184 2023-09-16T14:30:33.038 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-09-16T14:30:33.139 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hosts 2023-09-16T14:30:33.170 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts 2023-09-16T14:30:33.240 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hostname 2023-09-16T14:30:33.310 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-09-16T14:30:33.378 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-09-16T14:30:33.437 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2023-09-16T14:30:33.437 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8" 2023-09-16T14:30:33.437 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2023-09-16T14:30:33.438 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2023-09-16T14:30:33.438 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8" 2023-09-16T14:30:33.438 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-09-16T14:30:33.438 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-16T14:30:33.438 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-09-16T14:30:33.439 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-16T14:30:33.439 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2023-09-16T14:30:33.439 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T14:30:33.439 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T14:30:33.439 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-16T14:30:33.440 INFO:teuthology.provision.fog.smithi184:Deploy complete! 2023-09-16T14:30:33.441 DEBUG:teuthology.parallel:result is None 2023-09-16T14:30:34.276 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:30:49.571 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:31:04.751 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:31:19.945 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:31:35.114 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:31:50.262 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:32:05.398 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:32:20.526 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-16T14:32:20.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:32:23.710 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-16T14:32:29.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:32:32.794 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-16T14:32:38.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:32:41.850 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-16T14:32:47.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:32:50.910 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-16T14:32:56.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:32:59.998 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-16T14:33:06.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:33:09.082 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-16T14:33:15.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:33:25.402 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-16T14:33:31.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:33:34.458 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-16T14:33:40.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:33:43.514 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-16T14:33:49.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:33:49.686 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-16T14:33:49.686 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-16T14:34:09.460 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-09-16T14:34:09.460 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2023-09-16T14:34:09.485 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2023-09-16T14:34:09.486 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2023-09-16T14:34:09.547 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-09-16T14:34:09.547 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-09-16T14:34:09.672 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2023-09-16T14:34:09.704 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2023-09-16T14:34:09.775 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2023-09-16T14:34:09.846 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-09-16T14:34:09.914 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-09-16T14:34:09.973 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-09-16T14:34:09.974 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8" 2023-09-16T14:34:09.974 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-09-16T14:34:09.974 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-09-16T14:34:09.974 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8" 2023-09-16T14:34:09.975 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-09-16T14:34:09.975 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-16T14:34:09.975 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-09-16T14:34:09.975 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-16T14:34:09.976 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-09-16T14:34:09.976 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T14:34:09.976 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T14:34:09.976 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-16T14:34:09.976 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-09-16T14:34:09.977 DEBUG:teuthology.parallel:result is None 2023-09-16T14:34:10.165 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2023-09-16T14:34:10.166 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-16T14:34:10.185 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com 2023-09-16T14:34:10.186 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-16T14:34:10.203 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2023-09-16T14:34:10.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-09-16T14:34:10.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:34:10.272 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-09-16T14:34:10.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-09-16T14:34:10.298 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-09-16T14:34:10.357 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-09-16T14:34:10.357 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-09-16T14:34:10.415 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-09-16T14:34:10.415 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8" 2023-09-16T14:34:10.415 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-09-16T14:34:10.416 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-09-16T14:34:10.416 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8" 2023-09-16T14:34:10.416 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-09-16T14:34:10.416 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-16T14:34:10.416 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-09-16T14:34:10.417 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-16T14:34:10.417 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-09-16T14:34:10.417 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T14:34:10.417 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T14:34:10.417 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-16T14:34:10.418 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-09-16T14:34:10.436 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server 2023-09-16T14:34:10.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-09-16T14:34:10.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-16T14:34:10.506 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-09-16T14:34:10.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-09-16T14:34:10.645 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-09-16T14:34:10.704 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-09-16T14:34:10.704 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-09-16T14:34:10.762 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2023-09-16T14:34:10.762 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8" 2023-09-16T14:34:10.763 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2023-09-16T14:34:10.763 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2023-09-16T14:34:10.763 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8" 2023-09-16T14:34:10.763 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-09-16T14:34:10.763 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-16T14:34:10.764 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-09-16T14:34:10.764 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-16T14:34:10.764 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2023-09-16T14:34:10.764 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-16T14:34:10.764 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-16T14:34:10.766 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-16T14:34:10.766 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-09-16T14:34:10.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T14:34:10.891 INFO:teuthology.dispatcher.supervisor:Running job 7397228 2023-09-16T14:34:10.892 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi/7397228 --name teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi/7397228/orig.config.yaml 2023-09-16T14:34:10.895 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi/7397228 2023-09-16T14:34:10.896 INFO:teuthology.dispatcher.supervisor:Job PID: 3469699 2023-09-16T14:34:10.896 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-16T14:36:10.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T14:38:11.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T14:40:11.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T14:42:11.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T14:44:11.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T14:46:11.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T14:48:12.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T14:50:12.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T14:52:12.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T14:54:12.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T14:56:12.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T14:58:12.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:00:12.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:02:13.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:04:13.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:06:13.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:08:13.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:10:13.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:12:13.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:14:14.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:16:14.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:18:14.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:20:14.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:22:14.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:24:14.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:26:15.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:28:15.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:30:15.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:32:15.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:34:15.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:36:15.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:38:16.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:40:16.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:42:16.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:44:16.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:46:16.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:48:16.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:50:17.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:52:17.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:54:17.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:56:17.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T15:58:17.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:00:17.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:02:17.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:04:18.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:06:18.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:08:18.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-16T16:08:18.583 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-16T16:08:18.780 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-16T16:08:18.780 INFO:teuthology.nuke:Checking targets against current locks 2023-09-16T16:08:18.832 DEBUG:teuthology.nuke:shortname: smithi064 2023-09-16T16:08:18.832 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-16T16:08:18.858 DEBUG:teuthology.nuke:shortname: smithi184 2023-09-16T16:08:18.858 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-16T16:08:18.862 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi/7397228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-16 14:24:37.515910', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOIBCn5sYJxaBHR3z8V3ibh+72Zj5vb+TRcKxr0/bNnNiyI9qI/XYBHoruhIpI8s0mHWFNPb+S+SmILXsJHpBRQ='} 2023-09-16T16:08:18.883 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:quincy-x-reef-distro-default-smithi/7397228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-16 14:24:37.514390', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAwNONVI0wxdKaeE39Iug4PSPk6CB9P/ALyDUg/OqobmvhoHYhMsAuUWj39LDxvwjXvEswGKNzpGz4SGEobTwSw='} 2023-09-16T16:08:18.917 INFO:teuthology.orchestra.console.smithi064:Power off 2023-09-16T16:08:18.918 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T16:08:18.942 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-09-16T16:08:18.943 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:08:18.960 INFO:teuthology.orchestra.console.smithi184:Power off 2023-09-16T16:08:18.961 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-16T16:08:18.970 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-09-16T16:08:18.996 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-09-16T16:08:18.997 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-16T16:08:19.024 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-09-16T16:08:19.071 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-09-16T16:08:19.126 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-09-16T16:08:19.225 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-09-16T16:08:19.273 INFO:teuthology.lock.ops:unlocked: smithi184.front.sepia.ceph.com