2023-08-30T12:54:05.387 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-30T12:54:05.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T12:54:05.514 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f63db615820>, signals=[15]) 2023-08-30T12:54:05.515 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2023-08-30T12:54:05.516 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T12:54:05.516 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-08-30T12:54:05.536 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-08-30T12:54:05.537 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T12:54:05.537 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-08-30T12:54:05.539 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /host {"name": "smithi090"} 2023-08-30T12:54:05.560 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"} 2023-08-30T12:54:05.606 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-30T12:54:05.620 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-30T12:54:05.643 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_8.stream (ID 3) 2023-08-30T12:54:05.643 DEBUG:teuthology.provision.fog.smithi090:FOG request: PUT /host/195 {"imageID": 3} 2023-08-30T12:54:05.659 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_centos_8.stream (ID 3) 2023-08-30T12:54:05.659 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 3} 2023-08-30T12:54:05.684 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 8.stream 2023-08-30T12:54:05.685 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:54:05.699 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 8.stream 2023-08-30T12:54:05.699 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:54:05.747 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T12:54:05.754 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T12:54:05.779 DEBUG:teuthology.provision.fog.smithi090:FOG request: POST /host/195/task {"taskTypeID": 1} 2023-08-30T12:54:05.788 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1} 2023-08-30T12:54:05.841 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:54:05.885 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:54:05.943 INFO:teuthology.orchestra.console.smithi123:Power off 2023-08-30T12:54:05.944 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T12:54:05.963 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-08-30T12:54:05.964 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T12:54:05.985 INFO:teuthology.orchestra.console.smithi090:Power off 2023-08-30T12:54:05.986 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T12:54:05.994 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-08-30T12:54:06.005 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2023-08-30T12:54:06.006 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T12:54:06.025 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-08-30T12:54:06.095 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-08-30T12:54:06.127 INFO:teuthology.orchestra.console.smithi090:Power off completed 2023-08-30T12:54:06.196 INFO:teuthology.orchestra.console.smithi123:Power on 2023-08-30T12:54:06.197 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T12:54:06.216 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On 2023-08-30T12:54:06.217 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T12:54:06.228 INFO:teuthology.orchestra.console.smithi090:Power on 2023-08-30T12:54:06.228 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T12:54:06.236 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-08-30T12:54:06.248 DEBUG:teuthology.orchestra.console.smithi090:power on output: Chassis Power Control: Up/On 2023-08-30T12:54:06.248 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T12:54:06.269 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-08-30T12:54:10.238 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T12:54:10.270 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T12:54:10.346 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-08-30T12:54:10.378 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-08-30T12:54:14.350 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T12:54:14.378 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T12:54:14.459 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-08-30T12:54:14.488 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2023-08-30T12:54:14.561 INFO:teuthology.orchestra.console.smithi123:Power on completed 2023-08-30T12:54:14.589 INFO:teuthology.orchestra.console.smithi090:Power on completed 2023-08-30T12:54:14.662 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-08-30T12:54:14.663 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:54:14.690 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2023-08-30T12:54:14.691 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:54:29.858 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:54:29.880 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:54:45.121 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:54:45.141 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:55:00.356 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:55:00.358 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:55:15.597 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:55:15.599 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:55:30.820 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:55:30.841 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:55:46.100 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:55:46.101 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:56:01.345 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:56:01.347 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:56:17.302 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:56:17.473 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:56:34.074 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:56:34.239 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:56:49.522 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:56:49.691 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:57:04.838 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:57:05.165 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:57:20.118 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:57:20.439 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:57:36.430 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:57:36.515 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:57:53.476 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:57:53.971 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:58:10.466 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:58:10.817 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:58:26.275 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:58:27.112 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:58:41.558 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:58:42.431 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:58:56.911 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:58:57.632 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:59:12.794 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:59:13.489 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-30T12:59:13.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T12:59:16.794 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-30T12:59:22.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T12:59:25.882 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-30T12:59:28.134 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:59:31.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T12:59:34.938 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-30T12:59:40.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T12:59:43.709 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:59:44.026 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-30T12:59:50.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T12:59:53.114 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-30T12:59:59.050 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T12:59:59.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:00:02.170 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-30T13:00:08.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:00:11.226 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-30T13:00:14.323 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T13:00:17.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:00:20.282 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-30T13:00:26.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:00:29.569 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T13:00:44.822 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T13:01:00.015 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T13:01:15.236 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T13:01:26.298 WARNING:teuthology.provision.fog.smithi090:timed out 2023-08-30T13:01:30.395 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T13:01:32.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:01:32.575 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T13:01:32.576 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T13:01:32.935 INFO:teuthology.provision.fog.smithi090:Node is ready 2023-08-30T13:01:32.935 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2023-08-30T13:01:32.953 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2023-08-30T13:01:32.953 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2023-08-30T13:01:33.012 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2023-08-30T13:01:33.012 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-08-30T13:01:33.161 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2023-08-30T13:01:33.190 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2023-08-30T13:01:33.259 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2023-08-30T13:01:33.327 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-08-30T13:01:33.393 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-08-30T13:01:33.452 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2023-08-30T13:01:33.452 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8" 2023-08-30T13:01:33.452 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2023-08-30T13:01:33.452 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2023-08-30T13:01:33.453 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8" 2023-08-30T13:01:33.453 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-08-30T13:01:33.453 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T13:01:33.453 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-08-30T13:01:33.453 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T13:01:33.454 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2023-08-30T13:01:33.454 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T13:01:33.454 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T13:01:33.454 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T13:01:33.455 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2023-08-30T13:01:33.456 DEBUG:teuthology.parallel:result is None 2023-08-30T13:01:45.560 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T13:02:00.701 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-30T13:02:00.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:02:03.866 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-08-30T13:02:09.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:02:12.925 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-08-30T13:02:18.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:02:22.010 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-08-30T13:02:28.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:02:31.070 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-08-30T13:02:37.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:02:40.154 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-08-30T13:02:46.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:02:49.210 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-08-30T13:02:55.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:02:58.298 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-08-30T13:03:04.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:04:04.366 WARNING:teuthology.provision.fog.smithi123:timed out 2023-08-30T13:04:10.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:04:10.637 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T13:04:10.637 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T13:04:10.877 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-08-30T13:04:10.878 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-08-30T13:04:10.899 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2023-08-30T13:04:10.899 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts 2023-08-30T13:04:10.959 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-08-30T13:04:10.960 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-08-30T13:04:11.068 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts 2023-08-30T13:04:11.100 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2023-08-30T13:04:11.170 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname 2023-08-30T13:04:11.240 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-08-30T13:04:11.308 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-08-30T13:04:11.367 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2023-08-30T13:04:11.367 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8" 2023-08-30T13:04:11.368 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2023-08-30T13:04:11.368 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2023-08-30T13:04:11.368 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8" 2023-08-30T13:04:11.368 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-08-30T13:04:11.368 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T13:04:11.369 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-08-30T13:04:11.369 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T13:04:11.369 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2023-08-30T13:04:11.369 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T13:04:11.369 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T13:04:11.370 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T13:04:11.370 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-08-30T13:04:11.370 DEBUG:teuthology.parallel:result is None 2023-08-30T13:04:11.520 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2023-08-30T13:04:11.520 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T13:04:11.540 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-08-30T13:04:11.541 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T13:04:11.558 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2023-08-30T13:04:11.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-08-30T13:04:11.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:04:11.628 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-08-30T13:04:11.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-08-30T13:04:11.722 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2023-08-30T13:04:11.781 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2023-08-30T13:04:11.781 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-08-30T13:04:11.839 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2023-08-30T13:04:11.839 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8" 2023-08-30T13:04:11.839 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2023-08-30T13:04:11.840 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2023-08-30T13:04:11.840 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8" 2023-08-30T13:04:11.840 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-08-30T13:04:11.840 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T13:04:11.840 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-08-30T13:04:11.841 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T13:04:11.841 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2023-08-30T13:04:11.841 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T13:04:11.841 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T13:04:11.841 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T13:04:11.842 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-08-30T13:04:11.865 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-08-30T13:04:11.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-08-30T13:04:11.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:04:11.934 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-08-30T13:04:12.005 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-08-30T13:04:12.006 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-08-30T13:04:12.065 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-08-30T13:04:12.065 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-08-30T13:04:12.124 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2023-08-30T13:04:12.125 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8" 2023-08-30T13:04:12.125 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2023-08-30T13:04:12.125 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2023-08-30T13:04:12.125 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8" 2023-08-30T13:04:12.125 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-08-30T13:04:12.126 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T13:04:12.126 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-08-30T13:04:12.126 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T13:04:12.126 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2023-08-30T13:04:12.126 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T13:04:12.126 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T13:04:12.127 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T13:04:12.127 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-08-30T13:04:12.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:04:12.235 INFO:teuthology.dispatcher.supervisor:Running job 7384140 2023-08-30T13:04:12.236 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-08-30_12:53:13-orch:cephadm-main-testing-default-smithi/7384140 --name vshankar-2023-08-30_12:53:13-orch:cephadm-main-testing-default-smithi --description orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} -- /home/teuthworker/archive/vshankar-2023-08-30_12:53:13-orch:cephadm-main-testing-default-smithi/7384140/orig.config.yaml 2023-08-30T13:04:12.238 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-08-30_12:53:13-orch:cephadm-main-testing-default-smithi/7384140 2023-08-30T13:04:12.239 INFO:teuthology.dispatcher.supervisor:Job PID: 299332 2023-08-30T13:04:12.239 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T13:06:12.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:08:12.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:10:12.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:12:12.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:14:13.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:16:13.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:18:13.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:20:13.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:22:13.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:24:13.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:26:14.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:28:14.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:30:14.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:32:14.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:34:14.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:36:14.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:38:15.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:40:15.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:40:15.337 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T13:40:15.432 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T13:40:15.433 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T13:40:15.481 DEBUG:teuthology.nuke:shortname: smithi090 2023-08-30T13:40:15.481 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T13:40:15.508 DEBUG:teuthology.nuke:shortname: smithi123 2023-08-30T13:40:15.508 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T13:40:15.512 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-30_12:53:13-orch:cephadm-main-testing-default-smithi/7384140', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 12:54:04.638923', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD4tWWpcUa21Sl81VIYkRT/Lkfw5P6AowKutoQM00HqsCOa2URfjlRBSSLPAFeWl6CvwJBhoHjgd+SsmAm5hCQg1PhiG27WQG6F30vz+9fvI5bBOqEc8P1j1PzTmmGe227eJtBf9anLseHYyLiwKd12e9y1F50wme45VyDY0D41+O4PIxLPjarVrL161AQQYGvLnvSBCGiv/GQGNPYhf7XCwd1Y/G607DmZz5j4k3KZW3rsgE2HWBlsKrxLSRnP+GT9/WR0EOkI/Ii0ohWvZkOtCOjl/C+Fks/TqPaq54Za5Bf1LSE0CgCLFJeFB9ct+29fA7fdRO5yzHx0580bjB6BzBTXmiYvC32I0XTY5CL5sf8t9r3gDAzj5fqques/WjyWJd6eVJWn0xLP4hMr579gxV4JiCawY+9vNWr3KeMqEOxGIF/xQMREj7XkceuXS4DxCvnQUYCJnJPwR8N2UPCa8p6/De3255gZBjx3pIXBcvN8rt6ZVWjuNyQQd45ATU='} 2023-08-30T13:40:15.535 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-30_12:53:13-orch:cephadm-main-testing-default-smithi/7384140', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 12:54:04.640717', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7uUP9beUUTOHeThniqFJ6+H/J30WEyqI228ooMSY8yM9tQ7i+ZwUj5fDXLpyKev4jeESwEyHTjIwqdoN6Dzun4DHllEtwivJ/MrlKZsjUMJupNMn6pt4Pc2g1ZvJQKnq3FbmN4la80ZCq/0zENxLiKBc5x/PQmVVmie6KlD464sRDjl9CGx2wyo0jUpHkXkfThdx8Xu88mONBfkNijEazuWTlQzblzRlhwiBDHBaPFc0bvC2CK0Z87ut/yRmv6gqrQO0/jZg3TrXxf7QBK6SgBtDNnEKyG8jdxMRaV7Co8LObDCCjzwmPLleyCKNIh8VEjIKZmvhlFaBxhYZ7Z/jOVqdiUCMvNGDrKqCTvi7n+6f6lnh6IZX8vXYOgzS5l4VoArX79RbZ3MQZU/JcbCb46r30a0pGYPH4/XuY4xGHSHmoGg/vA0FBsiCwEYAzMrFecoHDwYHbbpmO/kLbgGcr79FVxfUd3XHNuLXtSXuSYahib7S0xnbzP8xtb1teg90='} 2023-08-30T13:40:15.551 INFO:teuthology.orchestra.console.smithi090:Power off 2023-08-30T13:40:15.552 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T13:40:15.572 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2023-08-30T13:40:15.572 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T13:40:15.588 INFO:teuthology.orchestra.console.smithi123:Power off 2023-08-30T13:40:15.589 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T13:40:15.597 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-08-30T13:40:15.608 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-08-30T13:40:15.609 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T13:40:15.627 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-08-30T13:40:15.698 INFO:teuthology.orchestra.console.smithi090:Power off completed 2023-08-30T13:40:15.729 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-08-30T13:40:15.845 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com 2023-08-30T13:40:15.879 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com