2023-08-02T02:56:56.290 INFO:root:teuthology version: 0.0.1.dev174+g10753fd 2023-08-02T02:56:56.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T02:56:56.424 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd971b4cee0>, signals=[15]) 2023-08-02T02:56:56.426 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2023-08-02T02:56:56.427 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2023-08-02T02:56:56.427 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-08-02T02:56:56.445 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-08-02T02:56:56.446 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-08-02T02:56:56.446 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-08-02T02:56:56.447 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /host {"name": "smithi055"} 2023-08-02T02:56:56.470 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /host {"name": "smithi190"} 2023-08-02T02:56:56.513 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-02T02:56:56.531 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-02T02:56:56.548 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_centos_8.stream (ID 3) 2023-08-02T02:56:56.548 DEBUG:teuthology.provision.fog.smithi055:FOG request: PUT /host/160 {"imageID": 3} 2023-08-02T02:56:56.580 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_centos_8.stream (ID 3) 2023-08-02T02:56:56.580 DEBUG:teuthology.provision.fog.smithi190:FOG request: PUT /host/295 {"imageID": 3} 2023-08-02T02:56:56.594 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of centos 8.stream 2023-08-02T02:56:56.594 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T02:56:56.631 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of centos 8.stream 2023-08-02T02:56:56.631 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T02:56:56.766 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /tasktype {"name": "deploy"} 2023-08-02T02:56:56.774 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /tasktype {"name": "deploy"} 2023-08-02T02:56:56.811 DEBUG:teuthology.provision.fog.smithi055:FOG request: POST /host/160/task {"taskTypeID": 1} 2023-08-02T02:56:56.821 DEBUG:teuthology.provision.fog.smithi190:FOG request: POST /host/295/task {"taskTypeID": 1} 2023-08-02T02:56:56.855 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T02:56:56.874 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T02:56:57.043 INFO:teuthology.orchestra.console.smithi055:Power off 2023-08-02T02:56:57.044 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-02T02:56:57.057 INFO:teuthology.orchestra.console.smithi190:Power off 2023-08-02T02:56:57.058 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-02T02:56:57.067 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2023-08-02T02:56:57.068 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T02:56:57.081 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-08-02T02:56:57.082 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T02:56:57.090 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2023-08-02T02:56:57.100 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-08-02T02:56:57.192 INFO:teuthology.orchestra.console.smithi055:Power off completed 2023-08-02T02:56:57.201 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-08-02T02:56:57.293 INFO:teuthology.orchestra.console.smithi055:Power on 2023-08-02T02:56:57.293 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-02T02:56:57.302 INFO:teuthology.orchestra.console.smithi190:Power on 2023-08-02T02:56:57.303 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-02T02:56:57.314 DEBUG:teuthology.orchestra.console.smithi055:power on output: Chassis Power Control: Up/On 2023-08-02T02:56:57.314 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T02:56:57.325 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2023-08-02T02:56:57.326 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T02:56:57.340 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2023-08-02T02:56:57.347 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-08-02T02:57:01.344 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T02:57:01.351 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T02:57:01.454 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2023-08-02T02:57:01.463 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-08-02T02:57:01.555 INFO:teuthology.orchestra.console.smithi055:Power on completed 2023-08-02T02:57:01.656 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2023-08-02T02:57:01.656 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T02:57:05.468 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T02:57:05.578 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-08-02T02:57:05.679 INFO:teuthology.orchestra.console.smithi190:Power on completed 2023-08-02T02:57:05.779 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-08-02T02:57:05.780 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T02:57:16.865 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T02:57:21.026 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T02:57:32.063 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T02:57:36.214 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T02:57:47.267 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T02:57:51.400 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T02:58:02.484 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T02:58:06.626 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T02:58:17.706 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T02:58:21.813 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T02:58:32.979 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T02:58:37.050 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T02:58:48.264 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T02:58:52.305 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T02:59:03.524 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T02:59:07.624 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T02:59:18.836 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T02:59:22.960 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T02:59:34.154 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T02:59:38.243 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T02:59:49.436 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T02:59:53.512 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:00:04.724 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:00:08.806 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:00:19.999 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:00:24.167 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:00:35.307 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:00:39.464 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:00:50.572 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:00:54.736 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:01:05.830 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:01:10.005 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:01:21.077 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:01:25.252 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:01:36.347 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:01:40.525 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:01:51.617 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:01:55.765 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:02:06.907 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:02:11.032 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:02:22.174 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:02:26.328 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:02:37.468 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:02:41.616 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:02:52.760 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:02:56.899 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:03:08.023 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:03:12.151 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:03:23.258 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:03:27.401 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:03:38.524 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:03:42.635 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:03:53.740 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:03:57.879 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:04:08.904 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:04:13.101 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:04:24.078 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:04:28.329 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:04:39.292 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:04:43.554 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:04:54.514 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:04:58.742 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:05:09.724 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:05:13.960 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:05:24.914 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:05:29.132 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:05:40.095 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:05:44.255 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:05:55.284 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-08-02T03:05:55.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:05:58.512 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-08-02T03:05:59.423 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:06:04.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:06:07.568 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-08-02T03:06:13.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:06:14.534 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:06:16.624 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-08-02T03:06:22.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:06:25.680 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-08-02T03:06:29.648 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:06:31.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:06:34.736 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-08-02T03:06:40.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:06:44.790 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:06:59.947 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:07:15.100 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:07:30.241 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:07:40.752 WARNING:teuthology.provision.fog.smithi055:timed out 2023-08-02T03:07:45.355 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:07:46.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:07:47.047 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-02T03:07:47.047 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-02T03:07:47.313 INFO:teuthology.provision.fog.smithi055:Node is ready 2023-08-02T03:07:47.314 DEBUG:teuthology.orchestra.run.smithi055:> hostname 2023-08-02T03:07:47.333 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2023-08-02T03:07:47.333 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi055.front.sepia.ceph.com /etc/hosts 2023-08-02T03:07:47.392 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2023-08-02T03:07:47.393 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2023-08-02T03:07:47.511 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hosts 2023-08-02T03:07:47.541 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.55/172.21.15.55/g' /etc/hosts 2023-08-02T03:07:47.611 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hostname 2023-08-02T03:07:47.680 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2023-08-02T03:07:47.748 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-08-02T03:07:47.806 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2023-08-02T03:07:47.807 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8" 2023-08-02T03:07:47.807 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2023-08-02T03:07:47.807 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2023-08-02T03:07:47.807 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8" 2023-08-02T03:07:47.807 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2023-08-02T03:07:47.807 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-02T03:07:47.808 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2023-08-02T03:07:47.808 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-02T03:07:47.808 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2023-08-02T03:07:47.808 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-02T03:07:47.808 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-02T03:07:47.809 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-02T03:07:47.809 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2023-08-02T03:07:47.810 DEBUG:teuthology.parallel:result is None 2023-08-02T03:08:00.468 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:08:15.577 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:08:30.680 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:08:45.788 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:09:00.888 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:09:15.984 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:09:31.076 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:09:46.144 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:10:01.220 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:10:16.282 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:10:31.348 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-08-02T03:10:31.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:10:34.480 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-02T03:10:40.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:10:43.540 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-02T03:10:49.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:10:52.628 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-02T03:10:58.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:11:01.712 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-02T03:11:07.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:11:10.768 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-02T03:11:16.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:11:19.824 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-08-02T03:11:25.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:12:25.888 WARNING:teuthology.provision.fog.smithi190:timed out 2023-08-02T03:12:31.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:12:32.150 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-02T03:12:32.150 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-02T03:12:32.380 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-08-02T03:12:32.380 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-08-02T03:12:32.440 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2023-08-02T03:12:32.440 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2023-08-02T03:12:32.500 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2023-08-02T03:12:32.501 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-08-02T03:12:32.615 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2023-08-02T03:12:32.645 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2023-08-02T03:12:32.713 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2023-08-02T03:12:32.781 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-08-02T03:12:32.848 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-08-02T03:12:32.906 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2023-08-02T03:12:32.906 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8" 2023-08-02T03:12:32.906 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2023-08-02T03:12:32.906 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2023-08-02T03:12:32.906 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8" 2023-08-02T03:12:32.907 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-08-02T03:12:32.907 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-02T03:12:32.907 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-08-02T03:12:32.907 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-02T03:12:32.907 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2023-08-02T03:12:32.907 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-02T03:12:32.907 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-02T03:12:32.908 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-02T03:12:32.908 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-08-02T03:12:32.908 DEBUG:teuthology.parallel:result is None 2023-08-02T03:12:33.054 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2023-08-02T03:12:33.055 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-02T03:12:33.076 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-08-02T03:12:33.076 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-02T03:12:33.102 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2023-08-02T03:12:33.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-08-02T03:12:33.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:12:33.171 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-08-02T03:12:33.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-08-02T03:12:33.312 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2023-08-02T03:12:33.372 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2023-08-02T03:12:33.372 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-08-02T03:12:33.432 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2023-08-02T03:12:33.432 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8" 2023-08-02T03:12:33.433 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2023-08-02T03:12:33.433 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2023-08-02T03:12:33.433 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8" 2023-08-02T03:12:33.433 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2023-08-02T03:12:33.433 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-02T03:12:33.433 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2023-08-02T03:12:33.434 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-02T03:12:33.434 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2023-08-02T03:12:33.434 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-02T03:12:33.434 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-02T03:12:33.434 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-02T03:12:33.435 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-08-02T03:12:33.459 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-08-02T03:12:33.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-08-02T03:12:33.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-02T03:12:33.526 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-08-02T03:12:33.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-08-02T03:12:33.551 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-08-02T03:12:33.609 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-08-02T03:12:33.609 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-08-02T03:12:33.667 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2023-08-02T03:12:33.667 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8" 2023-08-02T03:12:33.667 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2023-08-02T03:12:33.667 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2023-08-02T03:12:33.668 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8" 2023-08-02T03:12:33.668 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-08-02T03:12:33.668 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-02T03:12:33.668 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-08-02T03:12:33.668 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-02T03:12:33.668 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2023-08-02T03:12:33.668 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-02T03:12:33.669 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-02T03:12:33.669 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-02T03:12:33.669 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-08-02T03:12:33.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:12:33.802 INFO:teuthology.dispatcher.supervisor:Running job 7358092 2023-08-02T03:12:33.803 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_10753fdddd8d487ef9ffba05c09f1a055cd67877/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-08-02_02:56:22-orch:cephadm-main-testing-default-smithi/7358092 --name vshankar-2023-08-02_02:56:22-orch:cephadm-main-testing-default-smithi --description orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} -- /home/teuthworker/archive/vshankar-2023-08-02_02:56:22-orch:cephadm-main-testing-default-smithi/7358092/orig.config.yaml 2023-08-02T03:12:33.806 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-08-02_02:56:22-orch:cephadm-main-testing-default-smithi/7358092 2023-08-02T03:12:33.807 INFO:teuthology.dispatcher.supervisor:Job PID: 23625 2023-08-02T03:12:33.807 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-02T03:14:33.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:16:34.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:18:34.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:20:34.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:22:34.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:24:34.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:26:34.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:28:35.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:30:35.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:32:35.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:34:35.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:36:35.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:38:35.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-02T03:38:36.015 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-02T03:38:36.098 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-02T03:38:36.098 INFO:teuthology.nuke:Checking targets against current locks 2023-08-02T03:38:36.142 DEBUG:teuthology.nuke:shortname: smithi055 2023-08-02T03:38:36.143 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-02T03:38:36.167 DEBUG:teuthology.nuke:shortname: smithi190 2023-08-02T03:38:36.168 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-02T03:38:36.170 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-02_02:56:22-orch:cephadm-main-testing-default-smithi/7358092', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-02 02:56:55.534474', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2iVYpLiuOhcMvPW/+F3qsk3RW7DhZbgZE05otPCmt1xELFFs5bvaRhErxJp5l03fFTyTMM8samuluv29rwGgFnMB6wsI8uZi9WLZKJI9LSLS26U33sOZlq0i30CjGD3DH9wrXPsOiploI3Y/Lam6Lq11NcaHZtNB8YTqrTDmFmANZfubxQlOakfmrwOYCVXkPmHyZs0HKrMZxGV9ghjXBaCs7WE5O4FctjmQxJzkGDBHBrcB3e9IdCRa/sBPpGe3LVeptu9LLs1R8Ov9tlIXGrgut8G4ncgmS37H2VQOYEoklHVuIvUcdNNB6LheNpBxEr5ERVZVMvJ5V5qawd3VlmSXpCt5JCZ34JtXv4sgTAkOkpGo+OYch8CuNpx+w8oikMIXsOSdg2U/wVJk7ZRA8QGGXFerybDTiEQWNx9cTyIz2Ss/FL49pklN32jUyYWOQmWYdjw12fU9tiZwc3SKalZRzH3kgyyeeTOmCcwKEsq0mHsGlTf+mrFUGdx01+fM='} 2023-08-02T03:38:36.189 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-02_02:56:22-orch:cephadm-main-testing-default-smithi/7358092', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-02 02:56:55.532807', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGhfeqb/iafoGy85NRn03iJc03tF6E8NnBKKBnUEGQ7v2NDmkXx6F0k9Rq55TPbiOF6ED+0/Y15Mkba2v/I6yLS0SwLqswtpFHHI/lN25EhygsRb3ynTaiuIMTlC9+2e5+QW9RXtyH0TQJbtSbUVupL/SaHNKuz9B3Ezm+Qm9e6I6EoeY/opsX5AmZ+B2pRTp7sEGY62dfc0TVCVLKOmdIE2dCEejLP5drbsZuLoozi6cyLYqDxxqcdnaRh3teU4JthodiI+fjPzmmemLtWK5Y27FcNT0WSUDha9DXgdZeXInydBNXuDbcprVk+yOaGpYe9Jf67QxJP2+7mJcX20cxPFJOZGZx6bb+dCBCiNv656CKquOwq2ri3BEnLHoomOLrS/2nO8vCrJUIcPZfNf2pldG0Z09OLBjjs5bPpTBXMpxkX/kk1NQkLiWD0JYmX0+E4dP+xwpuYhg8iTZLI+4r+DTP0fU92TM/NUoztNQG6o6dlUNE4SVtfAF2eIrTN+U='} 2023-08-02T03:38:36.218 INFO:teuthology.orchestra.console.smithi055:Power off 2023-08-02T03:38:36.219 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-02T03:38:36.236 INFO:teuthology.orchestra.console.smithi190:Power off 2023-08-02T03:38:36.237 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-02T03:38:36.248 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2023-08-02T03:38:36.249 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T03:38:36.262 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-08-02T03:38:36.262 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-02T03:38:36.274 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2023-08-02T03:38:36.291 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-08-02T03:38:36.376 INFO:teuthology.orchestra.console.smithi055:Power off completed 2023-08-02T03:38:36.393 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-08-02T03:38:36.531 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2023-08-02T03:38:36.539 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com