2023-09-15T11:38:52.468 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-15T11:38:52.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T11:38:52.631 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbd9d3a3b80>, signals=[15]) 2023-09-15T11:38:52.632 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging 2023-09-15T11:38:52.633 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server 2023-09-15T11:38:52.633 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-09-15T11:38:52.653 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging 2023-09-15T11:38:52.653 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server 2023-09-15T11:38:52.654 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-09-15T11:38:52.655 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /host {"name": "smithi136"} 2023-09-15T11:38:52.678 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /host {"name": "smithi160"} 2023-09-15T11:38:52.721 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-15T11:38:52.739 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-15T11:38:52.756 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-15T11:38:52.756 DEBUG:teuthology.provision.fog.smithi136:FOG request: PUT /host/241 {"imageID": 6} 2023-09-15T11:38:52.777 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-15T11:38:52.777 DEBUG:teuthology.provision.fog.smithi160:FOG request: PUT /host/265 {"imageID": 6} 2023-09-15T11:38:52.801 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of ubuntu 22.04 2023-09-15T11:38:52.801 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:38:52.819 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of ubuntu 22.04 2023-09-15T11:38:52.820 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:38:52.900 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /tasktype {"name": "deploy"} 2023-09-15T11:38:52.919 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /tasktype {"name": "deploy"} 2023-09-15T11:38:52.938 DEBUG:teuthology.provision.fog.smithi136:FOG request: POST /host/241/task {"taskTypeID": 1} 2023-09-15T11:38:52.966 DEBUG:teuthology.provision.fog.smithi160:FOG request: POST /host/265/task {"taskTypeID": 1} 2023-09-15T11:38:53.003 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:38:53.009 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:38:53.126 INFO:teuthology.orchestra.console.smithi136:Power off 2023-09-15T11:38:53.127 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T11:38:53.138 INFO:teuthology.orchestra.console.smithi160:Power off 2023-09-15T11:38:53.139 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T11:38:53.147 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2023-09-15T11:38:53.147 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:38:53.158 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2023-09-15T11:38:53.159 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:38:53.167 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-09-15T11:38:53.178 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-09-15T11:38:53.279 INFO:teuthology.orchestra.console.smithi160:Power off completed 2023-09-15T11:38:53.380 INFO:teuthology.orchestra.console.smithi160:Power on 2023-09-15T11:38:53.380 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-15T11:38:53.400 DEBUG:teuthology.orchestra.console.smithi160:power on output: Chassis Power Control: Up/On 2023-09-15T11:38:53.401 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:38:53.420 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-09-15T11:38:57.170 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:38:57.277 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-09-15T11:38:57.421 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:38:57.529 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-09-15T11:38:57.630 INFO:teuthology.orchestra.console.smithi160:Power on completed 2023-09-15T11:38:57.731 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2023-09-15T11:38:57.732 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:39:01.282 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:39:01.389 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-09-15T11:39:01.490 INFO:teuthology.orchestra.console.smithi136:Power off completed 2023-09-15T11:39:01.591 INFO:teuthology.orchestra.console.smithi136:Power on 2023-09-15T11:39:01.592 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-15T11:39:01.613 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On 2023-09-15T11:39:01.614 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:39:01.635 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-09-15T11:39:05.638 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:39:05.745 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-09-15T11:39:09.750 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T11:39:09.858 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-09-15T11:39:09.959 INFO:teuthology.orchestra.console.smithi136:Power on completed 2023-09-15T11:39:10.060 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2023-09-15T11:39:10.061 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:39:12.887 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:39:25.239 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:39:28.062 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:39:40.409 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:39:43.240 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:39:55.579 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:39:58.398 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:40:10.758 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:40:13.587 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:40:25.971 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:40:28.775 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:40:41.185 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:40:43.977 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:41:19.446 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:41:21.059 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:41:37.254 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:41:38.894 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:41:54.765 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:41:55.869 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:42:10.202 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:42:12.652 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:42:25.488 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:42:29.232 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:42:41.219 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:42:44.569 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:42:56.691 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:43:00.567 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:43:12.019 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:43:15.844 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:43:29.539 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:43:31.142 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:43:44.888 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:43:46.452 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:44:00.249 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:44:01.787 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:44:15.568 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:44:17.074 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:44:30.841 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:44:32.534 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:44:46.126 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:44:48.018 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:45:01.387 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:45:03.442 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-09-15T11:45:03.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:45:16.659 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:45:22.074 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-09-15T11:45:28.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:45:31.162 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-09-15T11:45:31.854 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:45:37.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:45:40.250 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-09-15T11:45:46.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:45:47.079 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:45:49.338 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-09-15T11:45:55.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:45:58.394 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-09-15T11:46:02.284 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:46:04.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:46:17.485 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:46:22.746 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-09-15T11:46:28.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:46:31.834 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-09-15T11:46:32.628 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:46:37.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:46:38.803 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-09-15T11:46:44.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:46:44.813 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-09-15T11:46:47.811 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:46:50.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:46:50.820 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-09-15T11:46:56.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:46:56.829 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-09-15T11:47:02.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:47:02.838 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-09-15T11:47:02.956 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:47:08.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:47:09.149 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-15T11:47:09.150 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-15T11:47:09.585 INFO:teuthology.provision.fog.smithi160:Node is ready 2023-09-15T11:47:09.586 DEBUG:teuthology.orchestra.run.smithi160:> hostname 2023-09-15T11:47:09.633 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com 2023-09-15T11:47:09.634 DEBUG:teuthology.orchestra.run.smithi160:> grep smithi160.front.sepia.ceph.com /etc/hosts 2023-09-15T11:47:09.682 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160 2023-09-15T11:47:09.682 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-09-15T11:47:09.814 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hosts 2023-09-15T11:47:09.830 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.160/172.21.15.160/g' /etc/hosts 2023-09-15T11:47:09.886 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hostname 2023-09-15T11:47:09.945 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-09-15T11:47:10.004 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-09-15T11:47:10.053 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-15T11:47:10.054 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Ubuntu" 2023-09-15T11:47:10.054 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="22.04" 2023-09-15T11:47:10.054 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-15T11:47:10.055 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_CODENAME=jammy 2023-09-15T11:47:10.055 INFO:teuthology.orchestra.run.smithi160.stdout:ID=ubuntu 2023-09-15T11:47:10.055 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE=debian 2023-09-15T11:47:10.056 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-15T11:47:10.056 INFO:teuthology.orchestra.run.smithi160.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-15T11:47:10.056 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-15T11:47:10.056 INFO:teuthology.orchestra.run.smithi160.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-15T11:47:10.057 INFO:teuthology.orchestra.run.smithi160.stdout:UBUNTU_CODENAME=jammy 2023-09-15T11:47:10.057 INFO:teuthology.provision.fog.smithi160:Deploy complete! 2023-09-15T11:47:10.059 DEBUG:teuthology.parallel:result is None 2023-09-15T11:47:18.076 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:47:33.201 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:47:48.326 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-09-15T11:47:48.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:47:51.482 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-09-15T11:47:57.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:48:00.570 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-09-15T11:48:06.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:48:09.630 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-09-15T11:48:15.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:48:18.714 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-09-15T11:48:24.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:48:27.803 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-09-15T11:48:33.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:48:36.858 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-09-15T11:48:42.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:49:42.920 WARNING:teuthology.provision.fog.smithi136:timed out 2023-09-15T11:49:48.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:49:49.416 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-15T11:49:49.417 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-15T11:49:49.828 INFO:teuthology.provision.fog.smithi136:Node is ready 2023-09-15T11:49:49.829 DEBUG:teuthology.orchestra.run.smithi136:> hostname 2023-09-15T11:49:49.877 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com 2023-09-15T11:49:49.877 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts 2023-09-15T11:49:49.926 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2023-09-15T11:49:49.927 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2023-09-15T11:49:50.078 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts 2023-09-15T11:49:50.092 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts 2023-09-15T11:49:50.145 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname 2023-09-15T11:49:50.201 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2023-09-15T11:49:50.260 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-09-15T11:49:50.305 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-15T11:49:50.306 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu" 2023-09-15T11:49:50.306 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="22.04" 2023-09-15T11:49:50.306 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-15T11:49:50.307 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=jammy 2023-09-15T11:49:50.307 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu 2023-09-15T11:49:50.307 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian 2023-09-15T11:49:50.308 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-15T11:49:50.308 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-15T11:49:50.308 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-15T11:49:50.309 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-15T11:49:50.309 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=jammy 2023-09-15T11:49:50.309 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2023-09-15T11:49:50.310 DEBUG:teuthology.parallel:result is None 2023-09-15T11:49:50.491 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2023-09-15T11:49:50.491 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-15T11:49:50.521 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com 2023-09-15T11:49:50.521 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-15T11:49:50.547 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2023-09-15T11:49:50.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-09-15T11:49:50.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:49:50.622 DEBUG:teuthology.orchestra.run.smithi136:> true 2023-09-15T11:49:50.722 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-09-15T11:49:50.722 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2023-09-15T11:49:50.769 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2023-09-15T11:49:50.770 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-09-15T11:49:50.817 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-15T11:49:50.818 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu" 2023-09-15T11:49:50.818 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="22.04" 2023-09-15T11:49:50.818 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-15T11:49:50.818 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=jammy 2023-09-15T11:49:50.819 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu 2023-09-15T11:49:50.819 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian 2023-09-15T11:49:50.819 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-15T11:49:50.819 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-15T11:49:50.819 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-15T11:49:50.820 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-15T11:49:50.820 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=jammy 2023-09-15T11:49:50.820 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-09-15T11:49:50.846 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server 2023-09-15T11:49:50.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-09-15T11:49:50.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-15T11:49:50.921 DEBUG:teuthology.orchestra.run.smithi160:> true 2023-09-15T11:49:51.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-09-15T11:49:51.146 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2023-09-15T11:49:51.191 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2023-09-15T11:49:51.192 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-09-15T11:49:51.240 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-15T11:49:51.241 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Ubuntu" 2023-09-15T11:49:51.241 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="22.04" 2023-09-15T11:49:51.241 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-15T11:49:51.241 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_CODENAME=jammy 2023-09-15T11:49:51.241 INFO:teuthology.orchestra.run.smithi160.stdout:ID=ubuntu 2023-09-15T11:49:51.242 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE=debian 2023-09-15T11:49:51.242 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-15T11:49:51.242 INFO:teuthology.orchestra.run.smithi160.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-15T11:49:51.242 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-15T11:49:51.242 INFO:teuthology.orchestra.run.smithi160.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-15T11:49:51.242 INFO:teuthology.orchestra.run.smithi160.stdout:UBUNTU_CODENAME=jammy 2023-09-15T11:49:51.243 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-09-15T11:49:51.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T11:49:51.351 INFO:teuthology.dispatcher.supervisor:Running job 7396933 2023-09-15T11:49:51.351 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396933 --name rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396933/orig.config.yaml 2023-09-15T11:49:51.354 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396933 2023-09-15T11:49:51.354 INFO:teuthology.dispatcher.supervisor:Job PID: 712674 2023-09-15T11:49:51.355 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-15T11:51:51.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T11:53:51.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T11:55:51.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T11:57:52.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T11:59:52.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T12:01:52.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T12:03:52.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-15T12:03:52.635 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-15T12:03:52.739 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-15T12:03:52.740 INFO:teuthology.nuke:Checking targets against current locks 2023-09-15T12:03:52.787 DEBUG:teuthology.nuke:shortname: smithi136 2023-09-15T12:03:52.787 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-15T12:03:52.807 DEBUG:teuthology.nuke:shortname: smithi160 2023-09-15T12:03:52.808 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-15T12:03:52.812 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396933', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-15 11:38:51.687313', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBUeg5i2ZkMgTxdM6s7zrGFKVQpMPQpgPUcGr9EGZ6DuslLZ8aDnbfgt33Br4hCrR7SybFg5fu62k4biK+048pM='} 2023-09-15T12:03:52.827 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396933', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-15 11:38:51.685798', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC3oHUNZZ7ASdaZfjWA+uTnT33bDeW9Gvln7ULzJjs2Wzuj4QzVK/x3VXATzpZNe0fUUMkAAzt0y2DUupdfAnV0='} 2023-09-15T12:03:52.857 INFO:teuthology.orchestra.console.smithi136:Power off 2023-09-15T12:03:52.858 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T12:03:52.879 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2023-09-15T12:03:52.880 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T12:03:52.891 INFO:teuthology.orchestra.console.smithi160:Power off 2023-09-15T12:03:52.892 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-15T12:03:52.901 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-09-15T12:03:52.911 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2023-09-15T12:03:52.911 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-15T12:03:52.930 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-09-15T12:03:53.003 INFO:teuthology.orchestra.console.smithi136:Power off completed 2023-09-15T12:03:53.032 INFO:teuthology.orchestra.console.smithi160:Power off completed 2023-09-15T12:03:53.161 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com 2023-09-15T12:03:53.176 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com