2023-09-18T09:49:44.999 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-18T09:49:45.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-18T09:49:45.157 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd1ba443670>, signals=[15]) 2023-09-18T09:49:45.158 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging 2023-09-18T09:49:45.159 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server 2023-09-18T09:49:45.159 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-09-18T09:49:45.178 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-09-18T09:49:45.179 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-09-18T09:49:45.179 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-09-18T09:49:45.181 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /host {"name": "smithi164"} 2023-09-18T09:49:45.203 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"} 2023-09-18T09:49:45.247 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-18T09:49:45.282 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-18T09:49:45.285 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-18T09:49:45.285 DEBUG:teuthology.provision.fog.smithi164:FOG request: PUT /host/269 {"imageID": 6} 2023-09-18T09:49:45.323 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of ubuntu 22.04 2023-09-18T09:49:45.323 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:49:45.327 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-18T09:49:45.327 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 6} 2023-09-18T09:49:45.367 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of ubuntu 22.04 2023-09-18T09:49:45.367 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:49:45.374 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /tasktype {"name": "deploy"} 2023-09-18T09:49:45.407 DEBUG:teuthology.provision.fog.smithi164:FOG request: POST /host/269/task {"taskTypeID": 1} 2023-09-18T09:49:45.414 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"} 2023-09-18T09:49:45.451 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1} 2023-09-18T09:49:45.459 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:49:45.511 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:49:45.544 INFO:teuthology.orchestra.console.smithi164:Power off 2023-09-18T09:49:45.545 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-18T09:49:45.565 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2023-09-18T09:49:45.565 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-18T09:49:45.584 INFO:teuthology.orchestra.console.smithi203:Power off 2023-09-18T09:49:45.584 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-18T09:49:45.592 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-09-18T09:49:45.605 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-09-18T09:49:45.605 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-18T09:49:45.636 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-09-18T09:49:45.693 INFO:teuthology.orchestra.console.smithi164:Power off completed 2023-09-18T09:49:45.794 INFO:teuthology.orchestra.console.smithi164:Power on 2023-09-18T09:49:45.794 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-18T09:49:45.814 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On 2023-09-18T09:49:45.815 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-18T09:49:45.838 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-09-18T09:49:49.641 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-18T09:49:49.750 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-09-18T09:49:49.840 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-18T09:49:49.948 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2023-09-18T09:49:50.049 INFO:teuthology.orchestra.console.smithi164:Power on completed 2023-09-18T09:49:50.149 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2023-09-18T09:49:50.150 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:49:53.754 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-18T09:49:53.862 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-09-18T09:49:53.963 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-09-18T09:49:54.065 INFO:teuthology.orchestra.console.smithi203:Power on 2023-09-18T09:49:54.065 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-18T09:49:54.088 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On 2023-09-18T09:49:54.089 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-18T09:49:54.111 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-09-18T09:49:58.113 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-18T09:49:58.221 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-09-18T09:50:02.226 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-18T09:50:02.334 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-09-18T09:50:02.435 INFO:teuthology.orchestra.console.smithi203:Power on completed 2023-09-18T09:50:02.536 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-09-18T09:50:02.536 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:50:05.240 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:50:17.725 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:50:20.399 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:50:32.895 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:50:35.579 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:50:48.082 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:50:50.758 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:51:03.266 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:51:05.934 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:51:18.454 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:51:21.138 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:51:33.658 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:51:36.326 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:51:48.903 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:51:51.494 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:52:05.632 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:52:06.708 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:52:21.061 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:52:21.872 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:52:41.666 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:52:41.694 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:52:58.630 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:52:58.654 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:53:15.042 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:53:15.197 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:53:31.074 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:53:31.141 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:53:46.660 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:53:47.000 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:54:02.306 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:54:02.555 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:54:17.611 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:54:18.488 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:54:32.866 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:54:33.854 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:54:48.092 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:54:49.190 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:55:03.274 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:55:04.448 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:55:18.500 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:55:19.698 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:55:33.746 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:55:34.925 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:55:48.948 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:55:50.139 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:56:04.130 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:56:05.346 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:56:19.312 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:56:20.525 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:56:34.496 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:56:35.704 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:56:49.662 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:56:50.858 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:57:04.805 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:57:06.032 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:57:19.933 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:57:21.163 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:57:35.086 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:57:36.309 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:57:50.210 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:57:51.430 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:58:05.314 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:58:06.539 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:58:20.410 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:58:21.642 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:58:35.510 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:58:36.728 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-09-18T09:58:36.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T09:58:39.866 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-09-18T09:58:45.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T09:58:48.922 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-09-18T09:58:50.588 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:58:54.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T09:58:57.978 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-09-18T09:59:03.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T09:59:05.657 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:59:07.038 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-09-18T09:59:13.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T09:59:16.122 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-09-18T09:59:20.718 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-09-18T09:59:20.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T09:59:22.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T09:59:23.834 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-09-18T09:59:25.178 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-09-18T09:59:29.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T09:59:31.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T09:59:32.894 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-09-18T09:59:34.234 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-09-18T09:59:38.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T09:59:40.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T09:59:41.978 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-09-18T09:59:47.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T09:59:51.034 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-09-18T09:59:57.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T10:00:00.122 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-09-18T10:00:06.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T10:00:09.178 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-09-18T10:00:15.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T10:00:40.262 WARNING:teuthology.provision.fog.smithi203:timed out 2023-09-18T10:00:46.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T10:00:46.465 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-18T10:00:46.466 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-18T10:00:46.879 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-09-18T10:00:46.880 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2023-09-18T10:00:46.929 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2023-09-18T10:00:46.929 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2023-09-18T10:00:46.982 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2023-09-18T10:00:46.983 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-09-18T10:00:47.142 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2023-09-18T10:00:47.156 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2023-09-18T10:00:47.214 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2023-09-18T10:00:47.269 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-09-18T10:00:47.328 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-09-18T10:00:47.377 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-18T10:00:47.378 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Ubuntu" 2023-09-18T10:00:47.378 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="22.04" 2023-09-18T10:00:47.378 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-18T10:00:47.378 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_CODENAME=jammy 2023-09-18T10:00:47.378 INFO:teuthology.orchestra.run.smithi203.stdout:ID=ubuntu 2023-09-18T10:00:47.379 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE=debian 2023-09-18T10:00:47.379 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-18T10:00:47.379 INFO:teuthology.orchestra.run.smithi203.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-18T10:00:47.379 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-18T10:00:47.379 INFO:teuthology.orchestra.run.smithi203.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-18T10:00:47.380 INFO:teuthology.orchestra.run.smithi203.stdout:UBUNTU_CODENAME=jammy 2023-09-18T10:00:47.380 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-09-18T10:00:47.381 DEBUG:teuthology.parallel:result is None 2023-09-18T10:01:15.210 WARNING:teuthology.provision.fog.smithi164:timed out 2023-09-18T10:01:21.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T10:01:21.509 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-18T10:01:21.510 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-18T10:01:21.978 INFO:teuthology.provision.fog.smithi164:Node is ready 2023-09-18T10:01:21.979 DEBUG:teuthology.orchestra.run.smithi164:> hostname 2023-09-18T10:01:22.026 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2023-09-18T10:01:22.026 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts 2023-09-18T10:01:22.074 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2023-09-18T10:01:22.075 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-09-18T10:01:22.187 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts 2023-09-18T10:01:22.201 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts 2023-09-18T10:01:22.254 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname 2023-09-18T10:01:22.310 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-09-18T10:01:22.365 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-09-18T10:01:22.414 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-18T10:01:22.414 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Ubuntu" 2023-09-18T10:01:22.414 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="22.04" 2023-09-18T10:01:22.415 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-18T10:01:22.415 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_CODENAME=jammy 2023-09-18T10:01:22.415 INFO:teuthology.orchestra.run.smithi164.stdout:ID=ubuntu 2023-09-18T10:01:22.415 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE=debian 2023-09-18T10:01:22.416 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-18T10:01:22.416 INFO:teuthology.orchestra.run.smithi164.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-18T10:01:22.416 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-18T10:01:22.416 INFO:teuthology.orchestra.run.smithi164.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-18T10:01:22.416 INFO:teuthology.orchestra.run.smithi164.stdout:UBUNTU_CODENAME=jammy 2023-09-18T10:01:22.417 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2023-09-18T10:01:22.417 DEBUG:teuthology.parallel:result is None 2023-09-18T10:01:22.627 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2023-09-18T10:01:22.627 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-18T10:01:22.661 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-09-18T10:01:22.661 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-18T10:01:22.687 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2023-09-18T10:01:22.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-09-18T10:01:22.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T10:01:22.764 DEBUG:teuthology.orchestra.run.smithi164:> true 2023-09-18T10:01:22.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-09-18T10:01:22.874 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2023-09-18T10:01:22.922 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2023-09-18T10:01:22.922 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-09-18T10:01:22.970 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-18T10:01:22.970 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Ubuntu" 2023-09-18T10:01:22.970 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="22.04" 2023-09-18T10:01:22.971 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-18T10:01:22.971 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_CODENAME=jammy 2023-09-18T10:01:22.971 INFO:teuthology.orchestra.run.smithi164.stdout:ID=ubuntu 2023-09-18T10:01:22.971 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE=debian 2023-09-18T10:01:22.971 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-18T10:01:22.972 INFO:teuthology.orchestra.run.smithi164.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-18T10:01:22.972 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-18T10:01:22.972 INFO:teuthology.orchestra.run.smithi164.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-18T10:01:22.972 INFO:teuthology.orchestra.run.smithi164.stdout:UBUNTU_CODENAME=jammy 2023-09-18T10:01:22.973 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-09-18T10:01:23.011 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-09-18T10:01:23.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-09-18T10:01:23.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-18T10:01:23.087 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-09-18T10:01:23.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-09-18T10:01:23.322 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-09-18T10:01:23.369 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-09-18T10:01:23.369 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-09-18T10:01:23.417 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-18T10:01:23.417 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Ubuntu" 2023-09-18T10:01:23.418 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="22.04" 2023-09-18T10:01:23.418 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-18T10:01:23.418 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_CODENAME=jammy 2023-09-18T10:01:23.418 INFO:teuthology.orchestra.run.smithi203.stdout:ID=ubuntu 2023-09-18T10:01:23.418 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE=debian 2023-09-18T10:01:23.419 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-18T10:01:23.419 INFO:teuthology.orchestra.run.smithi203.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-18T10:01:23.419 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-18T10:01:23.419 INFO:teuthology.orchestra.run.smithi203.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-18T10:01:23.419 INFO:teuthology.orchestra.run.smithi203.stdout:UBUNTU_CODENAME=jammy 2023-09-18T10:01:23.420 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-09-18T10:01:23.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-18T10:01:23.523 INFO:teuthology.dispatcher.supervisor:Running job 7397507 2023-09-18T10:01:23.524 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2023-09-18_09:48:49-rados:basic-wip-lusov-config-format-distro-default-smithi/7397507 --name leonidus-2023-09-18_09:48:49-rados:basic-wip-lusov-config-format-distro-default-smithi --description rados:basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/commands} -- /home/teuthworker/archive/leonidus-2023-09-18_09:48:49-rados:basic-wip-lusov-config-format-distro-default-smithi/7397507/orig.config.yaml 2023-09-18T10:01:23.527 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2023-09-18_09:48:49-rados:basic-wip-lusov-config-format-distro-default-smithi/7397507 2023-09-18T10:01:23.528 INFO:teuthology.dispatcher.supervisor:Job PID: 2033095 2023-09-18T10:01:23.528 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-18T10:03:23.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-18T10:05:23.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-18T10:07:23.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-18T10:09:24.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-18T10:11:24.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-18T10:13:24.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-18T10:15:24.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-18T10:17:24.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-18T10:19:24.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-18T10:19:24.980 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-18T10:19:25.065 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-18T10:19:25.066 INFO:teuthology.nuke:Checking targets against current locks 2023-09-18T10:19:25.129 DEBUG:teuthology.nuke:shortname: smithi203 2023-09-18T10:19:25.130 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-18T10:19:25.140 DEBUG:teuthology.nuke:shortname: smithi164 2023-09-18T10:19:25.140 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-18T10:19:25.152 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-09-18_09:48:49-rados:basic-wip-lusov-config-format-distro-default-smithi/7397507', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-18 09:49:44.244833', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJqPZp81LykGV4KdtQu8wCYu1jM4tqtdPVixJQOYHIA0s8gSBCSvoV9QA3fjniKNY+ZNw6W7FujPmmm/1Gn0o7Q='} 2023-09-18T10:19:25.159 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-09-18_09:48:49-rados:basic-wip-lusov-config-format-distro-default-smithi/7397507', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-18 09:49:44.246629', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN9foDTwSjs/B+N8C/GIoCpI4mL69gq5TCgmPuZHoY8JU00ax1zrjRPFzJUVmYu3bKK62WqHn3vrT9ABR/EK9tY='} 2023-09-18T10:19:25.215 INFO:teuthology.orchestra.console.smithi203:Power off 2023-09-18T10:19:25.216 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-18T10:19:25.229 INFO:teuthology.orchestra.console.smithi164:Power off 2023-09-18T10:19:25.229 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-18T10:19:25.237 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-09-18T10:19:25.237 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-18T10:19:25.249 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2023-09-18T10:19:25.250 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-18T10:19:25.257 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-09-18T10:19:25.269 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2023-09-18T10:19:25.358 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-09-18T10:19:25.371 INFO:teuthology.orchestra.console.smithi164:Power off completed 2023-09-18T10:19:25.505 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com 2023-09-18T10:19:25.514 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com