2023-09-08T07:04:21.840 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-08T07:04:21.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:04:21.998 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd93b2dc670>, signals=[15]) 2023-09-08T07:04:22.000 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2023-09-08T07:04:22.000 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2023-09-08T07:04:22.000 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-09-08T07:04:22.026 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2023-09-08T07:04:22.026 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2023-09-08T07:04:22.026 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-09-08T07:04:22.028 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /host {"name": "smithi145"} 2023-09-08T07:04:22.050 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /host {"name": "smithi153"} 2023-09-08T07:04:22.098 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-08T07:04:22.102 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-08T07:04:22.139 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-08T07:04:22.139 DEBUG:teuthology.provision.fog.smithi153:FOG request: PUT /host/258 {"imageID": 6} 2023-09-08T07:04:22.142 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-08T07:04:22.142 DEBUG:teuthology.provision.fog.smithi145:FOG request: PUT /host/250 {"imageID": 6} 2023-09-08T07:04:22.190 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of ubuntu 22.04 2023-09-08T07:04:22.191 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:04:22.199 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of ubuntu 22.04 2023-09-08T07:04:22.199 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:04:22.331 DEBUG:teuthology.provision.fog.smithi145:Canceling deploy task with ID 483723 2023-09-08T07:04:22.332 DEBUG:teuthology.provision.fog.smithi145:FOG request: DELETE /task/cancel {"id": 483723} 2023-09-08T07:04:22.336 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /tasktype {"name": "deploy"} 2023-09-08T07:04:22.382 DEBUG:teuthology.provision.fog.smithi153:FOG request: POST /host/258/task {"taskTypeID": 1} 2023-09-08T07:04:22.436 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:04:22.451 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /tasktype {"name": "deploy"} 2023-09-08T07:04:22.490 DEBUG:teuthology.provision.fog.smithi145:FOG request: POST /host/250/task {"taskTypeID": 1} 2023-09-08T07:04:22.534 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:04:22.604 INFO:teuthology.orchestra.console.smithi153:Power off 2023-09-08T07:04:22.605 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T07:04:22.625 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-09-08T07:04:22.626 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:22.646 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-09-08T07:04:22.697 INFO:teuthology.orchestra.console.smithi145:Power off 2023-09-08T07:04:22.698 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T07:04:22.720 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2023-09-08T07:04:22.720 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:22.741 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-09-08T07:04:22.747 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-09-08T07:04:22.848 INFO:teuthology.orchestra.console.smithi153:Power on 2023-09-08T07:04:22.848 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-08T07:04:22.871 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On 2023-09-08T07:04:22.871 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:22.891 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-09-08T07:04:26.747 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:26.855 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-09-08T07:04:26.893 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:27.000 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-09-08T07:04:27.101 INFO:teuthology.orchestra.console.smithi153:Power on completed 2023-09-08T07:04:27.202 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2023-09-08T07:04:27.202 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:04:30.860 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:30.968 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-09-08T07:04:34.972 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:35.080 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-09-08T07:04:35.181 INFO:teuthology.orchestra.console.smithi145:Power off completed 2023-09-08T07:04:35.282 INFO:teuthology.orchestra.console.smithi145:Power on 2023-09-08T07:04:35.282 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-08T07:04:35.301 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On 2023-09-08T07:04:35.301 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:35.321 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-09-08T07:04:39.322 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:39.430 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-09-08T07:04:42.449 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:04:43.432 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:04:43.539 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2023-09-08T07:04:43.640 INFO:teuthology.orchestra.console.smithi145:Power on completed 2023-09-08T07:04:43.740 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2023-09-08T07:04:43.741 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:04:57.638 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:04:58.916 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:05:12.847 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:05:14.117 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:05:28.050 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:05:29.294 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:05:43.234 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:05:44.466 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:05:58.455 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:05:59.674 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:06:13.711 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:06:14.915 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:06:28.959 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:06:30.138 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:06:44.219 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:06:45.425 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:06:59.477 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:07:00.690 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:07:35.340 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:07:35.683 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:07:53.878 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:07:54.227 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:08:13.500 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:08:13.858 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:08:30.014 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:08:31.666 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:08:45.346 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:08:48.358 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:09:00.622 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:09:04.683 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:09:15.862 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:09:20.587 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:09:31.164 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:09:36.318 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:09:46.384 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:09:51.962 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:10:01.626 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:10:07.185 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:10:16.862 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:10:22.399 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:10:32.051 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:10:37.596 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:10:47.232 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-09-08T07:10:47.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:10:52.738 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:11:05.882 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-09-08T07:11:07.918 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:11:11.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:11:14.938 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-09-08T07:11:20.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:11:23.090 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:11:23.994 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-09-08T07:11:30.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:11:33.086 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-09-08T07:11:38.213 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:11:39.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:11:42.170 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-09-08T07:11:48.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:11:53.341 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:12:06.555 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-09-08T07:12:08.441 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:12:12.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:15.642 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-09-08T07:12:21.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:21.652 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-09-08T07:12:23.531 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-09-08T07:12:23.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:27.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:27.659 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-09-08T07:12:33.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:33.667 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-09-08T07:12:39.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:39.672 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-09-08T07:12:42.138 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-08T07:12:45.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:45.678 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-09-08T07:12:48.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:51.194 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-08T07:12:51.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:12:51.892 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-08T07:12:51.893 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-08T07:12:52.369 INFO:teuthology.provision.fog.smithi153:Node is ready 2023-09-08T07:12:52.369 DEBUG:teuthology.orchestra.run.smithi153:> hostname 2023-09-08T07:12:52.418 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2023-09-08T07:12:52.418 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts 2023-09-08T07:12:52.466 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2023-09-08T07:12:52.467 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-09-08T07:12:52.609 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts 2023-09-08T07:12:52.624 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts 2023-09-08T07:12:52.678 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname 2023-09-08T07:12:52.733 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-09-08T07:12:52.792 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-09-08T07:12:52.842 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-08T07:12:52.842 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2023-09-08T07:12:52.842 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04" 2023-09-08T07:12:52.842 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-08T07:12:52.843 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy 2023-09-08T07:12:52.843 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2023-09-08T07:12:52.843 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2023-09-08T07:12:52.843 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-08T07:12:52.844 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-08T07:12:52.844 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-08T07:12:52.844 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-08T07:12:52.844 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy 2023-09-08T07:12:52.845 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2023-09-08T07:12:52.846 DEBUG:teuthology.parallel:result is None 2023-09-08T07:12:57.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:13:00.250 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-08T07:13:06.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:13:09.338 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-08T07:13:15.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:13:18.426 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-08T07:13:24.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:13:42.811 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-08T07:13:48.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:13:51.866 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-08T07:13:57.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:13:58.874 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-08T07:14:04.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:14:04.880 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-08T07:14:10.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:14:10.891 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-08T07:14:16.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:14:16.895 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-08T07:14:22.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:14:22.904 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-09-08T07:14:28.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:14:29.103 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-08T07:14:29.103 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-08T07:14:29.763 INFO:teuthology.provision.fog.smithi145:Node is ready 2023-09-08T07:14:29.764 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2023-09-08T07:14:29.812 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2023-09-08T07:14:29.812 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts 2023-09-08T07:14:29.862 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2023-09-08T07:14:29.863 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-09-08T07:14:29.989 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts 2023-09-08T07:14:30.004 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2023-09-08T07:14:30.061 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname 2023-09-08T07:14:30.115 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-09-08T07:14:30.171 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-09-08T07:14:30.220 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-08T07:14:30.220 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Ubuntu" 2023-09-08T07:14:30.220 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="22.04" 2023-09-08T07:14:30.221 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-08T07:14:30.221 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_CODENAME=jammy 2023-09-08T07:14:30.221 INFO:teuthology.orchestra.run.smithi145.stdout:ID=ubuntu 2023-09-08T07:14:30.221 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE=debian 2023-09-08T07:14:30.221 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-08T07:14:30.222 INFO:teuthology.orchestra.run.smithi145.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-08T07:14:30.222 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-08T07:14:30.222 INFO:teuthology.orchestra.run.smithi145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-08T07:14:30.222 INFO:teuthology.orchestra.run.smithi145.stdout:UBUNTU_CODENAME=jammy 2023-09-08T07:14:30.223 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2023-09-08T07:14:30.224 DEBUG:teuthology.parallel:result is None 2023-09-08T07:14:30.459 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2023-09-08T07:14:30.459 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-08T07:14:30.478 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2023-09-08T07:14:30.478 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-08T07:14:30.504 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2023-09-08T07:14:30.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-09-08T07:14:30.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:14:30.581 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-09-08T07:14:30.686 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-09-08T07:14:30.686 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2023-09-08T07:14:30.732 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2023-09-08T07:14:30.732 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-09-08T07:14:30.780 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-08T07:14:30.780 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Ubuntu" 2023-09-08T07:14:30.780 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="22.04" 2023-09-08T07:14:30.781 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-08T07:14:30.781 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_CODENAME=jammy 2023-09-08T07:14:30.781 INFO:teuthology.orchestra.run.smithi145.stdout:ID=ubuntu 2023-09-08T07:14:30.781 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE=debian 2023-09-08T07:14:30.781 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-08T07:14:30.782 INFO:teuthology.orchestra.run.smithi145.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-08T07:14:30.782 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-08T07:14:30.787 INFO:teuthology.orchestra.run.smithi145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-08T07:14:30.787 INFO:teuthology.orchestra.run.smithi145.stdout:UBUNTU_CODENAME=jammy 2023-09-08T07:14:30.787 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-09-08T07:14:30.812 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2023-09-08T07:14:30.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-09-08T07:14:30.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-08T07:14:30.887 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-09-08T07:14:31.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-09-08T07:14:31.118 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-09-08T07:14:31.165 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-09-08T07:14:31.166 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-09-08T07:14:31.213 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-08T07:14:31.213 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2023-09-08T07:14:31.213 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04" 2023-09-08T07:14:31.214 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-08T07:14:31.214 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy 2023-09-08T07:14:31.214 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2023-09-08T07:14:31.214 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2023-09-08T07:14:31.214 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-08T07:14:31.215 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-08T07:14:31.215 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-08T07:14:31.215 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-08T07:14:31.215 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy 2023-09-08T07:14:31.216 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-09-08T07:14:31.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:14:31.327 INFO:teuthology.dispatcher.supervisor:Running job 7391033 2023-09-08T07:14:31.327 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391033 --name vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} -- /home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391033/orig.config.yaml 2023-09-08T07:14:31.331 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391033 2023-09-08T07:14:31.331 INFO:teuthology.dispatcher.supervisor:Job PID: 1740346 2023-09-08T07:14:31.332 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-08T07:16:31.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:18:31.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:20:31.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:22:31.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:24:32.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:26:32.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:28:32.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:30:32.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:32:32.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:34:33.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:36:33.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:38:33.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:40:33.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:42:33.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:44:33.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:46:34.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:48:34.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:50:34.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:52:34.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-08T07:52:34.625 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-08T07:52:34.834 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-08T07:52:34.835 INFO:teuthology.nuke:Checking targets against current locks 2023-09-08T07:52:34.886 DEBUG:teuthology.nuke:shortname: smithi145 2023-09-08T07:52:34.887 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-08T07:52:34.910 DEBUG:teuthology.nuke:shortname: smithi153 2023-09-08T07:52:34.910 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-08T07:52:34.913 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391033', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-08 07:04:21.008045', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCSi/vQR1XmKfTf4stnazSdeI6cDXrORvgFWLewL+j658958ziogU971YHdY2Uazzmd5zxGyYjjXpVsxRS5sdbc='} 2023-09-08T07:52:34.936 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-08_07:03:01-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7391033', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-08 07:04:21.009377', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHNQE+uoYNo516VLo1s1dIZgfUcHLXlfj/VVSK4NE/rYixnnlxJVgG7j0ePB+1srDw57Q4b+whE5tAbNpzadWOk='} 2023-09-08T07:52:34.968 INFO:teuthology.orchestra.console.smithi145:Power off 2023-09-08T07:52:34.968 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T07:52:34.987 INFO:teuthology.orchestra.console.smithi153:Power off 2023-09-08T07:52:34.987 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-08T07:52:34.995 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2023-09-08T07:52:34.995 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:52:35.007 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-09-08T07:52:35.007 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-08T07:52:35.014 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2023-09-08T07:52:35.027 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-09-08T07:52:35.115 INFO:teuthology.orchestra.console.smithi145:Power off completed 2023-09-08T07:52:35.128 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-09-08T07:52:35.266 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com 2023-09-08T07:52:35.275 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com