2023-09-13T14:11:06.086 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-13T14:11:06.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:11:06.224 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9fdb342670>, signals=[15]) 2023-09-13T14:11:06.226 INFO:teuthology.lock.ops:Start node 'smithi061.front.sepia.ceph.com' reimaging 2023-09-13T14:11:06.226 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: reset os type and version on server 2023-09-13T14:11:06.226 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-09-13T14:11:06.246 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2023-09-13T14:11:06.247 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2023-09-13T14:11:06.247 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-09-13T14:11:06.248 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /host {"name": "smithi061"} 2023-09-13T14:11:06.271 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /host {"name": "smithi142"} 2023-09-13T14:11:06.327 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-13T14:11:06.338 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-13T14:11:06.373 DEBUG:teuthology.provision.fog.smithi061:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-13T14:11:06.374 DEBUG:teuthology.provision.fog.smithi061:FOG request: PUT /host/166 {"imageID": 6} 2023-09-13T14:11:06.387 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-13T14:11:06.387 DEBUG:teuthology.provision.fog.smithi142:FOG request: PUT /host/247 {"imageID": 6} 2023-09-13T14:11:06.432 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of ubuntu 22.04 2023-09-13T14:11:06.433 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:11:06.440 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of ubuntu 22.04 2023-09-13T14:11:06.440 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:11:06.500 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /tasktype {"name": "deploy"} 2023-09-13T14:11:06.502 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /tasktype {"name": "deploy"} 2023-09-13T14:11:06.543 DEBUG:teuthology.provision.fog.smithi142:FOG request: POST /host/247/task {"taskTypeID": 1} 2023-09-13T14:11:06.546 DEBUG:teuthology.provision.fog.smithi061:FOG request: POST /host/166/task {"taskTypeID": 1} 2023-09-13T14:11:06.622 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:11:06.625 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:11:06.748 INFO:teuthology.orchestra.console.smithi061:Power off 2023-09-13T14:11:06.749 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T14:11:06.760 INFO:teuthology.orchestra.console.smithi142:Power off 2023-09-13T14:11:06.761 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T14:11:06.770 DEBUG:teuthology.orchestra.console.smithi061:power off output: Chassis Power Control: Down/Off 2023-09-13T14:11:06.770 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:11:06.781 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-09-13T14:11:06.782 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:11:06.790 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-09-13T14:11:06.801 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-09-13T14:11:10.794 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:11:10.803 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:11:10.903 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-09-13T14:11:10.911 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-09-13T14:11:14.906 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:11:14.912 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:11:15.015 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-09-13T14:11:15.021 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-09-13T14:11:19.020 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:11:19.026 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:11:19.129 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-09-13T14:11:19.135 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-09-13T14:11:19.231 INFO:teuthology.orchestra.console.smithi061:Power off completed 2023-09-13T14:11:19.236 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-09-13T14:11:19.332 INFO:teuthology.orchestra.console.smithi061:Power on 2023-09-13T14:11:19.332 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-13T14:11:19.340 INFO:teuthology.orchestra.console.smithi142:Power on 2023-09-13T14:11:19.341 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-13T14:11:19.355 DEBUG:teuthology.orchestra.console.smithi061:power on output: Chassis Power Control: Up/On 2023-09-13T14:11:19.355 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:11:19.363 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On 2023-09-13T14:11:19.364 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:11:19.376 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-09-13T14:11:19.383 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-09-13T14:11:23.382 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:11:23.389 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:11:23.491 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-09-13T14:11:23.497 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-09-13T14:11:23.593 INFO:teuthology.orchestra.console.smithi061:Power on completed 2023-09-13T14:11:23.601 INFO:teuthology.orchestra.console.smithi142:Power on completed 2023-09-13T14:11:23.694 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish 2023-09-13T14:11:23.695 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:11:23.701 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2023-09-13T14:11:23.702 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:11:38.770 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:11:38.772 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:11:53.846 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:11:53.848 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:12:08.926 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:12:08.928 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:12:24.017 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:12:24.019 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:12:39.106 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:12:39.108 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:12:54.194 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:12:54.196 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:13:09.277 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:13:09.279 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:13:24.359 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:13:24.360 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:13:39.438 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:13:39.440 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:13:54.518 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:13:54.520 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:14:09.606 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:14:09.608 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:14:24.698 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:14:24.701 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:14:39.790 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-09-13T14:14:39.792 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-09-13T14:14:39.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:14:39.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:14:42.906 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-09-13T14:14:42.907 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-13T14:14:48.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:14:48.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:14:51.966 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-09-13T14:14:51.998 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-13T14:14:57.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:14:58.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:01.050 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-13T14:15:01.050 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-09-13T14:15:07.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:07.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:10.110 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-13T14:15:10.142 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-09-13T14:15:16.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:16.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:19.194 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-13T14:15:19.195 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-09-13T14:15:25.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:25.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:28.250 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-13T14:15:28.282 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-09-13T14:15:34.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:34.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:37.338 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-13T14:15:43.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:15:46.394 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-13T14:15:52.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:23.963 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-13T14:16:29.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:29.969 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-13T14:16:34.293 WARNING:teuthology.provision.fog.smithi142:timed out 2023-09-13T14:16:35.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:35.974 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-13T14:16:40.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:40.511 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-13T14:16:40.512 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-13T14:16:40.960 INFO:teuthology.provision.fog.smithi142:Node is ready 2023-09-13T14:16:40.961 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2023-09-13T14:16:41.011 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2023-09-13T14:16:41.011 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2023-09-13T14:16:41.063 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2023-09-13T14:16:41.064 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-09-13T14:16:41.170 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2023-09-13T14:16:41.184 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2023-09-13T14:16:41.239 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2023-09-13T14:16:41.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-09-13T14:16:41.349 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-09-13T14:16:41.394 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-13T14:16:41.395 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu" 2023-09-13T14:16:41.395 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="22.04" 2023-09-13T14:16:41.395 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-13T14:16:41.395 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=jammy 2023-09-13T14:16:41.395 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu 2023-09-13T14:16:41.396 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian 2023-09-13T14:16:41.396 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-13T14:16:41.396 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-13T14:16:41.396 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-13T14:16:41.396 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-13T14:16:41.397 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=jammy 2023-09-13T14:16:41.397 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2023-09-13T14:16:41.399 DEBUG:teuthology.parallel:result is None 2023-09-13T14:16:41.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:41.979 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-09-13T14:16:47.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:48.516 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-13T14:16:48.517 DEBUG:teuthology.orchestra.run.smithi061:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-13T14:16:49.206 INFO:teuthology.provision.fog.smithi061:Node is ready 2023-09-13T14:16:49.207 DEBUG:teuthology.orchestra.run.smithi061:> hostname 2023-09-13T14:16:49.253 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com 2023-09-13T14:16:49.253 DEBUG:teuthology.orchestra.run.smithi061:> grep smithi061.front.sepia.ceph.com /etc/hosts 2023-09-13T14:16:49.301 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061 2023-09-13T14:16:49.302 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-09-13T14:16:49.488 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hosts 2023-09-13T14:16:49.503 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/172.21.15.61/172.21.15.61/g' /etc/hosts 2023-09-13T14:16:49.557 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hostname 2023-09-13T14:16:49.617 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-09-13T14:16:49.671 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-09-13T14:16:49.717 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-13T14:16:49.718 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Ubuntu" 2023-09-13T14:16:49.718 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="22.04" 2023-09-13T14:16:49.718 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-13T14:16:49.719 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_CODENAME=jammy 2023-09-13T14:16:49.719 INFO:teuthology.orchestra.run.smithi061.stdout:ID=ubuntu 2023-09-13T14:16:49.719 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE=debian 2023-09-13T14:16:49.719 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-13T14:16:49.719 INFO:teuthology.orchestra.run.smithi061.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-13T14:16:49.720 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-13T14:16:49.720 INFO:teuthology.orchestra.run.smithi061.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-13T14:16:49.720 INFO:teuthology.orchestra.run.smithi061.stdout:UBUNTU_CODENAME=jammy 2023-09-13T14:16:49.721 INFO:teuthology.provision.fog.smithi061:Deploy complete! 2023-09-13T14:16:49.721 DEBUG:teuthology.parallel:result is None 2023-09-13T14:16:49.912 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com 2023-09-13T14:16:49.913 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-13T14:16:49.938 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2023-09-13T14:16:49.939 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-13T14:16:49.964 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server 2023-09-13T14:16:49.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-09-13T14:16:49.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:50.046 DEBUG:teuthology.orchestra.run.smithi061:> true 2023-09-13T14:16:50.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-09-13T14:16:50.138 DEBUG:teuthology.orchestra.run.smithi061:> uname -m 2023-09-13T14:16:50.187 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2023-09-13T14:16:50.188 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-09-13T14:16:50.236 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-13T14:16:50.237 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Ubuntu" 2023-09-13T14:16:50.237 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="22.04" 2023-09-13T14:16:50.237 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-13T14:16:50.238 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_CODENAME=jammy 2023-09-13T14:16:50.238 INFO:teuthology.orchestra.run.smithi061.stdout:ID=ubuntu 2023-09-13T14:16:50.238 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE=debian 2023-09-13T14:16:50.239 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-13T14:16:50.239 INFO:teuthology.orchestra.run.smithi061.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-13T14:16:50.240 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-13T14:16:50.240 INFO:teuthology.orchestra.run.smithi061.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-13T14:16:50.240 INFO:teuthology.orchestra.run.smithi061.stdout:UBUNTU_CODENAME=jammy 2023-09-13T14:16:50.241 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-09-13T14:16:50.263 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2023-09-13T14:16:50.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-09-13T14:16:50.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T14:16:50.342 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-09-13T14:16:50.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-09-13T14:16:50.438 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-09-13T14:16:50.491 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-09-13T14:16:50.491 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-09-13T14:16:50.542 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-13T14:16:50.542 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu" 2023-09-13T14:16:50.543 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="22.04" 2023-09-13T14:16:50.543 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-13T14:16:50.543 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=jammy 2023-09-13T14:16:50.543 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu 2023-09-13T14:16:50.543 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian 2023-09-13T14:16:50.544 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-13T14:16:50.544 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-13T14:16:50.544 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-13T14:16:50.544 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-13T14:16:50.544 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=jammy 2023-09-13T14:16:50.545 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-09-13T14:16:50.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:16:50.658 INFO:teuthology.dispatcher.supervisor:Running job 7396267 2023-09-13T14:16:50.659 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-09-13_10:54:59-fs-wip-vshankar-testing-20230913.074344-testing-default-smithi/7396267 --name vshankar-2023-09-13_10:54:59-fs-wip-vshankar-testing-20230913.074344-testing-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} -- /home/teuthworker/archive/vshankar-2023-09-13_10:54:59-fs-wip-vshankar-testing-20230913.074344-testing-default-smithi/7396267/orig.config.yaml 2023-09-13T14:16:50.662 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-09-13_10:54:59-fs-wip-vshankar-testing-20230913.074344-testing-default-smithi/7396267 2023-09-13T14:16:50.663 INFO:teuthology.dispatcher.supervisor:Job PID: 396173 2023-09-13T14:16:50.663 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-13T14:18:50.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:20:50.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:22:51.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:24:51.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:26:51.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:28:51.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:30:51.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:32:51.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:34:52.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:36:52.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:38:52.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T14:38:52.493 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-13T14:38:52.661 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-13T14:38:52.662 INFO:teuthology.nuke:Checking targets against current locks 2023-09-13T14:38:52.709 DEBUG:teuthology.nuke:shortname: smithi061 2023-09-13T14:38:52.710 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T14:38:52.728 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-13_10:54:59-fs-wip-vshankar-testing-20230913.074344-testing-default-smithi/7396267', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 14:11:05.181808', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOs0ZqE8n5dcP+S8s0bYvcU9d3Etrnplv3oU0wbk1dXHImiG8EmBcz+WmocwzfAuXNJlTU/ZJzD3Pst1wpseSm0='} 2023-09-13T14:38:52.741 DEBUG:teuthology.nuke:shortname: smithi142 2023-09-13T14:38:52.741 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T14:38:52.759 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-13_10:54:59-fs-wip-vshankar-testing-20230913.074344-testing-default-smithi/7396267', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 14:11:05.183197', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF56uyfDXxPpFMaBL/w8jgFNgq4GMEAFb53U9oKsTIeR/te4rIqVk8TeXBbpyI56MJtrC5ylWlgn+JENguuiY4Q='} 2023-09-13T14:38:52.776 INFO:teuthology.orchestra.console.smithi061:Power off 2023-09-13T14:38:52.776 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T14:38:52.798 DEBUG:teuthology.orchestra.console.smithi061:power off output: Chassis Power Control: Down/Off 2023-09-13T14:38:52.798 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:38:52.814 INFO:teuthology.orchestra.console.smithi142:Power off 2023-09-13T14:38:52.815 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T14:38:52.822 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-09-13T14:38:52.834 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-09-13T14:38:52.835 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T14:38:52.855 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-09-13T14:38:52.923 INFO:teuthology.orchestra.console.smithi061:Power off completed 2023-09-13T14:38:52.957 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-09-13T14:38:53.075 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com 2023-09-13T14:38:53.100 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com