2023-08-21T07:54:50.099 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-21T07:54:50.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T07:54:50.218 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7ed86fcf70>, signals=[15]) 2023-08-21T07:54:50.219 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging 2023-08-21T07:54:50.220 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server 2023-08-21T07:54:50.220 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-08-21T07:54:50.239 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2023-08-21T07:54:50.240 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2023-08-21T07:54:50.240 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-08-21T07:54:50.241 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /host {"name": "smithi183"} 2023-08-21T07:54:50.265 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /host {"name": "smithi192"} 2023-08-21T07:54:50.309 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-21T07:54:50.320 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-21T07:54:50.350 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-21T07:54:50.351 DEBUG:teuthology.provision.fog.smithi183:FOG request: PUT /host/288 {"imageID": 6} 2023-08-21T07:54:50.370 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-21T07:54:50.370 DEBUG:teuthology.provision.fog.smithi192:FOG request: PUT /host/297 {"imageID": 6} 2023-08-21T07:54:50.393 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of ubuntu 22.04 2023-08-21T07:54:50.393 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:54:50.412 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of ubuntu 22.04 2023-08-21T07:54:50.412 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:54:50.438 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /tasktype {"name": "deploy"} 2023-08-21T07:54:50.452 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /tasktype {"name": "deploy"} 2023-08-21T07:54:50.472 DEBUG:teuthology.provision.fog.smithi183:FOG request: POST /host/288/task {"taskTypeID": 1} 2023-08-21T07:54:50.488 DEBUG:teuthology.provision.fog.smithi192:FOG request: POST /host/297/task {"taskTypeID": 1} 2023-08-21T07:54:50.595 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:54:50.627 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:54:50.671 INFO:teuthology.orchestra.console.smithi183:Power off 2023-08-21T07:54:50.672 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T07:54:50.692 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-08-21T07:54:50.693 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T07:54:50.710 INFO:teuthology.orchestra.console.smithi192:Power off 2023-08-21T07:54:50.711 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T07:54:50.720 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-08-21T07:54:50.733 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-08-21T07:54:50.733 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T07:54:50.763 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-08-21T07:54:54.726 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T07:54:54.765 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T07:54:54.836 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-08-21T07:54:54.875 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-08-21T07:54:58.841 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T07:54:58.876 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T07:54:58.951 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-08-21T07:54:58.985 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-08-21T07:54:59.053 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-08-21T07:54:59.086 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-08-21T07:54:59.154 INFO:teuthology.orchestra.console.smithi183:Power on 2023-08-21T07:54:59.154 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-21T07:54:59.172 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On 2023-08-21T07:54:59.173 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T07:54:59.187 INFO:teuthology.orchestra.console.smithi192:Power on 2023-08-21T07:54:59.187 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-21T07:54:59.195 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-08-21T07:54:59.205 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2023-08-21T07:54:59.206 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T07:54:59.224 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-08-21T07:55:03.198 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T07:55:03.225 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T07:55:03.307 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-08-21T07:55:03.334 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-08-21T07:55:07.313 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T07:55:07.335 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T07:55:07.423 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-08-21T07:55:07.446 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-08-21T07:55:07.524 INFO:teuthology.orchestra.console.smithi183:Power on completed 2023-08-21T07:55:07.547 INFO:teuthology.orchestra.console.smithi192:Power on completed 2023-08-21T07:55:07.625 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2023-08-21T07:55:07.626 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:55:07.647 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2023-08-21T07:55:07.648 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:55:22.706 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:55:22.707 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:55:37.785 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:55:37.786 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:55:52.861 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:55:52.863 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:56:07.940 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:56:07.941 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:56:23.022 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:56:23.024 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:56:38.101 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:56:38.102 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:56:53.182 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:56:53.183 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:57:08.255 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:57:08.256 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:57:23.345 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:57:23.346 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:57:38.434 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:57:38.435 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:57:53.514 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:57:53.515 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:58:08.570 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:58:08.573 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:58:23.637 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-08-21T07:58:23.639 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-21T07:58:23.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T07:58:23.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T07:58:42.032 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-21T07:58:42.034 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-08-21T07:58:48.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T07:58:48.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T07:58:51.120 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-21T07:58:51.121 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-08-21T07:58:57.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T07:58:57.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T07:59:00.208 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-21T07:59:00.209 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-08-21T07:59:06.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T07:59:06.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T07:59:09.296 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-21T07:59:09.297 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-08-21T07:59:15.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T07:59:15.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T07:59:33.744 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-21T07:59:39.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T07:59:42.832 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-21T07:59:48.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T07:59:51.920 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-21T07:59:57.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T07:59:57.928 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-21T08:00:03.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:00:03.936 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-21T08:00:09.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:00:09.939 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-21T08:00:15.308 WARNING:teuthology.provision.fog.smithi183:timed out 2023-08-21T08:00:15.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:00:15.943 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-21T08:00:21.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:00:21.525 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-21T08:00:21.526 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-21T08:00:21.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:00:21.967 INFO:teuthology.provision.fog.smithi183:Node is ready 2023-08-21T08:00:21.968 DEBUG:teuthology.orchestra.run.smithi183:> hostname 2023-08-21T08:00:22.013 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2023-08-21T08:00:22.013 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts 2023-08-21T08:00:22.061 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2023-08-21T08:00:22.061 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-08-21T08:00:22.127 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-21T08:00:22.127 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-21T08:00:22.232 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts 2023-08-21T08:00:22.248 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts 2023-08-21T08:00:22.301 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname 2023-08-21T08:00:22.361 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-08-21T08:00:22.416 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-08-21T08:00:22.469 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-21T08:00:22.469 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu" 2023-08-21T08:00:22.469 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="22.04" 2023-08-21T08:00:22.469 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-21T08:00:22.470 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=jammy 2023-08-21T08:00:22.470 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu 2023-08-21T08:00:22.470 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian 2023-08-21T08:00:22.470 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-21T08:00:22.470 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-21T08:00:22.470 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-21T08:00:22.470 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-21T08:00:22.470 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=jammy 2023-08-21T08:00:22.471 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2023-08-21T08:00:22.473 DEBUG:teuthology.parallel:result is None 2023-08-21T08:00:22.797 INFO:teuthology.provision.fog.smithi192:Node is ready 2023-08-21T08:00:22.798 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2023-08-21T08:00:22.846 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2023-08-21T08:00:22.847 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2023-08-21T08:00:22.895 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2023-08-21T08:00:22.896 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-08-21T08:00:23.036 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2023-08-21T08:00:23.050 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2023-08-21T08:00:23.106 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2023-08-21T08:00:23.162 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-08-21T08:00:23.217 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-08-21T08:00:23.263 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-21T08:00:23.263 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu" 2023-08-21T08:00:23.264 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="22.04" 2023-08-21T08:00:23.264 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-21T08:00:23.264 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=jammy 2023-08-21T08:00:23.265 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu 2023-08-21T08:00:23.265 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian 2023-08-21T08:00:23.265 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-21T08:00:23.266 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-21T08:00:23.266 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-21T08:00:23.266 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-21T08:00:23.267 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=jammy 2023-08-21T08:00:23.267 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2023-08-21T08:00:23.268 DEBUG:teuthology.parallel:result is None 2023-08-21T08:00:23.417 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2023-08-21T08:00:23.418 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-21T08:00:23.443 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2023-08-21T08:00:23.443 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-21T08:00:23.522 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2023-08-21T08:00:23.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-08-21T08:00:23.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:00:23.599 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-08-21T08:00:23.687 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-08-21T08:00:23.688 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-08-21T08:00:23.732 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-08-21T08:00:23.732 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-08-21T08:00:23.776 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-21T08:00:23.776 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu" 2023-08-21T08:00:23.776 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="22.04" 2023-08-21T08:00:23.777 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-21T08:00:23.777 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=jammy 2023-08-21T08:00:23.777 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu 2023-08-21T08:00:23.777 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian 2023-08-21T08:00:23.777 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-21T08:00:23.777 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-21T08:00:23.777 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-21T08:00:23.777 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-21T08:00:23.778 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=jammy 2023-08-21T08:00:23.778 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-08-21T08:00:23.801 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2023-08-21T08:00:23.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-08-21T08:00:23.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-21T08:00:23.875 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-08-21T08:00:23.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-08-21T08:00:23.968 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-08-21T08:00:24.017 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-08-21T08:00:24.018 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-08-21T08:00:24.065 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-21T08:00:24.066 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu" 2023-08-21T08:00:24.066 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="22.04" 2023-08-21T08:00:24.066 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-21T08:00:24.066 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=jammy 2023-08-21T08:00:24.066 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu 2023-08-21T08:00:24.067 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian 2023-08-21T08:00:24.067 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-21T08:00:24.067 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-21T08:00:24.067 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-21T08:00:24.067 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-21T08:00:24.067 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=jammy 2023-08-21T08:00:24.068 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-08-21T08:00:24.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:00:24.165 INFO:teuthology.dispatcher.supervisor:Running job 7373936 2023-08-21T08:00:24.165 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-08-21_07:53:19-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi/7373936 --name mchangir-2023-08-21_07:53:19-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/mchangir-2023-08-21_07:53:19-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi/7373936/orig.config.yaml 2023-08-21T08:00:24.169 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-08-21_07:53:19-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi/7373936 2023-08-21T08:00:24.170 INFO:teuthology.dispatcher.supervisor:Job PID: 9732 2023-08-21T08:00:24.170 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-21T08:02:24.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:04:24.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:06:24.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:08:24.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:10:24.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:12:24.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:14:25.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:16:25.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:18:25.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:20:25.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:22:25.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:24:25.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:26:25.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:28:26.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:30:26.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:32:26.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:34:26.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:36:26.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:38:26.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:40:26.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:42:27.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:44:27.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:46:27.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:48:27.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:50:27.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:52:27.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:54:28.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:56:28.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T08:58:28.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:00:28.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:02:28.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:04:28.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:06:29.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:08:29.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:10:29.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:12:29.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:14:30.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:16:30.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:18:30.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:20:30.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:22:30.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:24:31.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:26:31.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:28:31.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:30:31.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:32:31.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:34:31.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:36:31.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:38:32.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:40:32.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:42:32.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:44:32.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:46:32.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:48:33.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:50:33.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:52:33.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:54:33.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-21T09:54:33.472 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-21T09:54:33.600 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-21T09:54:33.600 INFO:teuthology.nuke:Checking targets against current locks 2023-08-21T09:54:33.647 DEBUG:teuthology.nuke:shortname: smithi183 2023-08-21T09:54:33.647 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-21T09:54:33.668 DEBUG:teuthology.nuke:shortname: smithi192 2023-08-21T09:54:33.668 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-21T09:54:33.670 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-08-21_07:53:19-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi/7373936', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 07:54:49.333732', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAOnghNldNRFaXbEQOjyUH4PpZUci+t2rbtWn0OXOOriL6D60y0b60PDfMqWFivn17U5oTmSNnHvPOTGDW39jbo='} 2023-08-21T09:54:33.690 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-08-21_07:53:19-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi/7373936', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-21 07:54:49.335640', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAvMoxaDXto+BminxTNLrgTja9YpRN3SnoL0oZZBw+A5X7qUHIouPq/4o0tz5p4ZIFucQFrN2zlZLsrVwhdYnsA='} 2023-08-21T09:54:33.735 INFO:teuthology.orchestra.console.smithi192:Power off 2023-08-21T09:54:33.735 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T09:54:33.749 INFO:teuthology.orchestra.console.smithi183:Power off 2023-08-21T09:54:33.750 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-21T09:54:33.758 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-08-21T09:54:33.759 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T09:54:33.770 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-08-21T09:54:33.771 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-21T09:54:33.778 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-08-21T09:54:33.790 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-08-21T09:54:33.880 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-08-21T09:54:33.891 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-08-21T09:54:34.029 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com 2023-08-21T09:54:34.038 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com