2023-10-17T02:02:09.615 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-17T02:02:09.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:02:09.759 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f52032b6670>, signals=[15]) 2023-10-17T02:02:09.761 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging 2023-10-17T02:02:09.761 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server 2023-10-17T02:02:09.761 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-10-17T02:02:09.780 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging 2023-10-17T02:02:09.780 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server 2023-10-17T02:02:09.781 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-10-17T02:02:09.783 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /host {"name": "smithi155"} 2023-10-17T02:02:09.806 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /host {"name": "smithi178"} 2023-10-17T02:02:09.866 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-17T02:02:09.870 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-17T02:02:09.907 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-17T02:02:09.908 DEBUG:teuthology.provision.fog.smithi155:FOG request: PUT /host/260 {"imageID": 6} 2023-10-17T02:02:09.913 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-17T02:02:09.913 DEBUG:teuthology.provision.fog.smithi178:FOG request: PUT /host/283 {"imageID": 6} 2023-10-17T02:02:09.953 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of ubuntu 22.04 2023-10-17T02:02:09.954 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:02:09.965 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of ubuntu 22.04 2023-10-17T02:02:09.965 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:02:10.001 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /tasktype {"name": "deploy"} 2023-10-17T02:02:10.005 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /tasktype {"name": "deploy"} 2023-10-17T02:02:10.038 DEBUG:teuthology.provision.fog.smithi178:FOG request: POST /host/283/task {"taskTypeID": 1} 2023-10-17T02:02:10.043 DEBUG:teuthology.provision.fog.smithi155:FOG request: POST /host/260/task {"taskTypeID": 1} 2023-10-17T02:02:10.084 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:02:10.090 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:02:10.168 INFO:teuthology.orchestra.console.smithi178:Power off 2023-10-17T02:02:10.169 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T02:02:10.182 INFO:teuthology.orchestra.console.smithi155:Power off 2023-10-17T02:02:10.183 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T02:02:10.191 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2023-10-17T02:02:10.192 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T02:02:10.205 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-10-17T02:02:10.206 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T02:02:10.215 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-10-17T02:02:10.228 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-10-17T02:02:14.219 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T02:02:14.229 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T02:02:14.329 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-10-17T02:02:14.337 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-10-17T02:02:18.334 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T02:02:18.340 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T02:02:18.443 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-10-17T02:02:18.450 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-10-17T02:02:18.544 INFO:teuthology.orchestra.console.smithi178:Power off completed 2023-10-17T02:02:18.551 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-10-17T02:02:18.646 INFO:teuthology.orchestra.console.smithi178:Power on 2023-10-17T02:02:18.646 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-17T02:02:18.653 INFO:teuthology.orchestra.console.smithi155:Power on 2023-10-17T02:02:18.654 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-17T02:02:18.668 DEBUG:teuthology.orchestra.console.smithi178:power on output: Chassis Power Control: Up/On 2023-10-17T02:02:18.669 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T02:02:18.678 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On 2023-10-17T02:02:18.678 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T02:02:18.690 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-10-17T02:02:18.699 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-10-17T02:02:22.694 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T02:02:22.701 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T02:02:22.804 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-10-17T02:02:22.810 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-10-17T02:02:26.806 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T02:02:26.813 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T02:02:26.921 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-10-17T02:02:27.022 INFO:teuthology.orchestra.console.smithi178:Power on completed 2023-10-17T02:02:27.031 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-10-17T02:02:27.123 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2023-10-17T02:02:27.124 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:02:27.133 INFO:teuthology.orchestra.console.smithi155:Power on completed 2023-10-17T02:02:27.234 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2023-10-17T02:02:27.234 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:02:42.199 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:02:42.288 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:02:57.266 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:02:57.350 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:03:12.334 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:03:12.403 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:03:27.405 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:03:27.466 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:03:42.470 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:03:42.519 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:03:57.538 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:03:57.573 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:04:12.614 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:04:12.623 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:04:27.690 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:04:27.692 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:04:42.764 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:04:42.766 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:04:57.854 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:04:57.856 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:05:12.926 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:05:12.928 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:05:27.988 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:05:27.990 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:05:43.082 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-10-17T02:05:43.084 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:05:43.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:05:58.162 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-10-17T02:05:58.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:06:01.594 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-17T02:06:07.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:06:10.654 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-17T02:06:16.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:06:16.702 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-10-17T02:06:19.738 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-17T02:06:22.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:06:25.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:06:25.818 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-10-17T02:06:28.798 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-17T02:06:31.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:06:34.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:06:34.878 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-10-17T02:06:37.882 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-17T02:06:40.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:06:43.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:06:43.966 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-10-17T02:06:46.942 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-10-17T02:06:49.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:06:52.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:06:53.050 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-10-17T02:06:59.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:07:02.110 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-10-17T02:07:08.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:07:39.643 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-10-17T02:07:45.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:07:45.649 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-10-17T02:07:51.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:07:51.657 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-10-17T02:07:52.950 WARNING:teuthology.provision.fog.smithi155:timed out 2023-10-17T02:07:57.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:07:57.665 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-10-17T02:07:58.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:07:59.165 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-17T02:07:59.166 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-17T02:07:59.622 INFO:teuthology.provision.fog.smithi155:Node is ready 2023-10-17T02:07:59.622 DEBUG:teuthology.orchestra.run.smithi155:> hostname 2023-10-17T02:07:59.667 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2023-10-17T02:07:59.668 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts 2023-10-17T02:07:59.716 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2023-10-17T02:07:59.716 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-10-17T02:07:59.864 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts 2023-10-17T02:07:59.880 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts 2023-10-17T02:07:59.937 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname 2023-10-17T02:07:59.996 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-10-17T02:08:00.051 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-10-17T02:08:00.100 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-17T02:08:00.100 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu" 2023-10-17T02:08:00.100 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="22.04" 2023-10-17T02:08:00.101 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-17T02:08:00.101 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=jammy 2023-10-17T02:08:00.101 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu 2023-10-17T02:08:00.101 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian 2023-10-17T02:08:00.101 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-17T02:08:00.102 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-17T02:08:00.102 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-17T02:08:00.102 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-17T02:08:00.102 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=jammy 2023-10-17T02:08:00.103 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2023-10-17T02:08:00.104 DEBUG:teuthology.parallel:result is None 2023-10-17T02:08:03.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:08:03.671 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-10-17T02:08:09.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:08:09.900 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-17T02:08:09.900 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-17T02:08:10.345 INFO:teuthology.provision.fog.smithi178:Node is ready 2023-10-17T02:08:10.345 DEBUG:teuthology.orchestra.run.smithi178:> hostname 2023-10-17T02:08:10.392 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com 2023-10-17T02:08:10.392 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts 2023-10-17T02:08:10.441 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178 2023-10-17T02:08:10.441 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-10-17T02:08:10.583 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts 2023-10-17T02:08:10.598 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts 2023-10-17T02:08:10.653 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname 2023-10-17T02:08:10.713 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-10-17T02:08:10.771 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-10-17T02:08:10.820 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-17T02:08:10.821 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Ubuntu" 2023-10-17T02:08:10.821 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="22.04" 2023-10-17T02:08:10.821 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-17T02:08:10.821 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_CODENAME=jammy 2023-10-17T02:08:10.821 INFO:teuthology.orchestra.run.smithi178.stdout:ID=ubuntu 2023-10-17T02:08:10.822 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE=debian 2023-10-17T02:08:10.822 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-17T02:08:10.822 INFO:teuthology.orchestra.run.smithi178.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-17T02:08:10.822 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-17T02:08:10.822 INFO:teuthology.orchestra.run.smithi178.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-17T02:08:10.823 INFO:teuthology.orchestra.run.smithi178.stdout:UBUNTU_CODENAME=jammy 2023-10-17T02:08:10.823 INFO:teuthology.provision.fog.smithi178:Deploy complete! 2023-10-17T02:08:10.824 DEBUG:teuthology.parallel:result is None 2023-10-17T02:08:11.000 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2023-10-17T02:08:11.000 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-17T02:08:11.025 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com 2023-10-17T02:08:11.025 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-17T02:08:11.042 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2023-10-17T02:08:11.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-17T02:08:11.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:08:11.118 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-10-17T02:08:11.222 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-10-17T02:08:11.222 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-10-17T02:08:11.270 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-10-17T02:08:11.271 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-10-17T02:08:11.315 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-17T02:08:11.315 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu" 2023-10-17T02:08:11.315 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="22.04" 2023-10-17T02:08:11.316 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-17T02:08:11.316 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=jammy 2023-10-17T02:08:11.316 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu 2023-10-17T02:08:11.316 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian 2023-10-17T02:08:11.316 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-17T02:08:11.317 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-17T02:08:11.317 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-17T02:08:11.317 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-17T02:08:11.317 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=jammy 2023-10-17T02:08:11.318 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-10-17T02:08:11.341 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server 2023-10-17T02:08:11.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-10-17T02:08:11.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T02:08:11.419 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-10-17T02:08:11.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-10-17T02:08:11.515 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2023-10-17T02:08:11.560 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-10-17T02:08:11.560 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-10-17T02:08:11.612 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-17T02:08:11.612 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Ubuntu" 2023-10-17T02:08:11.612 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="22.04" 2023-10-17T02:08:11.612 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-17T02:08:11.612 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_CODENAME=jammy 2023-10-17T02:08:11.613 INFO:teuthology.orchestra.run.smithi178.stdout:ID=ubuntu 2023-10-17T02:08:11.613 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE=debian 2023-10-17T02:08:11.613 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-17T02:08:11.613 INFO:teuthology.orchestra.run.smithi178.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-17T02:08:11.613 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-17T02:08:11.614 INFO:teuthology.orchestra.run.smithi178.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-17T02:08:11.614 INFO:teuthology.orchestra.run.smithi178.stdout:UBUNTU_CODENAME=jammy 2023-10-17T02:08:11.614 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-10-17T02:08:11.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:08:11.713 INFO:teuthology.dispatcher.supervisor:Running job 7431016 2023-10-17T02:08:11.713 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-10-17_01:52:53-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7431016 --name mchangir-2023-10-17_01:52:53-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/mchangir-2023-10-17_01:52:53-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7431016/orig.config.yaml 2023-10-17T02:08:11.716 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-10-17_01:52:53-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7431016 2023-10-17T02:08:11.716 INFO:teuthology.dispatcher.supervisor:Job PID: 3710830 2023-10-17T02:08:11.717 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-17T02:10:11.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:12:11.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:14:12.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:16:12.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:18:12.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:20:12.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:22:12.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:24:13.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:26:13.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:28:13.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:30:13.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:32:13.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:34:13.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:36:14.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:38:14.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:40:14.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:42:14.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:44:14.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:46:14.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:48:14.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:50:15.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:52:15.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:54:15.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:56:15.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T02:58:15.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:00:15.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:02:16.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:04:16.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:06:16.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:08:16.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:10:16.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:12:16.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:14:17.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:16:17.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:18:17.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:20:17.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:22:17.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:24:17.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:26:18.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:28:18.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:30:18.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:32:18.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:34:18.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:36:19.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:38:19.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:40:19.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:42:19.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:44:19.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:46:19.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:48:19.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:50:20.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:52:20.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:54:20.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:56:20.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T03:58:20.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T04:00:20.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T04:02:21.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T04:04:21.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T04:04:21.375 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-17T04:04:21.567 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-17T04:04:21.567 INFO:teuthology.nuke:Checking targets against current locks 2023-10-17T04:04:21.616 DEBUG:teuthology.nuke:shortname: smithi155 2023-10-17T04:04:21.617 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-17T04:04:21.630 DEBUG:teuthology.nuke:shortname: smithi178 2023-10-17T04:04:21.630 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-17T04:04:21.637 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-10-17_01:52:53-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7431016', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-17 02:02:08.735198', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHwwAscTFGKjqjXc4KKGKsBcICllUDNj0pKN5abSERwfv5Mc8m9MI2hRosM9fxqIpFFPRsojdlCoR67a+kJbw48='} 2023-10-17T04:04:21.648 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-10-17_01:52:53-fs-wip-mchangir-mgr-snap_schedule-support-subvol-and-group-arguments-distro-default-smithi/7431016', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-17 02:02:08.737237', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAVJPEBKLhCicKr83EOVhvP4X0+oPlznbEe4sVZ50G2Nqpfi5iztDO/Zty+URzTHT4xnxrocA28uueiWEWPZoZQ='} 2023-10-17T04:04:21.683 INFO:teuthology.orchestra.console.smithi155:Power off 2023-10-17T04:04:21.684 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T04:04:21.697 INFO:teuthology.orchestra.console.smithi178:Power off 2023-10-17T04:04:21.698 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T04:04:21.705 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-10-17T04:04:21.706 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T04:04:21.718 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2023-10-17T04:04:21.719 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T04:04:21.728 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-10-17T04:04:21.741 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-10-17T04:04:21.830 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-10-17T04:04:21.842 INFO:teuthology.orchestra.console.smithi178:Power off completed 2023-10-17T04:04:21.981 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com 2023-10-17T04:04:21.989 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com