2023-10-16T02:38:25.840 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T02:38:25.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T02:38:25.978 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f612dee3670>, signals=[15]) 2023-10-16T02:38:25.979 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2023-10-16T02:38:25.980 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T02:38:25.980 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-10-16T02:38:26.006 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging 2023-10-16T02:38:26.006 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T02:38:26.006 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-10-16T02:38:26.008 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /host {"name": "smithi118"} 2023-10-16T02:38:26.030 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /host {"name": "smithi136"} 2023-10-16T02:38:26.086 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-16T02:38:26.107 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-16T02:38:26.129 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-16T02:38:26.129 DEBUG:teuthology.provision.fog.smithi118:FOG request: PUT /host/223 {"imageID": 2} 2023-10-16T02:38:26.146 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-16T02:38:26.147 DEBUG:teuthology.provision.fog.smithi136:FOG request: PUT /host/241 {"imageID": 2} 2023-10-16T02:38:26.176 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of ubuntu 20.04 2023-10-16T02:38:26.176 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:38:26.195 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of ubuntu 20.04 2023-10-16T02:38:26.195 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:38:26.218 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T02:38:26.236 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T02:38:26.254 DEBUG:teuthology.provision.fog.smithi118:FOG request: POST /host/223/task {"taskTypeID": 1} 2023-10-16T02:38:26.275 DEBUG:teuthology.provision.fog.smithi136:FOG request: POST /host/241/task {"taskTypeID": 1} 2023-10-16T02:38:26.303 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:38:26.321 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:38:26.380 INFO:teuthology.orchestra.console.smithi118:Power off 2023-10-16T02:38:26.380 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T02:38:26.393 INFO:teuthology.orchestra.console.smithi136:Power off 2023-10-16T02:38:26.393 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T02:38:26.404 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-10-16T02:38:26.404 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T02:38:26.414 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2023-10-16T02:38:26.415 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T02:38:26.426 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-10-16T02:38:26.437 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-10-16T02:38:30.430 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T02:38:30.438 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T02:38:30.540 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-10-16T02:38:30.547 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-10-16T02:38:34.542 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T02:38:34.549 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T02:38:34.650 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-10-16T02:38:34.657 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-10-16T02:38:34.751 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-10-16T02:38:34.758 INFO:teuthology.orchestra.console.smithi136:Power off completed 2023-10-16T02:38:34.853 INFO:teuthology.orchestra.console.smithi118:Power on 2023-10-16T02:38:34.853 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T02:38:34.860 INFO:teuthology.orchestra.console.smithi136:Power on 2023-10-16T02:38:34.861 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T02:38:34.874 DEBUG:teuthology.orchestra.console.smithi118:power on output: Chassis Power Control: Up/On 2023-10-16T02:38:34.875 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T02:38:34.894 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-10-16T02:38:34.901 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On 2023-10-16T02:38:34.901 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T02:38:34.923 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-10-16T02:38:38.898 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T02:38:38.924 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T02:38:39.007 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-10-16T02:38:39.033 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-10-16T02:38:43.012 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T02:38:43.034 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T02:38:43.123 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2023-10-16T02:38:43.142 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-10-16T02:38:43.224 INFO:teuthology.orchestra.console.smithi118:Power on completed 2023-10-16T02:38:43.243 INFO:teuthology.orchestra.console.smithi136:Power on completed 2023-10-16T02:38:43.326 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2023-10-16T02:38:43.326 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:38:43.344 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2023-10-16T02:38:43.345 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:38:58.398 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:38:58.400 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:39:13.466 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:39:13.467 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:39:28.532 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:39:28.534 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:39:43.606 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:39:43.608 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:39:58.688 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:39:58.690 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:40:13.758 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:40:13.760 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:40:28.819 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:40:28.821 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:40:43.890 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:40:43.892 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:40:58.974 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:40:58.976 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:41:14.050 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:41:14.052 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:41:29.126 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:41:29.127 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:41:44.194 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:41:44.196 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:41:59.261 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:41:59.263 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:42:14.347 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-16T02:42:14.349 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:42:14.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:42:17.466 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-16T02:42:23.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:42:26.554 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-16T02:42:29.423 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:42:32.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:42:35.610 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-16T02:42:41.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:42:44.470 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:42:44.666 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-16T02:42:50.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:42:53.754 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-16T02:42:59.522 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-10-16T02:42:59.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:42:59.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:43:02.650 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-10-16T02:43:02.814 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-16T02:43:08.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:43:08.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:43:11.706 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-10-16T02:43:11.866 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-16T02:43:17.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:43:17.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:43:20.766 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-10-16T02:43:26.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:43:29.850 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-10-16T02:43:35.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:43:38.906 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-10-16T02:43:44.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:43:47.998 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-10-16T02:43:49.913 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T02:43:49.914 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T02:43:54.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:43:57.082 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-10-16T02:44:03.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:44:10.766 INFO:teuthology.provision.fog.smithi136:Node is ready 2023-10-16T02:44:10.766 DEBUG:teuthology.orchestra.run.smithi136:> hostname 2023-10-16T02:44:10.773 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com 2023-10-16T02:44:10.774 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts 2023-10-16T02:44:10.781 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2023-10-16T02:44:10.782 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2023-10-16T02:44:10.864 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts 2023-10-16T02:44:10.879 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts 2023-10-16T02:44:10.893 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname 2023-10-16T02:44:10.904 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2023-10-16T02:44:10.965 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-10-16T02:44:10.970 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu" 2023-10-16T02:44:10.970 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-16T02:44:10.970 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu 2023-10-16T02:44:10.970 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian 2023-10-16T02:44:10.971 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-16T02:44:10.971 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="20.04" 2023-10-16T02:44:10.971 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-16T02:44:10.971 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-16T02:44:10.971 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-16T02:44:10.971 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-16T02:44:10.972 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=focal 2023-10-16T02:44:10.972 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=focal 2023-10-16T02:44:10.973 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2023-10-16T02:44:10.974 DEBUG:teuthology.parallel:result is None 2023-10-16T02:44:35.290 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T02:44:35.291 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T02:44:51.510 INFO:teuthology.provision.fog.smithi118:Node is ready 2023-10-16T02:44:51.510 DEBUG:teuthology.orchestra.run.smithi118:> hostname 2023-10-16T02:44:51.517 INFO:teuthology.orchestra.run.smithi118.stdout:smithi129 2023-10-16T02:44:51.518 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi129 /etc/hosts 2023-10-16T02:44:51.566 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.129 smithi129 smithi129 2023-10-16T02:44:51.567 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-10-16T02:44:51.677 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi129/smithi118/g' /etc/hosts 2023-10-16T02:44:51.695 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.129/172.21.15.118/g' /etc/hosts 2023-10-16T02:44:51.709 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi129/smithi118/g' /etc/hostname 2023-10-16T02:44:51.767 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-10-16T02:44:51.777 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-10-16T02:44:51.782 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Ubuntu" 2023-10-16T02:44:51.782 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-16T02:44:51.782 INFO:teuthology.orchestra.run.smithi118.stdout:ID=ubuntu 2023-10-16T02:44:51.782 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE=debian 2023-10-16T02:44:51.783 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-16T02:44:51.783 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="20.04" 2023-10-16T02:44:51.783 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-16T02:44:51.784 INFO:teuthology.orchestra.run.smithi118.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-16T02:44:51.784 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-16T02:44:51.784 INFO:teuthology.orchestra.run.smithi118.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-16T02:44:51.784 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_CODENAME=focal 2023-10-16T02:44:51.785 INFO:teuthology.orchestra.run.smithi118.stdout:UBUNTU_CODENAME=focal 2023-10-16T02:44:51.785 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2023-10-16T02:44:51.786 DEBUG:teuthology.parallel:result is None 2023-10-16T02:44:52.003 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2023-10-16T02:44:52.004 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T02:44:52.023 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2023-10-16T02:44:52.024 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T02:44:52.049 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2023-10-16T02:44:52.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-16T02:44:52.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:44:52.102 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-10-16T02:44:52.227 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-10-16T02:44:52.228 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-10-16T02:44:52.234 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-10-16T02:44:52.235 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-10-16T02:44:52.281 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Ubuntu" 2023-10-16T02:44:52.281 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-16T02:44:52.281 INFO:teuthology.orchestra.run.smithi118.stdout:ID=ubuntu 2023-10-16T02:44:52.282 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE=debian 2023-10-16T02:44:52.282 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-16T02:44:52.282 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="20.04" 2023-10-16T02:44:52.282 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-16T02:44:52.282 INFO:teuthology.orchestra.run.smithi118.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-16T02:44:52.283 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-16T02:44:52.283 INFO:teuthology.orchestra.run.smithi118.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-16T02:44:52.283 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_CODENAME=focal 2023-10-16T02:44:52.283 INFO:teuthology.orchestra.run.smithi118.stdout:UBUNTU_CODENAME=focal 2023-10-16T02:44:52.284 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-10-16T02:44:52.307 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2023-10-16T02:44:52.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-10-16T02:44:52.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T02:44:52.356 DEBUG:teuthology.orchestra.run.smithi136:> true 2023-10-16T02:44:52.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-10-16T02:44:52.570 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2023-10-16T02:44:52.576 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2023-10-16T02:44:52.576 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-10-16T02:44:52.582 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu" 2023-10-16T02:44:52.582 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-16T02:44:52.583 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu 2023-10-16T02:44:52.583 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian 2023-10-16T02:44:52.583 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-16T02:44:52.583 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="20.04" 2023-10-16T02:44:52.584 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-16T02:44:52.584 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-16T02:44:52.584 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-16T02:44:52.584 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-16T02:44:52.585 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=focal 2023-10-16T02:44:52.585 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=focal 2023-10-16T02:44:52.585 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-10-16T02:44:52.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T02:44:52.707 INFO:teuthology.dispatcher.supervisor:Running job 7427312 2023-10-16T02:44:52.708 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-10-14_01:51:22-fs-wip-vshankar-testing-20231013.093215-testing-default-smithi/7427312 --name vshankar-2023-10-14_01:51:22-fs-wip-vshankar-testing-20231013.093215-testing-default-smithi --description fs/shell/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell} -- /home/teuthworker/archive/vshankar-2023-10-14_01:51:22-fs-wip-vshankar-testing-20231013.093215-testing-default-smithi/7427312/orig.config.yaml 2023-10-16T02:44:52.712 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-10-14_01:51:22-fs-wip-vshankar-testing-20231013.093215-testing-default-smithi/7427312 2023-10-16T02:44:52.712 INFO:teuthology.dispatcher.supervisor:Job PID: 2371319 2023-10-16T02:44:52.713 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-16T02:46:52.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T02:48:52.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T02:50:53.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T02:52:53.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T02:54:53.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T02:56:53.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T02:58:53.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T03:00:53.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T03:02:54.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T03:04:54.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T03:06:54.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T03:06:54.538 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-16T03:06:54.646 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-16T03:06:54.646 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T03:06:54.695 DEBUG:teuthology.nuke:shortname: smithi118 2023-10-16T03:06:54.696 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T03:06:54.719 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-14_01:51:22-fs-wip-vshankar-testing-20231013.093215-testing-default-smithi/7427312', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 02:38:25.072168', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-16T03:06:54.723 DEBUG:teuthology.nuke:shortname: smithi136 2023-10-16T03:06:54.723 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T03:06:54.744 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-14_01:51:22-fs-wip-vshankar-testing-20231013.093215-testing-default-smithi/7427312', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 02:38:25.070762', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-16T03:06:54.768 INFO:teuthology.orchestra.console.smithi118:Power off 2023-10-16T03:06:54.768 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T03:06:54.789 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2023-10-16T03:06:54.789 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T03:06:54.804 INFO:teuthology.orchestra.console.smithi136:Power off 2023-10-16T03:06:54.805 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T03:06:54.813 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2023-10-16T03:06:54.824 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2023-10-16T03:06:54.825 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T03:06:54.845 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-10-16T03:06:54.915 INFO:teuthology.orchestra.console.smithi118:Power off completed 2023-10-16T03:06:54.946 INFO:teuthology.orchestra.console.smithi136:Power off completed 2023-10-16T03:06:55.063 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com 2023-10-16T03:06:55.095 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com