2023-10-10T11:54:56.874 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-10T11:54:56.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:54:57.008 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f876f307670>, signals=[15]) 2023-10-10T11:54:57.009 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2023-10-10T11:54:57.010 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T11:54:57.010 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-10-10T11:54:57.033 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging 2023-10-10T11:54:57.033 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T11:54:57.034 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-10-10T11:54:57.035 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /host {"name": "smithi012"} 2023-10-10T11:54:57.057 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /host {"name": "smithi046"} 2023-10-10T11:54:57.102 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-10T11:54:57.122 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-10T11:54:57.141 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-10T11:54:57.141 DEBUG:teuthology.provision.fog.smithi012:FOG request: PUT /host/118 {"imageID": 2} 2023-10-10T11:54:57.165 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-10T11:54:57.165 DEBUG:teuthology.provision.fog.smithi046:FOG request: PUT /host/151 {"imageID": 2} 2023-10-10T11:54:57.190 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of ubuntu 20.04 2023-10-10T11:54:57.191 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:54:57.208 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of ubuntu 20.04 2023-10-10T11:54:57.208 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:54:57.283 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T11:54:57.290 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T11:54:57.319 DEBUG:teuthology.provision.fog.smithi012:FOG request: POST /host/118/task {"taskTypeID": 1} 2023-10-10T11:54:57.333 DEBUG:teuthology.provision.fog.smithi046:FOG request: POST /host/151/task {"taskTypeID": 1} 2023-10-10T11:54:57.380 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:54:57.391 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:54:57.511 INFO:teuthology.orchestra.console.smithi046:Power off 2023-10-10T11:54:57.511 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T11:54:57.523 INFO:teuthology.orchestra.console.smithi012:Power off 2023-10-10T11:54:57.523 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T11:54:57.531 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2023-10-10T11:54:57.532 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:54:57.543 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-10-10T11:54:57.543 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:54:57.563 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-10-10T11:54:57.574 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-10-10T11:54:57.664 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-10-10T11:54:57.676 INFO:teuthology.orchestra.console.smithi046:Power off completed 2023-10-10T11:54:57.765 INFO:teuthology.orchestra.console.smithi012:Power on 2023-10-10T11:54:57.766 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T11:54:57.777 INFO:teuthology.orchestra.console.smithi046:Power on 2023-10-10T11:54:57.777 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T11:54:57.786 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On 2023-10-10T11:54:57.787 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:54:57.798 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On 2023-10-10T11:54:57.799 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:54:57.808 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-10-10T11:54:57.819 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-10-10T11:55:01.810 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:55:01.820 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:55:01.919 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-10-10T11:55:01.929 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-10-10T11:55:05.922 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:55:05.931 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:55:06.039 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-10-10T11:55:06.132 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-10-10T11:55:06.141 INFO:teuthology.orchestra.console.smithi046:Power on completed 2023-10-10T11:55:06.233 INFO:teuthology.orchestra.console.smithi012:Power on completed 2023-10-10T11:55:06.243 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2023-10-10T11:55:06.243 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:55:06.334 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2023-10-10T11:55:06.335 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:55:21.343 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:55:21.407 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:55:36.438 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:55:36.482 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:55:51.531 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:55:51.560 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:56:06.626 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:56:06.635 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:56:21.730 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:56:21.732 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:56:36.829 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:56:36.831 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:56:51.942 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:56:51.944 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:57:07.038 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:57:07.040 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:57:22.122 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:57:22.123 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:57:37.204 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:57:37.206 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:57:52.271 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:57:52.273 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:58:07.350 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:58:07.352 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:58:22.422 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:58:22.424 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:58:37.506 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-10-10T11:58:37.508 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:58:37.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:58:40.638 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-10-10T11:58:46.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:58:49.726 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-10-10T11:58:52.571 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-10-10T11:58:52.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:58:55.710 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-10-10T11:58:55.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:58:58.778 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-10-10T11:59:01.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:59:04.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:59:04.794 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-10-10T11:59:07.834 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-10-10T11:59:10.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:59:13.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:59:13.854 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-10-10T11:59:19.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:59:22.942 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-10-10T11:59:28.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:59:32.030 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-10-10T11:59:38.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T11:59:41.119 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-10-10T11:59:47.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T12:00:13.869 WARNING:teuthology.provision.fog.smithi012:timed out 2023-10-10T12:00:19.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T12:00:20.089 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T12:00:20.090 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T12:00:20.574 INFO:teuthology.provision.fog.smithi012:Node is ready 2023-10-10T12:00:20.575 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2023-10-10T12:00:20.581 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2023-10-10T12:00:20.582 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2023-10-10T12:00:20.589 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2023-10-10T12:00:20.589 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-10-10T12:00:20.795 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2023-10-10T12:00:20.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2023-10-10T12:00:20.872 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2023-10-10T12:00:20.883 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-10-10T12:00:20.894 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-10-10T12:00:20.900 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Ubuntu" 2023-10-10T12:00:20.900 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-10T12:00:20.900 INFO:teuthology.orchestra.run.smithi012.stdout:ID=ubuntu 2023-10-10T12:00:20.901 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE=debian 2023-10-10T12:00:20.901 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-10T12:00:20.901 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="20.04" 2023-10-10T12:00:20.901 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-10T12:00:20.901 INFO:teuthology.orchestra.run.smithi012.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-10T12:00:20.902 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-10T12:00:20.902 INFO:teuthology.orchestra.run.smithi012.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-10T12:00:20.902 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_CODENAME=focal 2023-10-10T12:00:20.902 INFO:teuthology.orchestra.run.smithi012.stdout:UBUNTU_CODENAME=focal 2023-10-10T12:00:20.903 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2023-10-10T12:00:20.904 DEBUG:teuthology.parallel:result is None 2023-10-10T12:00:47.146 WARNING:teuthology.provision.fog.smithi046:timed out 2023-10-10T12:00:53.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T12:00:53.364 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T12:00:53.364 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T12:00:53.894 INFO:teuthology.provision.fog.smithi046:Node is ready 2023-10-10T12:00:53.894 DEBUG:teuthology.orchestra.run.smithi046:> hostname 2023-10-10T12:00:53.900 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2023-10-10T12:00:53.901 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts 2023-10-10T12:00:53.907 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-10-10T12:00:53.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-10-10T12:00:54.022 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts 2023-10-10T12:00:54.038 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts 2023-10-10T12:00:54.051 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname 2023-10-10T12:00:54.109 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-10-10T12:00:54.120 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-10-10T12:00:54.126 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Ubuntu" 2023-10-10T12:00:54.126 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-10T12:00:54.127 INFO:teuthology.orchestra.run.smithi046.stdout:ID=ubuntu 2023-10-10T12:00:54.127 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE=debian 2023-10-10T12:00:54.127 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-10T12:00:54.127 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="20.04" 2023-10-10T12:00:54.127 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-10T12:00:54.128 INFO:teuthology.orchestra.run.smithi046.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-10T12:00:54.128 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-10T12:00:54.128 INFO:teuthology.orchestra.run.smithi046.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-10T12:00:54.128 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_CODENAME=focal 2023-10-10T12:00:54.128 INFO:teuthology.orchestra.run.smithi046.stdout:UBUNTU_CODENAME=focal 2023-10-10T12:00:54.129 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2023-10-10T12:00:54.129 DEBUG:teuthology.parallel:result is None 2023-10-10T12:00:54.399 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2023-10-10T12:00:54.400 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2023-10-10T12:00:54.401 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2023-10-10T12:00:54.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-10T12:00:54.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T12:00:54.452 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-10-10T12:00:54.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-10T12:00:54.660 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-10-10T12:00:54.666 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-10-10T12:00:54.666 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-10-10T12:00:54.714 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Ubuntu" 2023-10-10T12:00:54.714 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-10T12:00:54.715 INFO:teuthology.orchestra.run.smithi012.stdout:ID=ubuntu 2023-10-10T12:00:54.715 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE=debian 2023-10-10T12:00:54.715 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-10T12:00:54.715 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="20.04" 2023-10-10T12:00:54.715 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-10T12:00:54.716 INFO:teuthology.orchestra.run.smithi012.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-10T12:00:54.716 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-10T12:00:54.716 INFO:teuthology.orchestra.run.smithi012.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-10T12:00:54.716 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_CODENAME=focal 2023-10-10T12:00:54.717 INFO:teuthology.orchestra.run.smithi012.stdout:UBUNTU_CODENAME=focal 2023-10-10T12:00:54.717 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-10-10T12:00:54.746 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2023-10-10T12:00:54.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-10T12:00:54.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T12:00:54.796 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-10-10T12:00:54.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-10-10T12:00:54.912 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2023-10-10T12:00:54.918 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2023-10-10T12:00:54.918 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-10-10T12:00:54.924 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Ubuntu" 2023-10-10T12:00:54.925 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-10T12:00:54.925 INFO:teuthology.orchestra.run.smithi046.stdout:ID=ubuntu 2023-10-10T12:00:54.925 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE=debian 2023-10-10T12:00:54.925 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-10T12:00:54.926 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="20.04" 2023-10-10T12:00:54.926 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-10T12:00:54.926 INFO:teuthology.orchestra.run.smithi046.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-10T12:00:54.926 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-10T12:00:54.926 INFO:teuthology.orchestra.run.smithi046.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-10T12:00:54.927 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_CODENAME=focal 2023-10-10T12:00:54.927 INFO:teuthology.orchestra.run.smithi046.stdout:UBUNTU_CODENAME=focal 2023-10-10T12:00:54.927 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-10-10T12:00:54.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T12:00:55.044 INFO:teuthology.dispatcher.supervisor:Running job 7419603 2023-10-10T12:00:55.044 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419603 --name yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} -- /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419603/orig.config.yaml 2023-10-10T12:00:55.047 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419603 2023-10-10T12:00:55.048 INFO:teuthology.dispatcher.supervisor:Job PID: 2620679 2023-10-10T12:00:55.048 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-10T12:02:55.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T12:04:55.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T12:06:55.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T12:08:55.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T12:10:55.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T12:12:55.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T12:14:56.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T12:16:56.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T12:18:56.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T12:18:56.537 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-10T12:18:56.650 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-10T12:18:56.651 INFO:teuthology.nuke:Checking targets against current locks 2023-10-10T12:18:56.699 DEBUG:teuthology.nuke:shortname: smithi012 2023-10-10T12:18:56.700 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T12:18:56.723 DEBUG:teuthology.nuke:shortname: smithi046 2023-10-10T12:18:56.724 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T12:18:56.727 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419603', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 11:54:56.043661', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-10T12:18:56.747 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419603', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 11:54:56.046404', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-10T12:18:56.776 INFO:teuthology.orchestra.console.smithi012:Power off 2023-10-10T12:18:56.777 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T12:18:56.800 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-10-10T12:18:56.801 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T12:18:56.816 INFO:teuthology.orchestra.console.smithi046:Power off 2023-10-10T12:18:56.816 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T12:18:56.824 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-10-10T12:18:56.839 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2023-10-10T12:18:56.839 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T12:18:56.860 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-10-10T12:18:56.926 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-10-10T12:18:56.961 INFO:teuthology.orchestra.console.smithi046:Power off completed 2023-10-10T12:18:57.079 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com 2023-10-10T12:18:57.111 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com