2024-04-01T12:27:37.261 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T12:27:37.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T12:27:37.425 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f19e1310c10>, signals=[15]) 2024-04-01T12:27:37.425 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2024-04-01T12:27:37.426 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T12:27:37.426 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-04-01T12:27:37.451 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2024-04-01T12:27:37.451 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T12:27:37.451 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-04-01T12:27:37.476 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging 2024-04-01T12:27:37.476 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T12:27:37.476 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-04-01T12:27:37.545 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_ubuntu_20.04 (ID 2) 2024-04-01T12:27:37.666 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of ubuntu 20.04 2024-04-01T12:27:37.669 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_ubuntu_20.04 (ID 2) 2024-04-01T12:27:37.684 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_ubuntu_20.04 (ID 2) 2024-04-01T12:27:37.708 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of ubuntu 20.04 2024-04-01T12:27:37.727 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of ubuntu 20.04 2024-04-01T12:27:37.946 INFO:teuthology.orchestra.console.smithi038:Power off 2024-04-01T12:27:37.947 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T12:27:37.975 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2024-04-01T12:27:37.976 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T12:27:37.995 INFO:teuthology.orchestra.console.smithi164:Power off 2024-04-01T12:27:37.995 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T12:27:38.011 INFO:teuthology.orchestra.console.smithi143:Power off 2024-04-01T12:27:38.012 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T12:27:38.019 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-04-01T12:27:38.021 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2024-04-01T12:27:38.021 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T12:27:38.038 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2024-04-01T12:27:38.038 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T12:27:38.052 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-04-01T12:27:38.061 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2024-04-01T12:27:38.120 INFO:teuthology.orchestra.console.smithi038:Power off completed 2024-04-01T12:27:38.154 INFO:teuthology.orchestra.console.smithi164:Power off completed 2024-04-01T12:27:38.161 INFO:teuthology.orchestra.console.smithi143:Power off completed 2024-04-01T12:27:38.222 INFO:teuthology.orchestra.console.smithi038:Power on 2024-04-01T12:27:38.222 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T12:27:38.251 DEBUG:teuthology.orchestra.console.smithi038:power on output: Chassis Power Control: Up/On 2024-04-01T12:27:38.251 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T12:27:38.259 INFO:teuthology.orchestra.console.smithi164:Power on 2024-04-01T12:27:38.259 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T12:27:38.267 INFO:teuthology.orchestra.console.smithi143:Power on 2024-04-01T12:27:38.267 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T12:27:38.282 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On 2024-04-01T12:27:38.282 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T12:27:38.290 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2024-04-01T12:27:38.293 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On 2024-04-01T12:27:38.294 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T12:27:38.306 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-04-01T12:27:38.318 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2024-04-01T12:27:42.291 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T12:27:42.307 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T12:27:42.318 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T12:27:42.400 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2024-04-01T12:27:42.415 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-01T12:27:42.427 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2024-04-01T12:27:42.501 INFO:teuthology.orchestra.console.smithi038:Power on completed 2024-04-01T12:27:42.516 INFO:teuthology.orchestra.console.smithi164:Power on completed 2024-04-01T12:27:42.527 INFO:teuthology.orchestra.console.smithi143:Power on completed 2024-04-01T12:27:42.603 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2024-04-01T12:27:42.617 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2024-04-01T12:27:42.628 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2024-04-01T12:31:29.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:31:32.735 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-04-01T12:31:38.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:31:41.790 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-04-01T12:31:47.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:31:50.846 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-04-01T12:31:56.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:31:59.934 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-04-01T12:32:05.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:32:08.990 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-04-01T12:32:14.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:32:18.050 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2024-04-01T12:32:24.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:32:29.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:32:33.022 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-04-01T12:32:39.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:32:42.078 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-04-01T12:32:48.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:32:51.134 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-04-01T12:32:57.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:33:00.190 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-04-01T12:33:06.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:33:09.282 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-04-01T12:33:15.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:33:15.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:33:18.174 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-01T12:33:18.338 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2024-04-01T12:33:24.064 WARNING:teuthology.provision.fog.smithi038:timed out 2024-04-01T12:33:24.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:33:24.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:33:27.230 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-01T12:33:30.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:33:30.319 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T12:33:30.319 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T12:33:30.817 INFO:teuthology.provision.fog.smithi038:Node is ready 2024-04-01T12:33:30.817 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2024-04-01T12:33:30.823 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2024-04-01T12:33:30.824 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2024-04-01T12:33:30.831 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2024-04-01T12:33:30.831 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2024-04-01T12:33:30.946 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2024-04-01T12:33:30.962 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2024-04-01T12:33:30.980 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2024-04-01T12:33:30.993 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2024-04-01T12:33:31.004 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-04-01T12:33:31.009 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Ubuntu" 2024-04-01T12:33:31.009 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-01T12:33:31.009 INFO:teuthology.orchestra.run.smithi038.stdout:ID=ubuntu 2024-04-01T12:33:31.009 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE=debian 2024-04-01T12:33:31.009 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-01T12:33:31.009 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="20.04" 2024-04-01T12:33:31.009 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-01T12:33:31.009 INFO:teuthology.orchestra.run.smithi038.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-01T12:33:31.009 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-01T12:33:31.009 INFO:teuthology.orchestra.run.smithi038.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-01T12:33:31.009 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_CODENAME=focal 2024-04-01T12:33:31.009 INFO:teuthology.orchestra.run.smithi038.stdout:UBUNTU_CODENAME=focal 2024-04-01T12:33:31.010 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2024-04-01T12:33:31.011 DEBUG:teuthology.parallel:result is None 2024-04-01T12:33:33.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:33:36.286 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-01T12:33:42.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:33:45.374 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-01T12:33:51.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:33:54.430 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-01T12:33:56.479 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T12:33:56.479 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T12:34:00.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:34:03.486 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-01T12:34:09.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:34:12.542 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-01T12:34:18.261 INFO:teuthology.provision.fog.smithi143:Node is ready 2024-04-01T12:34:18.261 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2024-04-01T12:34:18.265 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2024-04-01T12:34:18.266 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts 2024-04-01T12:34:18.270 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2024-04-01T12:34:18.271 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2024-04-01T12:34:18.372 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts 2024-04-01T12:34:18.388 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts 2024-04-01T12:34:18.399 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname 2024-04-01T12:34:18.412 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2024-04-01T12:34:18.469 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-04-01T12:34:18.473 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu" 2024-04-01T12:34:18.473 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-01T12:34:18.473 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu 2024-04-01T12:34:18.473 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian 2024-04-01T12:34:18.474 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-01T12:34:18.474 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="20.04" 2024-04-01T12:34:18.474 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-01T12:34:18.474 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-01T12:34:18.474 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-01T12:34:18.474 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-01T12:34:18.474 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=focal 2024-04-01T12:34:18.474 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=focal 2024-04-01T12:34:18.474 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2024-04-01T12:34:18.475 DEBUG:teuthology.parallel:result is None 2024-04-01T12:34:18.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:34:21.598 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-01T12:34:27.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:35:27.667 WARNING:teuthology.provision.fog.smithi164:timed out 2024-04-01T12:35:33.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:35:33.924 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T12:35:33.924 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T12:35:34.484 INFO:teuthology.provision.fog.smithi164:Node is ready 2024-04-01T12:35:34.484 DEBUG:teuthology.orchestra.run.smithi164:> hostname 2024-04-01T12:35:34.534 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2024-04-01T12:35:34.534 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts 2024-04-01T12:35:34.541 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2024-04-01T12:35:34.541 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2024-04-01T12:35:34.665 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts 2024-04-01T12:35:34.682 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts 2024-04-01T12:35:34.698 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname 2024-04-01T12:35:34.754 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2024-04-01T12:35:34.764 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-04-01T12:35:34.771 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Ubuntu" 2024-04-01T12:35:34.771 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-01T12:35:34.771 INFO:teuthology.orchestra.run.smithi164.stdout:ID=ubuntu 2024-04-01T12:35:34.771 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE=debian 2024-04-01T12:35:34.771 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-01T12:35:34.771 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="20.04" 2024-04-01T12:35:34.771 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-01T12:35:34.771 INFO:teuthology.orchestra.run.smithi164.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-01T12:35:34.771 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-01T12:35:34.772 INFO:teuthology.orchestra.run.smithi164.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-01T12:35:34.772 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_CODENAME=focal 2024-04-01T12:35:34.772 INFO:teuthology.orchestra.run.smithi164.stdout:UBUNTU_CODENAME=focal 2024-04-01T12:35:34.772 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2024-04-01T12:35:34.772 DEBUG:teuthology.parallel:result is None 2024-04-01T12:35:35.159 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2024-04-01T12:35:35.160 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T12:35:35.190 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2024-04-01T12:35:35.190 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T12:35:35.215 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2024-04-01T12:35:35.215 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T12:35:35.233 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2024-04-01T12:35:35.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-04-01T12:35:35.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:35:35.332 DEBUG:teuthology.orchestra.run.smithi038:> true 2024-04-01T12:35:35.540 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2024-04-01T12:35:35.540 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2024-04-01T12:35:35.546 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2024-04-01T12:35:35.546 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2024-04-01T12:35:35.553 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Ubuntu" 2024-04-01T12:35:35.553 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-01T12:35:35.553 INFO:teuthology.orchestra.run.smithi038.stdout:ID=ubuntu 2024-04-01T12:35:35.553 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE=debian 2024-04-01T12:35:35.553 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-01T12:35:35.553 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="20.04" 2024-04-01T12:35:35.553 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-01T12:35:35.553 INFO:teuthology.orchestra.run.smithi038.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-01T12:35:35.553 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-01T12:35:35.554 INFO:teuthology.orchestra.run.smithi038.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-01T12:35:35.554 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_CODENAME=focal 2024-04-01T12:35:35.554 INFO:teuthology.orchestra.run.smithi038.stdout:UBUNTU_CODENAME=focal 2024-04-01T12:35:35.554 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2024-04-01T12:35:35.573 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2024-04-01T12:35:35.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-04-01T12:35:35.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:35:35.664 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-04-01T12:35:35.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-04-01T12:35:35.868 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2024-04-01T12:35:35.874 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2024-04-01T12:35:35.874 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-04-01T12:35:35.880 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu" 2024-04-01T12:35:35.880 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-01T12:35:35.880 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu 2024-04-01T12:35:35.880 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian 2024-04-01T12:35:35.880 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-01T12:35:35.880 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="20.04" 2024-04-01T12:35:35.880 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-01T12:35:35.881 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-01T12:35:35.881 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-01T12:35:35.881 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-01T12:35:35.881 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=focal 2024-04-01T12:35:35.881 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=focal 2024-04-01T12:35:35.881 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-04-01T12:35:35.907 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2024-04-01T12:35:35.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-01T12:35:35.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T12:35:35.996 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-04-01T12:35:36.119 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-01T12:35:36.120 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-04-01T12:35:36.166 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-04-01T12:35:36.166 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-04-01T12:35:36.170 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Ubuntu" 2024-04-01T12:35:36.170 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-01T12:35:36.170 INFO:teuthology.orchestra.run.smithi164.stdout:ID=ubuntu 2024-04-01T12:35:36.170 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE=debian 2024-04-01T12:35:36.170 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-01T12:35:36.171 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="20.04" 2024-04-01T12:35:36.171 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-01T12:35:36.171 INFO:teuthology.orchestra.run.smithi164.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-01T12:35:36.171 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-01T12:35:36.171 INFO:teuthology.orchestra.run.smithi164.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-01T12:35:36.171 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_CODENAME=focal 2024-04-01T12:35:36.171 INFO:teuthology.orchestra.run.smithi164.stdout:UBUNTU_CODENAME=focal 2024-04-01T12:35:36.171 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-04-01T12:35:36.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T12:35:36.293 INFO:teuthology.dispatcher.supervisor:Running job 7608706 2024-04-01T12:35:36.293 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-18_00:40:02-upgrade:quincy-p2p-quincy-distro-default-smithi/7608706 --name teuthology-2024-03-18_00:40:02-upgrade:quincy-p2p-quincy-distro-default-smithi --description upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-stupid supported-all-distro/ubuntu_latest thrashosds-health} -- /home/teuthworker/archive/teuthology-2024-03-18_00:40:02-upgrade:quincy-p2p-quincy-distro-default-smithi/7608706/orig.config.yaml 2024-04-01T12:35:36.296 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-18_00:40:02-upgrade:quincy-p2p-quincy-distro-default-smithi/7608706 2024-04-01T12:35:36.297 INFO:teuthology.dispatcher.supervisor:Job PID: 2646898 2024-04-01T12:35:36.297 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-01T12:37:36.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T12:39:36.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T12:41:36.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T12:43:36.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T12:45:37.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T12:47:37.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T12:49:37.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T12:49:37.413 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1