2023-12-08T03:41:15.009 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-08T03:41:15.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T03:41:15.148 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3e912a1550>, signals=[15]) 2023-12-08T03:41:15.148 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2023-12-08T03:41:15.149 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2023-12-08T03:41:15.149 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-12-08T03:41:15.171 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2023-12-08T03:41:15.171 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2023-12-08T03:41:15.171 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-12-08T03:41:15.305 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-12-08T03:41:15.308 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-12-08T03:41:15.352 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of ubuntu 20.04 2023-12-08T03:41:15.369 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of ubuntu 20.04 2023-12-08T03:41:15.638 INFO:teuthology.orchestra.console.smithi032:Power off 2023-12-08T03:41:15.638 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T03:41:15.651 INFO:teuthology.orchestra.console.smithi057:Power off 2023-12-08T03:41:15.651 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T03:41:15.660 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-12-08T03:41:15.660 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T03:41:15.675 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-12-08T03:41:15.675 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T03:41:15.682 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-12-08T03:41:15.696 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-12-08T03:41:19.686 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T03:41:19.696 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T03:41:19.795 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-12-08T03:41:19.804 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-12-08T03:41:23.799 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T03:41:23.805 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T03:41:23.908 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-12-08T03:41:23.916 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-12-08T03:41:24.010 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-12-08T03:41:24.110 INFO:teuthology.orchestra.console.smithi032:Power on 2023-12-08T03:41:24.111 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-08T03:41:24.131 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On 2023-12-08T03:41:24.132 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T03:41:24.153 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-12-08T03:41:27.918 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T03:41:28.027 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-12-08T03:41:28.128 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-12-08T03:41:28.154 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T03:41:28.229 INFO:teuthology.orchestra.console.smithi057:Power on 2023-12-08T03:41:28.229 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-08T03:41:28.250 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On 2023-12-08T03:41:28.251 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T03:41:28.262 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-12-08T03:41:28.272 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-12-08T03:41:32.266 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T03:41:32.274 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T03:41:32.377 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2023-12-08T03:41:32.383 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-12-08T03:41:32.478 INFO:teuthology.orchestra.console.smithi032:Power on completed 2023-12-08T03:41:32.579 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2023-12-08T03:41:36.388 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T03:41:36.497 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-12-08T03:41:36.597 INFO:teuthology.orchestra.console.smithi057:Power on completed 2023-12-08T03:41:36.699 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2023-12-08T03:44:48.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:44:48.745 ERROR:teuthology.orchestra.connection:Error authenticating with smithi032.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-08T03:45:03.074 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-12-08T03:45:09.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:45:12.130 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-12-08T03:45:18.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:45:21.186 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-12-08T03:45:22.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:45:27.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:45:30.242 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-12-08T03:45:36.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:45:39.302 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-12-08T03:45:41.222 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:45:45.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:45:47.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:45:50.306 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:45:56.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:45:59.366 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:46:05.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:46:08.418 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:46:14.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:46:17.474 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:46:23.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:46:26.534 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:46:32.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:46:35.618 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:46:41.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:46:44.674 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:46:45.305 WARNING:teuthology.provision.fog.smithi032:timed out 2023-12-08T03:46:50.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:46:51.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:46:51.530 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-08T03:46:51.530 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-08T03:46:52.069 INFO:teuthology.provision.fog.smithi032:Node is ready 2023-12-08T03:46:52.070 DEBUG:teuthology.orchestra.run.smithi032:> hostname 2023-12-08T03:46:52.076 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com 2023-12-08T03:46:52.077 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts 2023-12-08T03:46:52.127 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032 2023-12-08T03:46:52.127 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-12-08T03:46:52.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts 2023-12-08T03:46:52.262 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts 2023-12-08T03:46:52.275 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname 2023-12-08T03:46:52.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-12-08T03:46:52.342 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-12-08T03:46:52.348 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2023-12-08T03:46:52.348 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-08T03:46:52.348 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2023-12-08T03:46:52.348 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2023-12-08T03:46:52.348 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-08T03:46:52.348 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="20.04" 2023-12-08T03:46:52.348 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-08T03:46:52.349 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-08T03:46:52.349 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-08T03:46:52.349 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-08T03:46:52.349 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=focal 2023-12-08T03:46:52.349 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=focal 2023-12-08T03:46:52.350 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2023-12-08T03:46:52.351 DEBUG:teuthology.parallel:result is None 2023-12-08T03:46:53.730 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:46:59.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:47:02.786 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:47:08.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:47:11.846 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:47:17.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:47:20.930 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:47:26.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:47:29.986 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:47:35.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:47:39.042 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:47:45.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:47:48.099 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:47:54.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:47:57.154 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-12-08T03:48:03.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:49:03.158 WARNING:teuthology.provision.fog.smithi057:timed out 2023-12-08T03:49:09.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:49:09.360 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-08T03:49:09.360 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-08T03:49:10.030 INFO:teuthology.provision.fog.smithi057:Node is ready 2023-12-08T03:49:10.030 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2023-12-08T03:49:10.036 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2023-12-08T03:49:10.037 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2023-12-08T03:49:10.087 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2023-12-08T03:49:10.088 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-12-08T03:49:10.164 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2023-12-08T03:49:10.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2023-12-08T03:49:10.198 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2023-12-08T03:49:10.255 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-12-08T03:49:10.270 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-12-08T03:49:10.276 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2023-12-08T03:49:10.276 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-08T03:49:10.276 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2023-12-08T03:49:10.276 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2023-12-08T03:49:10.276 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-08T03:49:10.276 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="20.04" 2023-12-08T03:49:10.276 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-08T03:49:10.277 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-08T03:49:10.277 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-08T03:49:10.277 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-08T03:49:10.277 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=focal 2023-12-08T03:49:10.277 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=focal 2023-12-08T03:49:10.277 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2023-12-08T03:49:10.278 DEBUG:teuthology.parallel:result is None 2023-12-08T03:49:10.530 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2023-12-08T03:49:10.531 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-08T03:49:10.556 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2023-12-08T03:49:10.556 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-08T03:49:10.573 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2023-12-08T03:49:10.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-12-08T03:49:10.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:49:10.622 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-12-08T03:49:10.828 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-12-08T03:49:10.828 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2023-12-08T03:49:10.834 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2023-12-08T03:49:10.834 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-12-08T03:49:10.840 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2023-12-08T03:49:10.840 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-08T03:49:10.840 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2023-12-08T03:49:10.840 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2023-12-08T03:49:10.840 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-08T03:49:10.840 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="20.04" 2023-12-08T03:49:10.840 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-08T03:49:10.841 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-08T03:49:10.841 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-08T03:49:10.841 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-08T03:49:10.841 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=focal 2023-12-08T03:49:10.841 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=focal 2023-12-08T03:49:10.841 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-12-08T03:49:10.864 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2023-12-08T03:49:10.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-12-08T03:49:10.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T03:49:10.915 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-12-08T03:49:11.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-12-08T03:49:11.032 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-12-08T03:49:11.038 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-12-08T03:49:11.039 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-12-08T03:49:11.045 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2023-12-08T03:49:11.045 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-08T03:49:11.045 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2023-12-08T03:49:11.045 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2023-12-08T03:49:11.045 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-08T03:49:11.045 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="20.04" 2023-12-08T03:49:11.045 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-08T03:49:11.045 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-08T03:49:11.045 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-08T03:49:11.046 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-08T03:49:11.046 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=focal 2023-12-08T03:49:11.046 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=focal 2023-12-08T03:49:11.046 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-12-08T03:49:11.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T03:49:11.165 INFO:teuthology.dispatcher.supervisor:Running job 7482983 2023-12-08T03:49:11.165 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_ksirivad@teuthology --archive /home/teuthworker/archive/ksirivad-2023-12-08_01:49:25-upgrade:quincy-x-wip-ksirivad-63389-investigate-main-distro-default-smithi/7482983 --name ksirivad-2023-12-08_01:49:25-upgrade:quincy-x-wip-ksirivad-63389-investigate-main-distro-default-smithi --description upgrade:quincy-x/parallel/{0-random-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} -- /home/teuthworker/archive/ksirivad-2023-12-08_01:49:25-upgrade:quincy-x-wip-ksirivad-63389-investigate-main-distro-default-smithi/7482983/orig.config.yaml 2023-12-08T03:49:11.168 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ksirivad-2023-12-08_01:49:25-upgrade:quincy-x-wip-ksirivad-63389-investigate-main-distro-default-smithi/7482983 2023-12-08T03:49:11.168 INFO:teuthology.dispatcher.supervisor:Job PID: 4030122 2023-12-08T03:49:11.169 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-08T03:51:11.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T03:53:11.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T03:55:11.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T03:57:11.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T03:59:11.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:01:11.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:03:11.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:05:11.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:07:11.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:09:11.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:11:11.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:13:11.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:15:12.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:17:12.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:19:12.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:21:12.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:23:12.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:25:12.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:27:12.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:29:12.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:31:12.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:33:12.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:35:12.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T04:35:12.832 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-08T04:35:12.945 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-08T04:35:12.946 INFO:teuthology.nuke:Checking targets against current locks 2023-12-08T04:35:12.995 DEBUG:teuthology.nuke:shortname: smithi032 2023-12-08T04:35:12.995 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T04:35:13.019 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ksirivad-2023-12-08_01:49:25-upgrade:quincy-x-wip-ksirivad-63389-investigate-main-distro-default-smithi/7482983', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 03:41:14.111560', 'locked_by': 'scheduled_ksirivad@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-08T04:35:13.023 DEBUG:teuthology.nuke:shortname: smithi057 2023-12-08T04:35:13.023 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T04:35:13.042 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ksirivad-2023-12-08_01:49:25-upgrade:quincy-x-wip-ksirivad-63389-investigate-main-distro-default-smithi/7482983', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 03:41:14.113255', 'locked_by': 'scheduled_ksirivad@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-08T04:35:13.072 INFO:teuthology.orchestra.console.smithi032:Power off 2023-12-08T04:35:13.072 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T04:35:13.096 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2023-12-08T04:35:13.096 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T04:35:13.109 INFO:teuthology.orchestra.console.smithi057:Power off 2023-12-08T04:35:13.109 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T04:35:13.118 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2023-12-08T04:35:13.130 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-12-08T04:35:13.131 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T04:35:13.150 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-12-08T04:35:13.219 INFO:teuthology.orchestra.console.smithi032:Power off completed 2023-12-08T04:35:13.251 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-12-08T04:35:13.372 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com 2023-12-08T04:35:13.398 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com