2023-11-28T01:30:42.210 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-28T01:30:42.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T01:30:42.353 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbf0a58b670>, signals=[15]) 2023-11-28T01:30:42.353 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2023-11-28T01:30:42.353 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T01:30:42.354 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-11-28T01:30:42.375 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging 2023-11-28T01:30:42.375 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T01:30:42.375 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-11-28T01:30:42.484 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-28T01:30:42.527 DEBUG:teuthology.provision.fog.smithi204:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-28T01:30:42.531 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of ubuntu 20.04 2023-11-28T01:30:42.570 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of ubuntu 20.04 2023-11-28T01:30:42.809 INFO:teuthology.orchestra.console.smithi193:Power off 2023-11-28T01:30:42.809 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T01:30:42.831 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2023-11-28T01:30:42.831 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:30:42.848 INFO:teuthology.orchestra.console.smithi204:Power off 2023-11-28T01:30:42.848 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T01:30:42.856 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-11-28T01:30:42.870 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2023-11-28T01:30:42.871 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:30:42.895 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-11-28T01:30:46.858 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:30:46.896 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:30:46.967 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-11-28T01:30:47.005 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-11-28T01:30:50.971 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:30:51.006 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:30:51.081 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-11-28T01:30:51.119 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-11-28T01:30:51.219 INFO:teuthology.orchestra.console.smithi204:Power off completed 2023-11-28T01:30:51.320 INFO:teuthology.orchestra.console.smithi204:Power on 2023-11-28T01:30:51.320 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T01:30:51.341 DEBUG:teuthology.orchestra.console.smithi204:power on output: Chassis Power Control: Up/On 2023-11-28T01:30:51.341 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:30:51.366 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-11-28T01:30:55.084 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:30:55.193 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-11-28T01:30:55.294 INFO:teuthology.orchestra.console.smithi193:Power off completed 2023-11-28T01:30:55.367 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:30:55.395 INFO:teuthology.orchestra.console.smithi193:Power on 2023-11-28T01:30:55.396 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T01:30:55.419 DEBUG:teuthology.orchestra.console.smithi193:power on output: Chassis Power Control: Up/On 2023-11-28T01:30:55.420 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:30:55.442 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-11-28T01:30:55.476 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-11-28T01:30:59.446 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:30:59.477 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:30:59.556 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2023-11-28T01:30:59.586 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-11-28T01:30:59.657 INFO:teuthology.orchestra.console.smithi193:Power on completed 2023-11-28T01:30:59.688 INFO:teuthology.orchestra.console.smithi204:Power on completed 2023-11-28T01:30:59.758 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2023-11-28T01:30:59.788 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish 2023-11-28T01:34:46.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:34:46.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:34:49.094 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-11-28T01:34:49.095 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-28T01:34:55.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:34:55.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:34:58.182 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-11-28T01:34:58.182 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-28T01:35:04.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:35:04.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:35:07.266 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-11-28T01:35:07.267 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-28T01:35:13.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:35:13.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:35:16.358 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-11-28T01:35:16.359 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-28T01:35:22.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:35:22.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:35:25.442 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-28T01:35:25.446 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-11-28T01:35:31.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:35:31.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:35:34.531 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-28T01:35:34.531 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-11-28T01:35:40.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:35:40.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:35:43.590 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-28T01:35:49.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:35:52.674 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-28T01:35:58.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:36:16.994 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-28T01:36:22.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:36:26.050 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-28T01:36:32.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:36:32.725 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T01:36:32.726 DEBUG:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T01:36:40.538 WARNING:teuthology.provision.fog.smithi193:timed out 2023-11-28T01:36:46.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:36:46.743 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T01:36:46.743 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T01:36:47.287 INFO:teuthology.provision.fog.smithi193:Node is ready 2023-11-28T01:36:47.287 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2023-11-28T01:36:47.293 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com 2023-11-28T01:36:47.294 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts 2023-11-28T01:36:47.341 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-11-28T01:36:47.341 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-11-28T01:36:47.434 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts 2023-11-28T01:36:47.449 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts 2023-11-28T01:36:47.460 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname 2023-11-28T01:36:47.519 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-11-28T01:36:47.534 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-11-28T01:36:47.539 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Ubuntu" 2023-11-28T01:36:47.540 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-28T01:36:47.540 INFO:teuthology.orchestra.run.smithi193.stdout:ID=ubuntu 2023-11-28T01:36:47.540 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE=debian 2023-11-28T01:36:47.540 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-28T01:36:47.540 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="20.04" 2023-11-28T01:36:47.540 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T01:36:47.540 INFO:teuthology.orchestra.run.smithi193.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T01:36:47.540 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T01:36:47.541 INFO:teuthology.orchestra.run.smithi193.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T01:36:47.541 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_CODENAME=focal 2023-11-28T01:36:47.541 INFO:teuthology.orchestra.run.smithi193.stdout:UBUNTU_CODENAME=focal 2023-11-28T01:36:47.542 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2023-11-28T01:36:47.543 DEBUG:teuthology.parallel:result is None 2023-11-28T01:36:53.843 INFO:teuthology.provision.fog.smithi204:Node is ready 2023-11-28T01:36:53.844 DEBUG:teuthology.orchestra.run.smithi204:> hostname 2023-11-28T01:36:53.850 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com 2023-11-28T01:36:53.851 DEBUG:teuthology.orchestra.run.smithi204:> grep smithi204.front.sepia.ceph.com /etc/hosts 2023-11-28T01:36:53.900 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2023-11-28T01:36:53.901 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2023-11-28T01:36:54.025 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hosts 2023-11-28T01:36:54.042 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts 2023-11-28T01:36:54.099 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hostname 2023-11-28T01:36:54.112 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2023-11-28T01:36:54.122 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-11-28T01:36:54.170 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Ubuntu" 2023-11-28T01:36:54.170 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-28T01:36:54.170 INFO:teuthology.orchestra.run.smithi204.stdout:ID=ubuntu 2023-11-28T01:36:54.170 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE=debian 2023-11-28T01:36:54.170 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-28T01:36:54.170 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="20.04" 2023-11-28T01:36:54.170 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T01:36:54.171 INFO:teuthology.orchestra.run.smithi204.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T01:36:54.171 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T01:36:54.171 INFO:teuthology.orchestra.run.smithi204.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T01:36:54.171 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_CODENAME=focal 2023-11-28T01:36:54.171 INFO:teuthology.orchestra.run.smithi204.stdout:UBUNTU_CODENAME=focal 2023-11-28T01:36:54.171 INFO:teuthology.provision.fog.smithi204:Deploy complete! 2023-11-28T01:36:54.172 DEBUG:teuthology.parallel:result is None 2023-11-28T01:36:54.390 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2023-11-28T01:36:54.390 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T01:36:54.411 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com 2023-11-28T01:36:54.411 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T01:36:54.437 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2023-11-28T01:36:54.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-11-28T01:36:54.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:36:54.495 DEBUG:teuthology.orchestra.run.smithi193:> true 2023-11-28T01:36:54.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-11-28T01:36:54.616 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2023-11-28T01:36:54.622 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2023-11-28T01:36:54.622 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-11-28T01:36:54.629 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Ubuntu" 2023-11-28T01:36:54.629 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-28T01:36:54.629 INFO:teuthology.orchestra.run.smithi193.stdout:ID=ubuntu 2023-11-28T01:36:54.629 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE=debian 2023-11-28T01:36:54.630 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-28T01:36:54.630 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="20.04" 2023-11-28T01:36:54.630 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T01:36:54.630 INFO:teuthology.orchestra.run.smithi193.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T01:36:54.630 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T01:36:54.630 INFO:teuthology.orchestra.run.smithi193.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T01:36:54.630 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_CODENAME=focal 2023-11-28T01:36:54.630 INFO:teuthology.orchestra.run.smithi193.stdout:UBUNTU_CODENAME=focal 2023-11-28T01:36:54.631 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-11-28T01:36:54.652 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server 2023-11-28T01:36:54.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-11-28T01:36:54.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T01:36:54.705 DEBUG:teuthology.orchestra.run.smithi204:> true 2023-11-28T01:36:54.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-11-28T01:36:54.832 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2023-11-28T01:36:54.878 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2023-11-28T01:36:54.878 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-11-28T01:36:54.887 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Ubuntu" 2023-11-28T01:36:54.887 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-28T01:36:54.887 INFO:teuthology.orchestra.run.smithi204.stdout:ID=ubuntu 2023-11-28T01:36:54.887 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE=debian 2023-11-28T01:36:54.888 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-28T01:36:54.888 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="20.04" 2023-11-28T01:36:54.888 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T01:36:54.890 INFO:teuthology.orchestra.run.smithi204.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T01:36:54.890 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T01:36:54.890 INFO:teuthology.orchestra.run.smithi204.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T01:36:54.890 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_CODENAME=focal 2023-11-28T01:36:54.890 INFO:teuthology.orchestra.run.smithi204.stdout:UBUNTU_CODENAME=focal 2023-11-28T01:36:54.891 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-11-28T01:36:54.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T01:36:54.990 INFO:teuthology.dispatcher.supervisor:Running job 7468575 2023-11-28T01:36:54.990 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-27_21:22:16-rgw-wip-yuri8-testing-2023-11-27-0830-pacific-distro-default-smithi/7468575 --name yuriw-2023-11-27_21:22:16-rgw-wip-yuri8-testing-2023-11-27-0830-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/yuriw-2023-11-27_21:22:16-rgw-wip-yuri8-testing-2023-11-27-0830-pacific-distro-default-smithi/7468575/orig.config.yaml 2023-11-28T01:36:54.993 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-27_21:22:16-rgw-wip-yuri8-testing-2023-11-27-0830-pacific-distro-default-smithi/7468575 2023-11-28T01:36:54.993 INFO:teuthology.dispatcher.supervisor:Job PID: 2070545 2023-11-28T01:36:54.993 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-28T01:38:55.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T01:40:55.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T01:42:55.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T01:44:55.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T01:46:55.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T01:48:55.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T01:50:56.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T01:52:56.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T01:54:56.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T01:54:56.504 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-28T01:54:56.601 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-28T01:54:56.601 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T01:54:56.651 DEBUG:teuthology.nuke:shortname: smithi193 2023-11-28T01:54:56.652 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T01:54:56.675 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_21:22:16-rgw-wip-yuri8-testing-2023-11-27-0830-pacific-distro-default-smithi/7468575', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 01:30:41.390109', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-28T01:54:56.679 DEBUG:teuthology.nuke:shortname: smithi204 2023-11-28T01:54:56.679 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T01:54:56.700 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_21:22:16-rgw-wip-yuri8-testing-2023-11-27-0830-pacific-distro-default-smithi/7468575', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 01:30:41.388712', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-28T01:54:56.729 INFO:teuthology.orchestra.console.smithi193:Power off 2023-11-28T01:54:56.730 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T01:54:56.751 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2023-11-28T01:54:56.751 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:54:56.767 INFO:teuthology.orchestra.console.smithi204:Power off 2023-11-28T01:54:56.767 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T01:54:56.779 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2023-11-28T01:54:56.790 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2023-11-28T01:54:56.791 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T01:54:56.814 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-11-28T01:54:56.880 INFO:teuthology.orchestra.console.smithi193:Power off completed 2023-11-28T01:54:56.915 INFO:teuthology.orchestra.console.smithi204:Power off completed 2023-11-28T01:54:57.029 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com 2023-11-28T01:54:57.062 INFO:teuthology.lock.ops:unlocked: smithi204.front.sepia.ceph.com