2023-11-29T22:52:58.735 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-11-29T22:52:58.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T22:52:58.876 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1690ab5550>, signals=[15]) 2023-11-29T22:52:58.877 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2023-11-29T22:52:58.877 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2023-11-29T22:52:58.877 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-11-29T22:52:58.906 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2023-11-29T22:52:58.906 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2023-11-29T22:52:58.906 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-11-29T22:52:59.034 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-29T22:52:59.041 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-29T22:52:59.086 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of ubuntu 20.04 2023-11-29T22:52:59.089 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of ubuntu 20.04 2023-11-29T22:52:59.363 INFO:teuthology.orchestra.console.smithi107:Power off 2023-11-29T22:52:59.364 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T22:52:59.377 INFO:teuthology.orchestra.console.smithi088:Power off 2023-11-29T22:52:59.377 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T22:52:59.386 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-11-29T22:52:59.386 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T22:52:59.400 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-11-29T22:52:59.401 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T22:52:59.409 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-11-29T22:52:59.425 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-11-29T22:53:03.414 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T22:53:03.426 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T22:53:03.526 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-11-29T22:53:03.535 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-11-29T22:53:07.530 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T22:53:07.539 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T22:53:07.640 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-11-29T22:53:07.647 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-11-29T22:53:07.742 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-11-29T22:53:07.749 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-11-29T22:53:07.843 INFO:teuthology.orchestra.console.smithi107:Power on 2023-11-29T22:53:07.844 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-29T22:53:07.852 INFO:teuthology.orchestra.console.smithi088:Power on 2023-11-29T22:53:07.852 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-29T22:53:07.865 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2023-11-29T22:53:07.866 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T22:53:07.874 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2023-11-29T22:53:07.874 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T22:53:07.887 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-11-29T22:53:07.896 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-11-29T22:53:11.891 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T22:53:11.899 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T22:53:12.001 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-11-29T22:53:12.007 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-11-29T22:53:16.007 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T22:53:16.013 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T22:53:16.116 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-11-29T22:53:16.122 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-11-29T22:53:16.217 INFO:teuthology.orchestra.console.smithi107:Power on completed 2023-11-29T22:53:16.222 INFO:teuthology.orchestra.console.smithi088:Power on completed 2023-11-29T22:53:16.319 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2023-11-29T22:53:16.323 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2023-11-29T22:57:02.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:57:05.730 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-29T22:57:11.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:57:14.818 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-29T22:57:17.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:57:20.802 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-29T22:57:20.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:57:23.878 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-29T22:57:26.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:57:29.858 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-29T22:57:29.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:57:32.930 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-29T22:57:35.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:57:38.914 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-29T22:57:38.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:57:41.990 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-29T22:57:44.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:57:47.970 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-29T22:57:47.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:57:51.042 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-29T22:57:53.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:57:57.026 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-29T22:57:57.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:58:03.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:58:06.114 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-29T22:58:12.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:58:15.170 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-11-29T22:58:21.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:58:57.074 WARNING:teuthology.provision.fog.smithi107:timed out 2023-11-29T22:59:03.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:59:03.297 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-29T22:59:03.298 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-29T22:59:03.765 INFO:teuthology.provision.fog.smithi107:Node is ready 2023-11-29T22:59:03.766 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2023-11-29T22:59:03.812 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2023-11-29T22:59:03.813 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2023-11-29T22:59:03.820 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2023-11-29T22:59:03.820 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-11-29T22:59:03.914 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2023-11-29T22:59:03.930 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2023-11-29T22:59:03.942 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2023-11-29T22:59:04.002 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-11-29T22:59:04.016 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-11-29T22:59:04.068 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2023-11-29T22:59:04.069 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-29T22:59:04.069 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2023-11-29T22:59:04.069 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2023-11-29T22:59:04.069 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-29T22:59:04.069 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="20.04" 2023-11-29T22:59:04.069 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-29T22:59:04.069 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-29T22:59:04.069 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-29T22:59:04.069 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-29T22:59:04.069 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=focal 2023-11-29T22:59:04.069 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=focal 2023-11-29T22:59:04.070 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2023-11-29T22:59:04.071 DEBUG:teuthology.parallel:result is None 2023-11-29T22:59:21.196 WARNING:teuthology.provision.fog.smithi088:timed out 2023-11-29T22:59:27.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:59:27.405 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-29T22:59:27.405 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-29T22:59:27.880 INFO:teuthology.provision.fog.smithi088:Node is ready 2023-11-29T22:59:27.881 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2023-11-29T22:59:27.886 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2023-11-29T22:59:27.887 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2023-11-29T22:59:27.894 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2023-11-29T22:59:27.894 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-11-29T22:59:27.997 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2023-11-29T22:59:28.012 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2023-11-29T22:59:28.070 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2023-11-29T22:59:28.082 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-11-29T22:59:28.093 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-11-29T22:59:28.144 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu" 2023-11-29T22:59:28.144 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-29T22:59:28.144 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu 2023-11-29T22:59:28.145 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian 2023-11-29T22:59:28.145 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-29T22:59:28.145 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="20.04" 2023-11-29T22:59:28.145 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-29T22:59:28.145 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-29T22:59:28.145 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-29T22:59:28.146 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-29T22:59:28.146 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=focal 2023-11-29T22:59:28.146 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=focal 2023-11-29T22:59:28.147 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2023-11-29T22:59:28.148 DEBUG:teuthology.parallel:result is None 2023-11-29T22:59:28.377 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2023-11-29T22:59:28.377 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-29T22:59:28.401 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2023-11-29T22:59:28.401 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-29T22:59:28.418 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2023-11-29T22:59:28.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-29T22:59:28.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:59:28.468 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-11-29T22:59:28.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-11-29T22:59:28.588 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-11-29T22:59:28.594 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-11-29T22:59:28.594 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-11-29T22:59:28.600 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu" 2023-11-29T22:59:28.601 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-29T22:59:28.601 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu 2023-11-29T22:59:28.601 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian 2023-11-29T22:59:28.601 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-29T22:59:28.601 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="20.04" 2023-11-29T22:59:28.601 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-29T22:59:28.601 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-29T22:59:28.601 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-29T22:59:28.601 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-29T22:59:28.601 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=focal 2023-11-29T22:59:28.601 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=focal 2023-11-29T22:59:28.602 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-11-29T22:59:28.626 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2023-11-29T22:59:28.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-11-29T22:59:28.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T22:59:28.672 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-11-29T22:59:28.871 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-11-29T22:59:28.871 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-11-29T22:59:28.920 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-11-29T22:59:28.921 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-11-29T22:59:28.927 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2023-11-29T22:59:28.927 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-29T22:59:28.927 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2023-11-29T22:59:28.927 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2023-11-29T22:59:28.927 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-29T22:59:28.928 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="20.04" 2023-11-29T22:59:28.928 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-29T22:59:28.928 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-29T22:59:28.928 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-29T22:59:28.928 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-29T22:59:28.928 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=focal 2023-11-29T22:59:28.928 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=focal 2023-11-29T22:59:28.928 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-11-29T22:59:28.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T22:59:29.040 INFO:teuthology.dispatcher.supervisor:Running job 7471181 2023-11-29T22:59:29.040 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-29_18:10:24-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7471181 --name yuriw-2023-11-29_18:10:24-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi --description rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} -- /home/teuthworker/archive/yuriw-2023-11-29_18:10:24-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7471181/orig.config.yaml 2023-11-29T22:59:29.043 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-29_18:10:24-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7471181 2023-11-29T22:59:29.044 INFO:teuthology.dispatcher.supervisor:Job PID: 713878 2023-11-29T22:59:29.044 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-29T23:01:29.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:03:29.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:05:29.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:07:29.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:09:29.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:11:29.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:13:30.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:15:30.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:17:30.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:19:30.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:21:30.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:23:30.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:25:31.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:27:31.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:29:31.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:31:31.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:33:31.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:35:31.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:37:32.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:39:32.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:41:32.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T23:41:32.573 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-29T23:41:32.746 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-29T23:41:32.747 INFO:teuthology.nuke:Checking targets against current locks 2023-11-29T23:41:32.792 DEBUG:teuthology.nuke:shortname: smithi088 2023-11-29T23:41:32.792 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T23:41:32.817 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-29_18:10:24-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7471181', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 22:52:57.814015', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-29T23:41:32.821 DEBUG:teuthology.nuke:shortname: smithi107 2023-11-29T23:41:32.821 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T23:41:32.849 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-29_18:10:24-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7471181', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 22:52:57.815908', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-29T23:41:32.877 INFO:teuthology.orchestra.console.smithi088:Power off 2023-11-29T23:41:32.877 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T23:41:32.898 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-11-29T23:41:32.898 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T23:41:32.916 INFO:teuthology.orchestra.console.smithi107:Power off 2023-11-29T23:41:32.917 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T23:41:32.926 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-11-29T23:41:32.938 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-11-29T23:41:32.938 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T23:41:32.959 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-11-29T23:41:33.026 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-11-29T23:41:33.060 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-11-29T23:41:33.180 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com 2023-11-29T23:41:33.214 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com