2023-12-28T11:34:01.384 INFO:root:teuthology version: 0.0.1.dev228+g01dd171 2023-12-28T11:34:01.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:34:01.563 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8a05f30940>, signals=[15]) 2023-12-28T11:34:01.563 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2023-12-28T11:34:01.564 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2023-12-28T11:34:01.564 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-12-28T11:34:01.607 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-12-28T11:34:01.607 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-12-28T11:34:01.607 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-12-28T11:34:01.726 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-28T11:34:01.747 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-28T11:34:01.770 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of ubuntu 22.04 2023-12-28T11:34:01.796 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of ubuntu 22.04 2023-12-28T11:34:02.389 INFO:teuthology.orchestra.console.smithi107:Power off 2023-12-28T11:34:02.389 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-28T11:34:02.402 INFO:teuthology.orchestra.console.smithi195:Power off 2023-12-28T11:34:02.402 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-28T11:34:02.410 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-12-28T11:34:02.411 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:34:02.424 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-12-28T11:34:02.425 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:34:02.432 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-12-28T11:34:02.448 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-28T11:34:06.433 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:34:06.449 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:34:06.544 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-12-28T11:34:06.558 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-28T11:34:10.550 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:34:10.559 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:34:10.659 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-12-28T11:34:10.667 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-28T11:34:10.761 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-12-28T11:34:10.768 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-12-28T11:34:10.862 INFO:teuthology.orchestra.console.smithi107:Power on 2023-12-28T11:34:10.862 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-28T11:34:10.870 INFO:teuthology.orchestra.console.smithi195:Power on 2023-12-28T11:34:10.871 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-28T11:34:10.896 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2023-12-28T11:34:10.897 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:34:10.907 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2023-12-28T11:34:10.907 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:34:10.928 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-12-28T11:34:10.935 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-28T11:34:14.929 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:34:14.936 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:34:15.038 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-12-28T11:34:15.043 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-28T11:34:19.044 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:34:19.050 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:34:19.153 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-12-28T11:34:19.159 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-28T11:34:19.254 INFO:teuthology.orchestra.console.smithi107:Power on completed 2023-12-28T11:34:19.260 INFO:teuthology.orchestra.console.smithi195:Power on completed 2023-12-28T11:34:19.355 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2023-12-28T11:34:19.361 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-12-28T11:40:26.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:40:29.778 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-12-28T11:40:35.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:40:38.869 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-12-28T11:40:44.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:40:47.953 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-12-28T11:40:53.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:40:57.009 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-12-28T11:41:03.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:41:06.097 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-12-28T11:41:12.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:41:15.185 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-12-28T11:41:21.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:42:21.198 WARNING:teuthology.provision.fog.smithi107:timed out 2023-12-28T11:42:27.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:42:27.380 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-28T11:42:27.380 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-28T11:42:27.841 INFO:teuthology.provision.fog.smithi107:Node is ready 2023-12-28T11:42:27.841 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2023-12-28T11:42:27.890 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2023-12-28T11:42:27.890 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2023-12-28T11:42:27.937 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2023-12-28T11:42:27.940 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-12-28T11:42:28.078 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2023-12-28T11:42:28.090 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2023-12-28T11:42:28.150 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2023-12-28T11:42:28.209 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-12-28T11:42:28.264 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-12-28T11:42:28.309 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-28T11:42:28.309 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2023-12-28T11:42:28.309 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="22.04" 2023-12-28T11:42:28.310 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-28T11:42:28.310 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=jammy 2023-12-28T11:42:28.310 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2023-12-28T11:42:28.310 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2023-12-28T11:42:28.310 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-28T11:42:28.310 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-28T11:42:28.310 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-28T11:42:28.310 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-28T11:42:28.310 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=jammy 2023-12-28T11:42:28.311 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2023-12-28T11:42:28.312 DEBUG:teuthology.parallel:result is None 2023-12-28T11:43:13.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:43:16.501 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-28T11:43:22.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:43:25.589 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-28T11:43:31.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:43:34.677 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-28T11:43:40.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:43:43.761 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-28T11:43:49.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:43:52.817 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-28T11:43:58.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:01.905 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-28T11:44:07.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:39.442 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-28T11:44:45.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:45.448 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-28T11:44:51.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:51.456 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-28T11:44:57.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:57.464 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-28T11:45:03.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:45:03.934 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-28T11:45:03.935 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-28T11:45:04.809 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-12-28T11:45:04.809 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-12-28T11:45:04.857 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2023-12-28T11:45:04.858 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2023-12-28T11:45:04.905 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2023-12-28T11:45:04.906 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-12-28T11:45:05.046 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2023-12-28T11:45:05.059 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2023-12-28T11:45:05.116 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2023-12-28T11:45:05.168 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-12-28T11:45:05.220 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-12-28T11:45:05.269 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-28T11:45:05.269 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu" 2023-12-28T11:45:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="22.04" 2023-12-28T11:45:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-28T11:45:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=jammy 2023-12-28T11:45:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu 2023-12-28T11:45:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian 2023-12-28T11:45:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-28T11:45:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-28T11:45:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-28T11:45:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-28T11:45:05.270 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=jammy 2023-12-28T11:45:05.270 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-12-28T11:45:05.271 DEBUG:teuthology.parallel:result is None 2023-12-28T11:45:05.451 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2023-12-28T11:45:05.452 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-28T11:45:05.472 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-12-28T11:45:05.472 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-28T11:45:05.490 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2023-12-28T11:45:05.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-12-28T11:45:05.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:45:05.564 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-12-28T11:45:05.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-12-28T11:45:05.793 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-12-28T11:45:05.839 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-12-28T11:45:05.840 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-12-28T11:45:05.887 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-28T11:45:05.887 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2023-12-28T11:45:05.887 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="22.04" 2023-12-28T11:45:05.887 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-28T11:45:05.887 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=jammy 2023-12-28T11:45:05.888 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2023-12-28T11:45:05.888 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2023-12-28T11:45:05.888 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-28T11:45:05.888 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-28T11:45:05.888 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-28T11:45:05.888 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-28T11:45:05.888 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=jammy 2023-12-28T11:45:05.888 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-12-28T11:45:05.914 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-12-28T11:45:05.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-28T11:45:05.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:45:05.990 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-12-28T11:45:06.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-28T11:45:06.098 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-12-28T11:45:06.146 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-12-28T11:45:06.146 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-12-28T11:45:06.193 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-28T11:45:06.194 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu" 2023-12-28T11:45:06.194 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="22.04" 2023-12-28T11:45:06.194 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-28T11:45:06.194 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=jammy 2023-12-28T11:45:06.194 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu 2023-12-28T11:45:06.194 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian 2023-12-28T11:45:06.194 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-28T11:45:06.194 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-28T11:45:06.194 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-28T11:45:06.194 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-28T11:45:06.194 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=jammy 2023-12-28T11:45:06.194 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-12-28T11:45:06.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:45:06.304 INFO:teuthology.dispatcher.supervisor:Running job 7502729 2023-12-28T11:45:06.304 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2023-12-28_11:32:19-rados-wip-rf-be-error-distro-default-smithi/7502729 --name rfriedma-2023-12-28_11:32:19-rados-wip-rf-be-error-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} -- /home/teuthworker/archive/rfriedma-2023-12-28_11:32:19-rados-wip-rf-be-error-distro-default-smithi/7502729/orig.config.yaml 2023-12-28T11:45:06.307 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2023-12-28_11:32:19-rados-wip-rf-be-error-distro-default-smithi/7502729 2023-12-28T11:45:06.307 INFO:teuthology.dispatcher.supervisor:Job PID: 159663 2023-12-28T11:45:06.308 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-28T11:47:06.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:49:06.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:51:06.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:53:06.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:55:07.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:57:07.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:59:07.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T12:01:07.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T12:03:07.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T12:03:07.861 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-28T12:03:07.960 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-28T12:03:07.961 INFO:teuthology.nuke:Checking targets against current locks 2023-12-28T12:03:08.005 DEBUG:teuthology.nuke:shortname: smithi107 2023-12-28T12:03:08.005 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-28T12:03:08.026 DEBUG:teuthology.nuke:shortname: smithi195 2023-12-28T12:03:08.026 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-28T12:03:08.032 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-12-28_11:32:19-rados-wip-rf-be-error-distro-default-smithi/7502729', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-28 11:34:00.517413', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAi51jgfc65N0zWDqHvWO9IMgZbn9VEfRwOW2BQOHO3ntw8q0ey9XqidQkKwiyro59jItZtEklxGXJGNiIwjX9Y='} 2023-12-28T12:03:08.045 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-12-28_11:32:19-rados-wip-rf-be-error-distro-default-smithi/7502729', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-28 11:34:00.519236', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEn74vjLClAHXAfigvixA2cifGKD657YyPWY3opanAb4tqYDmKuz6yjQKiA+7Xafg5GUe22D8aSVK4sRmORBLe0='} 2023-12-28T12:03:08.079 INFO:teuthology.orchestra.console.smithi107:Power off 2023-12-28T12:03:08.080 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-28T12:03:08.091 INFO:teuthology.orchestra.console.smithi195:Power off 2023-12-28T12:03:08.091 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-28T12:03:08.100 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-12-28T12:03:08.100 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T12:03:08.111 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-12-28T12:03:08.111 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T12:03:08.119 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-12-28T12:03:08.134 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-28T12:03:08.220 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-12-28T12:03:08.235 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-12-28T12:03:08.376 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com 2023-12-28T12:03:08.386 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com