2023-12-28T11:36:03.878 INFO:root:teuthology version: 0.0.1.dev228+g01dd171 2023-12-28T11:36:03.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:36:04.012 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fde1ebff940>, signals=[15]) 2023-12-28T11:36:04.012 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2023-12-28T11:36:04.013 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2023-12-28T11:36:04.013 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-12-28T11:36:04.031 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2023-12-28T11:36:04.031 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2023-12-28T11:36:04.031 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-12-28T11:36:04.169 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-28T11:36:04.186 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-28T11:36:04.350 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of ubuntu 22.04 2023-12-28T11:36:04.401 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of ubuntu 22.04 2023-12-28T11:36:05.429 INFO:teuthology.orchestra.console.smithi086:Power off 2023-12-28T11:36:06.553 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-28T11:36:06.576 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2023-12-28T11:36:06.576 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:36:06.595 INFO:teuthology.orchestra.console.smithi152:Power off 2023-12-28T11:36:06.595 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-28T11:36:06.606 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-12-28T11:36:06.621 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-12-28T11:36:06.621 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:36:06.650 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-12-28T11:36:10.612 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:36:10.650 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:36:10.722 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-12-28T11:36:10.760 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-12-28T11:36:14.727 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:36:14.760 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:36:14.837 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-12-28T11:36:14.868 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-12-28T11:36:14.938 INFO:teuthology.orchestra.console.smithi086:Power off completed 2023-12-28T11:36:14.969 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-12-28T11:36:15.039 INFO:teuthology.orchestra.console.smithi086:Power on 2023-12-28T11:36:15.039 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-28T11:36:15.060 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On 2023-12-28T11:36:15.061 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:36:15.071 INFO:teuthology.orchestra.console.smithi152:Power on 2023-12-28T11:36:15.071 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-28T11:36:15.086 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-12-28T11:36:15.091 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On 2023-12-28T11:36:15.091 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:36:15.111 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-12-28T11:36:19.090 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:36:19.112 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:36:19.199 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-12-28T11:36:19.221 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-12-28T11:36:23.204 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:36:23.222 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T11:36:23.331 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-12-28T11:36:23.380 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-12-28T11:36:23.432 INFO:teuthology.orchestra.console.smithi152:Power on completed 2023-12-28T11:36:23.481 INFO:teuthology.orchestra.console.smithi086:Power on completed 2023-12-28T11:36:23.533 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2023-12-28T11:36:23.581 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2023-12-28T11:43:45.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:43:45.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:43:48.721 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-12-28T11:43:48.722 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-28T11:43:54.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:43:54.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:43:57.778 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-28T11:43:57.778 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-12-28T11:44:03.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:03.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:06.837 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-28T11:44:06.838 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-12-28T11:44:12.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:12.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:15.925 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-28T11:44:15.926 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-12-28T11:44:21.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:21.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:25.009 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-28T11:44:25.010 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-12-28T11:44:31.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:31.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:34.065 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-28T11:44:34.066 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-12-28T11:44:40.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:40.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:43.121 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-12-28T11:44:49.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:50.197 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-12-28T11:44:56.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:44:59.285 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-12-28T11:45:05.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:45:07.346 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-12-28T11:45:13.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:45:13.351 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-12-28T11:45:19.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:45:19.359 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-12-28T11:45:25.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:45:25.368 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-12-28T11:45:31.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:45:31.376 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-12-28T11:45:37.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:45:37.608 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-28T11:45:37.609 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-28T11:45:38.127 INFO:teuthology.provision.fog.smithi086:Node is ready 2023-12-28T11:45:38.128 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2023-12-28T11:45:38.178 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com 2023-12-28T11:45:38.179 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086.front.sepia.ceph.com /etc/hosts 2023-12-28T11:45:38.237 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2023-12-28T11:45:38.237 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-12-28T11:45:38.388 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hosts 2023-12-28T11:45:38.406 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts 2023-12-28T11:45:38.462 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hostname 2023-12-28T11:45:38.519 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-12-28T11:45:38.573 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-12-28T11:45:38.626 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-28T11:45:38.626 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Ubuntu" 2023-12-28T11:45:38.627 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="22.04" 2023-12-28T11:45:38.627 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-28T11:45:38.627 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_CODENAME=jammy 2023-12-28T11:45:38.627 INFO:teuthology.orchestra.run.smithi086.stdout:ID=ubuntu 2023-12-28T11:45:38.627 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE=debian 2023-12-28T11:45:38.627 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-28T11:45:38.627 INFO:teuthology.orchestra.run.smithi086.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-28T11:45:38.627 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-28T11:45:38.627 INFO:teuthology.orchestra.run.smithi086.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-28T11:45:38.627 INFO:teuthology.orchestra.run.smithi086.stdout:UBUNTU_CODENAME=jammy 2023-12-28T11:45:38.629 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2023-12-28T11:45:38.633 DEBUG:teuthology.parallel:result is None 2023-12-28T11:45:49.135 WARNING:teuthology.provision.fog.smithi152:timed out 2023-12-28T11:45:55.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:45:55.436 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-28T11:45:55.437 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-28T11:45:56.286 INFO:teuthology.provision.fog.smithi152:Node is ready 2023-12-28T11:45:56.286 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2023-12-28T11:45:56.332 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2023-12-28T11:45:56.333 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2023-12-28T11:45:56.381 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2023-12-28T11:45:56.382 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-12-28T11:45:56.530 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2023-12-28T11:45:56.543 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2023-12-28T11:45:56.597 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2023-12-28T11:45:56.655 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-12-28T11:45:56.708 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-12-28T11:45:56.761 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-28T11:45:56.761 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Ubuntu" 2023-12-28T11:45:56.761 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="22.04" 2023-12-28T11:45:56.761 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-28T11:45:56.761 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_CODENAME=jammy 2023-12-28T11:45:56.762 INFO:teuthology.orchestra.run.smithi152.stdout:ID=ubuntu 2023-12-28T11:45:56.762 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE=debian 2023-12-28T11:45:56.762 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-28T11:45:56.762 INFO:teuthology.orchestra.run.smithi152.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-28T11:45:56.762 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-28T11:45:56.762 INFO:teuthology.orchestra.run.smithi152.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-28T11:45:56.762 INFO:teuthology.orchestra.run.smithi152.stdout:UBUNTU_CODENAME=jammy 2023-12-28T11:45:56.762 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2023-12-28T11:45:56.763 DEBUG:teuthology.parallel:result is None 2023-12-28T11:45:57.012 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2023-12-28T11:45:57.012 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-28T11:45:57.040 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2023-12-28T11:45:57.040 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-28T11:45:57.066 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2023-12-28T11:45:57.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-12-28T11:45:57.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:45:57.146 DEBUG:teuthology.orchestra.run.smithi086:> true 2023-12-28T11:45:57.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-12-28T11:45:57.258 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2023-12-28T11:45:57.305 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2023-12-28T11:45:57.305 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-12-28T11:45:57.354 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-28T11:45:57.354 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Ubuntu" 2023-12-28T11:45:57.354 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="22.04" 2023-12-28T11:45:57.354 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-28T11:45:57.354 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_CODENAME=jammy 2023-12-28T11:45:57.354 INFO:teuthology.orchestra.run.smithi086.stdout:ID=ubuntu 2023-12-28T11:45:57.354 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE=debian 2023-12-28T11:45:57.354 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-28T11:45:57.354 INFO:teuthology.orchestra.run.smithi086.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-28T11:45:57.354 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-28T11:45:57.354 INFO:teuthology.orchestra.run.smithi086.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-28T11:45:57.354 INFO:teuthology.orchestra.run.smithi086.stdout:UBUNTU_CODENAME=jammy 2023-12-28T11:45:57.355 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-12-28T11:45:57.381 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2023-12-28T11:45:57.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-28T11:45:57.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-28T11:45:57.500 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-12-28T11:45:57.601 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-12-28T11:45:57.602 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-12-28T11:45:57.649 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-12-28T11:45:57.650 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-12-28T11:45:57.696 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-28T11:45:57.696 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Ubuntu" 2023-12-28T11:45:57.697 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="22.04" 2023-12-28T11:45:57.697 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-28T11:45:57.697 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_CODENAME=jammy 2023-12-28T11:45:57.697 INFO:teuthology.orchestra.run.smithi152.stdout:ID=ubuntu 2023-12-28T11:45:57.697 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE=debian 2023-12-28T11:45:57.697 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-28T11:45:57.697 INFO:teuthology.orchestra.run.smithi152.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-28T11:45:57.697 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-28T11:45:57.697 INFO:teuthology.orchestra.run.smithi152.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-28T11:45:57.697 INFO:teuthology.orchestra.run.smithi152.stdout:UBUNTU_CODENAME=jammy 2023-12-28T11:45:57.698 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-12-28T11:45:57.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:45:57.822 INFO:teuthology.dispatcher.supervisor:Running job 7502735 2023-12-28T11:45:57.823 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2023-12-28_11:32:19-rados-wip-rf-be-error-distro-default-smithi/7502735 --name rfriedma-2023-12-28_11:32:19-rados-wip-rf-be-error-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} -- /home/teuthworker/archive/rfriedma-2023-12-28_11:32:19-rados-wip-rf-be-error-distro-default-smithi/7502735/orig.config.yaml 2023-12-28T11:45:57.831 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2023-12-28_11:32:19-rados-wip-rf-be-error-distro-default-smithi/7502735 2023-12-28T11:45:57.831 INFO:teuthology.dispatcher.supervisor:Job PID: 183487 2023-12-28T11:45:57.831 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-28T11:47:57.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:49:58.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:51:58.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:53:58.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:55:58.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:57:58.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T11:59:59.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T12:01:59.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T12:03:59.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-28T12:03:59.598 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-28T12:03:59.695 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-28T12:03:59.695 INFO:teuthology.nuke:Checking targets against current locks 2023-12-28T12:03:59.738 DEBUG:teuthology.nuke:shortname: smithi086 2023-12-28T12:03:59.738 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-28T12:03:59.763 DEBUG:teuthology.nuke:shortname: smithi152 2023-12-28T12:03:59.763 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-28T12:03:59.766 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-12-28_11:32:19-rados-wip-rf-be-error-distro-default-smithi/7502735', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-28 11:36:02.997487', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJTdkXb0y9VSPqHkdVn4MgwW7chafOVaJCm5PL/80AjqPF3VfL3Z7Q/q0zut+IZ9MkaDCEenbF/eb9s6vz25638='} 2023-12-28T12:03:59.787 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-12-28_11:32:19-rados-wip-rf-be-error-distro-default-smithi/7502735', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-28 11:36:02.998926', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB1mpvM2kI42ktZtnw/XMoxYDFDsglgy0eCgtQCBv+RCnSHYHYmktkn5bao5SCgtmQEJmDbiYlVc2mrUl3dpF+A='} 2023-12-28T12:03:59.817 INFO:teuthology.orchestra.console.smithi086:Power off 2023-12-28T12:03:59.818 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-28T12:03:59.838 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2023-12-28T12:03:59.839 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T12:03:59.857 INFO:teuthology.orchestra.console.smithi152:Power off 2023-12-28T12:03:59.857 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-28T12:03:59.866 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-12-28T12:03:59.878 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-12-28T12:03:59.878 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-28T12:03:59.899 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-12-28T12:03:59.966 INFO:teuthology.orchestra.console.smithi086:Power off completed 2023-12-28T12:04:00.001 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-12-28T12:04:00.128 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com 2023-12-28T12:04:00.136 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com