2024-01-09T15:52:23.645 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-09T15:52:23.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T15:52:23.786 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f0d1c8e2f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f0d1d948c10>, signals=[15])
2024-01-09T15:52:23.786 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging
2024-01-09T15:52:23.787 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server
2024-01-09T15:52:23.788 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2024-01-09T15:52:23.804 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging
2024-01-09T15:52:23.804 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server
2024-01-09T15:52:23.804 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-01-09T15:52:23.926 DEBUG:teuthology.provision.fog.smithi077:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-09T15:52:23.940 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-09T15:52:23.975 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of ubuntu 22.04
2024-01-09T15:52:23.979 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of ubuntu 22.04
2024-01-09T15:52:24.399 INFO:teuthology.orchestra.console.smithi113:Power off
2024-01-09T15:52:24.399 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-09T15:52:24.421 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off
2024-01-09T15:52:24.421 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-09T15:52:24.437 INFO:teuthology.orchestra.console.smithi077:Power off
2024-01-09T15:52:24.437 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-09T15:52:24.447 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-01-09T15:52:24.462 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off
2024-01-09T15:52:24.462 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-09T15:52:24.484 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2024-01-09T15:52:24.548 INFO:teuthology.orchestra.console.smithi113:Power off completed
2024-01-09T15:52:24.586 INFO:teuthology.orchestra.console.smithi077:Power off completed
2024-01-09T15:52:24.649 INFO:teuthology.orchestra.console.smithi113:Power on
2024-01-09T15:52:24.650 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-09T15:52:24.673 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On
2024-01-09T15:52:24.673 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-09T15:52:24.687 INFO:teuthology.orchestra.console.smithi077:Power on
2024-01-09T15:52:24.687 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-09T15:52:24.695 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-01-09T15:52:24.708 DEBUG:teuthology.orchestra.console.smithi077:power on output: Chassis Power Control: Up/On
2024-01-09T15:52:24.708 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-09T15:52:24.731 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2024-01-09T15:52:28.699 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-09T15:52:28.732 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-09T15:52:28.807 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-01-09T15:52:28.839 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2024-01-09T15:52:32.812 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-09T15:52:32.841 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-09T15:52:32.920 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on
2024-01-09T15:52:32.948 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on
2024-01-09T15:52:33.022 INFO:teuthology.orchestra.console.smithi113:Power on completed
2024-01-09T15:52:33.050 INFO:teuthology.orchestra.console.smithi077:Power on completed
2024-01-09T15:52:33.123 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish
2024-01-09T15:52:33.151 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish
2024-01-09T15:55:34.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:55:34.411 ERROR:teuthology.orchestra.connection:Error authenticating with smithi077.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-09T15:56:04.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:56:07.488 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-09T15:56:13.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:56:16.544 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-09T15:56:22.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:56:25.628 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-09T15:56:31.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:56:34.684 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-09T15:56:38.415 WARNING:teuthology.provision.fog.smithi077:timed out
2024-01-09T15:56:40.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:56:43.740 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-09T15:56:44.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:56:47.484 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-01-09T15:56:49.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:56:52.796 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-09T15:56:53.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:56:56.540 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-01-09T15:56:58.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:57:01.852 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-09T15:57:02.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:57:05.599 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-01-09T15:57:07.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:57:10.908 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113
2024-01-09T15:57:11.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:57:11.603 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-01-09T15:57:16.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:57:17.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:57:17.605 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-01-09T15:57:23.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:57:23.609 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-01-09T15:57:29.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:57:29.613 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-01-09T15:57:35.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:57:35.616 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77
2024-01-09T15:57:41.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:57:42.003 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-09T15:57:42.003 DEBUG:teuthology.orchestra.run.smithi077:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-09T15:57:42.439 INFO:teuthology.provision.fog.smithi077:Node is ready
2024-01-09T15:57:42.439 DEBUG:teuthology.orchestra.run.smithi077:> hostname
2024-01-09T15:57:42.490 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com
2024-01-09T15:57:42.490 DEBUG:teuthology.orchestra.run.smithi077:> grep smithi077.front.sepia.ceph.com /etc/hosts
2024-01-09T15:57:42.539 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077
2024-01-09T15:57:42.539 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077
2024-01-09T15:57:42.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hosts
2024-01-09T15:57:42.695 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/172.21.15.77/172.21.15.77/g' /etc/hosts
2024-01-09T15:57:42.754 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hostname
2024-01-09T15:57:42.810 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077
2024-01-09T15:57:42.870 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release
2024-01-09T15:57:42.922 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-09T15:57:42.922 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Ubuntu"
2024-01-09T15:57:42.922 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="22.04"
2024-01-09T15:57:42.922 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-09T15:57:42.923 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_CODENAME=jammy
2024-01-09T15:57:42.923 INFO:teuthology.orchestra.run.smithi077.stdout:ID=ubuntu
2024-01-09T15:57:42.923 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE=debian
2024-01-09T15:57:42.923 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-09T15:57:42.923 INFO:teuthology.orchestra.run.smithi077.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-09T15:57:42.923 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-09T15:57:42.923 INFO:teuthology.orchestra.run.smithi077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-09T15:57:42.923 INFO:teuthology.orchestra.run.smithi077.stdout:UBUNTU_CODENAME=jammy
2024-01-09T15:57:42.924 INFO:teuthology.provision.fog.smithi077:Deploy complete!
2024-01-09T15:57:42.929 DEBUG:teuthology.parallel:result is None
2024-01-09T15:58:16.913 WARNING:teuthology.provision.fog.smithi113:timed out
2024-01-09T15:58:22.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:58:23.225 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-09T15:58:23.226 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-09T15:58:23.749 INFO:teuthology.provision.fog.smithi113:Node is ready
2024-01-09T15:58:23.749 DEBUG:teuthology.orchestra.run.smithi113:> hostname
2024-01-09T15:58:23.795 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113.front.sepia.ceph.com
2024-01-09T15:58:23.795 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113.front.sepia.ceph.com /etc/hosts
2024-01-09T15:58:23.843 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113
2024-01-09T15:58:23.844 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-01-09T15:58:23.982 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hosts
2024-01-09T15:58:23.996 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts
2024-01-09T15:58:24.051 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hostname
2024-01-09T15:58:24.107 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113
2024-01-09T15:58:24.162 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-01-09T15:58:24.207 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-09T15:58:24.207 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="Ubuntu"
2024-01-09T15:58:24.207 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="22.04"
2024-01-09T15:58:24.208 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-09T15:58:24.208 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_CODENAME=jammy
2024-01-09T15:58:24.209 INFO:teuthology.orchestra.run.smithi113.stdout:ID=ubuntu
2024-01-09T15:58:24.209 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE=debian
2024-01-09T15:58:24.209 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-09T15:58:24.209 INFO:teuthology.orchestra.run.smithi113.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-09T15:58:24.209 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-09T15:58:24.209 INFO:teuthology.orchestra.run.smithi113.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-09T15:58:24.209 INFO:teuthology.orchestra.run.smithi113.stdout:UBUNTU_CODENAME=jammy
2024-01-09T15:58:24.209 INFO:teuthology.provision.fog.smithi113:Deploy complete!
2024-01-09T15:58:24.210 DEBUG:teuthology.parallel:result is None
2024-01-09T15:58:24.423 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com
2024-01-09T15:58:24.424 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-09T15:58:24.452 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com
2024-01-09T15:58:24.452 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-09T15:58:24.478 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server
2024-01-09T15:58:24.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com'
2024-01-09T15:58:24.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:58:24.557 DEBUG:teuthology.orchestra.run.smithi077:> true
2024-01-09T15:58:24.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com'
2024-01-09T15:58:24.788 DEBUG:teuthology.orchestra.run.smithi077:> uname -m
2024-01-09T15:58:24.833 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64
2024-01-09T15:58:24.833 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release
2024-01-09T15:58:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-09T15:58:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Ubuntu"
2024-01-09T15:58:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="22.04"
2024-01-09T15:58:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-09T15:58:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_CODENAME=jammy
2024-01-09T15:58:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:ID=ubuntu
2024-01-09T15:58:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE=debian
2024-01-09T15:58:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-09T15:58:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-09T15:58:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-09T15:58:24.883 INFO:teuthology.orchestra.run.smithi077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-09T15:58:24.883 INFO:teuthology.orchestra.run.smithi077.stdout:UBUNTU_CODENAME=jammy
2024-01-09T15:58:24.883 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2024-01-09T15:58:24.902 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server
2024-01-09T15:58:24.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-01-09T15:58:24.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-09T15:58:24.980 DEBUG:teuthology.orchestra.run.smithi113:> true
2024-01-09T15:58:25.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com'
2024-01-09T15:58:25.084 DEBUG:teuthology.orchestra.run.smithi113:> uname -m
2024-01-09T15:58:25.135 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64
2024-01-09T15:58:25.136 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release
2024-01-09T15:58:25.183 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-09T15:58:25.184 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="Ubuntu"
2024-01-09T15:58:25.184 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="22.04"
2024-01-09T15:58:25.184 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-09T15:58:25.184 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_CODENAME=jammy
2024-01-09T15:58:25.184 INFO:teuthology.orchestra.run.smithi113.stdout:ID=ubuntu
2024-01-09T15:58:25.184 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE=debian
2024-01-09T15:58:25.184 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-09T15:58:25.185 INFO:teuthology.orchestra.run.smithi113.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-09T15:58:25.185 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-09T15:58:25.185 INFO:teuthology.orchestra.run.smithi113.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-09T15:58:25.186 INFO:teuthology.orchestra.run.smithi113.stdout:UBUNTU_CODENAME=jammy
2024-01-09T15:58:25.186 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server
2024-01-09T15:58:25.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T15:58:25.300 INFO:teuthology.dispatcher.supervisor:Running job 7509588
2024-01-09T15:58:25.300 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2024-01-09_15:23:42-rgw-wip-yuval-63855-distro-default-smithi/7509588 --name yuvalif-2024-01-09_15:23:42-rgw-wip-yuval-63855-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/yuvalif-2024-01-09_15:23:42-rgw-wip-yuval-63855-distro-default-smithi/7509588/orig.config.yaml
2024-01-09T15:58:25.304 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuvalif-2024-01-09_15:23:42-rgw-wip-yuval-63855-distro-default-smithi/7509588
2024-01-09T15:58:25.304 INFO:teuthology.dispatcher.supervisor:Job PID: 1889146
2024-01-09T15:58:25.304 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-09T16:00:25.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:02:25.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:04:25.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:06:25.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:08:25.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:10:25.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:12:25.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:14:25.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:16:25.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:18:25.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:20:25.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:22:26.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:24:26.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:26:26.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:28:26.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:30:26.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:32:26.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:34:26.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:36:26.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:38:26.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:40:26.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:42:26.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:44:26.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:46:26.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:48:26.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:50:27.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:52:27.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:54:27.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:56:27.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T16:58:27.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:00:27.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:02:27.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:04:27.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:06:27.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:08:27.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:10:27.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:12:27.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:14:27.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:16:28.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:18:28.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:20:28.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:22:28.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:24:28.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:26:28.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:28:28.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:30:28.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:32:28.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:34:28.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:36:28.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:38:28.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:40:28.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:42:28.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:44:29.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:46:29.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:48:29.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:50:29.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:52:29.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:54:29.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:56:29.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T17:58:29.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:00:29.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:02:29.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:04:29.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:06:29.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:08:29.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:10:29.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:12:30.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:14:30.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:16:30.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:18:30.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:20:30.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:22:30.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:24:30.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:26:30.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:28:30.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:30:30.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:32:30.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:34:30.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:36:30.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:38:31.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:40:31.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:42:31.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:44:31.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:46:31.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:48:31.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:50:31.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:52:31.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:54:31.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:56:31.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T18:58:31.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T19:00:31.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T19:02:31.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T19:04:32.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T19:06:32.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T19:08:32.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T19:10:32.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T19:12:32.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T19:14:32.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T19:16:32.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T19:18:32.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T19:20:32.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-09T19:20:32.968 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-09T19:20:33.128 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-09T19:20:33.128 INFO:teuthology.nuke:Checking targets against current locks
2024-01-09T19:20:33.173 DEBUG:teuthology.nuke:shortname: smithi077
2024-01-09T19:20:33.173 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-09T19:20:33.190 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2024-01-09_15:23:42-rgw-wip-yuval-63855-distro-default-smithi/7509588', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-09 15:52:22.559224', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFXpWdmqpgijbW7EGjPS6A16RQjQ61X0cz/PHPWfkmxK++xc8zmqeWTUahkF6QPJb6JmMZ8AdF9Q7ExkhIkTNbA='}
2024-01-09T19:20:33.198 DEBUG:teuthology.nuke:shortname: smithi113
2024-01-09T19:20:33.198 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-09T19:20:33.217 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2024-01-09_15:23:42-rgw-wip-yuval-63855-distro-default-smithi/7509588', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-09 15:52:22.560864', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAMBhYA58BrjBPcNN3RgCxlTb4ouJpUJgZ/XKoyM1tGZMhnws6FMnZxudHR71kD1cbAL/GXU1EPqWxAO1gGfax4='}
2024-01-09T19:20:33.245 INFO:teuthology.orchestra.console.smithi077:Power off
2024-01-09T19:20:33.245 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-09T19:20:33.269 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off
2024-01-09T19:20:33.269 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-09T19:20:33.281 INFO:teuthology.orchestra.console.smithi113:Power off
2024-01-09T19:20:33.281 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-09T19:20:33.289 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off
2024-01-09T19:20:33.301 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off
2024-01-09T19:20:33.301 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-09T19:20:33.321 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off
2024-01-09T19:20:33.391 INFO:teuthology.orchestra.console.smithi077:Power off completed
2024-01-09T19:20:33.422 INFO:teuthology.orchestra.console.smithi113:Power off completed
2024-01-09T19:20:33.541 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com
2024-01-09T19:20:33.565 INFO:teuthology.lock.ops:unlocked: smithi113.front.sepia.ceph.com