2023-12-17T01:27:17.441 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-17T01:27:17.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T01:27:17.570 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff5be872550>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff5bf7ca940>, signals=[15])
2023-12-17T01:27:17.570 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging
2023-12-17T01:27:17.570 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server
2023-12-17T01:27:17.570 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2023-12-17T01:27:17.595 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging
2023-12-17T01:27:17.596 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server
2023-12-17T01:27:17.596 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2023-12-17T01:27:17.715 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-12-17T01:27:17.732 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-12-17T01:27:17.766 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of ubuntu 22.04
2023-12-17T01:27:17.780 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of ubuntu 22.04
2023-12-17T01:27:18.003 INFO:teuthology.orchestra.console.smithi040:Power off
2023-12-17T01:27:18.004 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-17T01:27:18.026 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off
2023-12-17T01:27:18.026 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-17T01:27:18.044 INFO:teuthology.orchestra.console.smithi097:Power off
2023-12-17T01:27:18.044 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-17T01:27:18.052 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2023-12-17T01:27:18.065 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off
2023-12-17T01:27:18.065 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-17T01:27:18.094 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2023-12-17T01:27:22.053 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-17T01:27:22.095 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-17T01:27:22.163 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2023-12-17T01:27:22.204 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2023-12-17T01:27:26.165 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-17T01:27:26.205 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-17T01:27:26.275 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2023-12-17T01:27:26.314 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2023-12-17T01:27:30.276 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-17T01:27:30.315 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-17T01:27:30.386 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2023-12-17T01:27:30.424 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2023-12-17T01:27:30.487 INFO:teuthology.orchestra.console.smithi040:Power off completed
2023-12-17T01:27:30.525 INFO:teuthology.orchestra.console.smithi097:Power off completed
2023-12-17T01:27:30.588 INFO:teuthology.orchestra.console.smithi040:Power on
2023-12-17T01:27:30.589 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-17T01:27:30.612 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On
2023-12-17T01:27:30.612 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-17T01:27:30.626 INFO:teuthology.orchestra.console.smithi097:Power on
2023-12-17T01:27:30.626 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-17T01:27:30.635 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2023-12-17T01:27:30.649 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On
2023-12-17T01:27:30.649 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-17T01:27:30.672 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2023-12-17T01:27:34.637 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-17T01:27:34.673 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-17T01:27:34.747 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on
2023-12-17T01:27:34.782 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2023-12-17T01:27:34.848 INFO:teuthology.orchestra.console.smithi040:Power on completed
2023-12-17T01:27:34.883 INFO:teuthology.orchestra.console.smithi097:Power on completed
2023-12-17T01:27:34.949 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish
2023-12-17T01:27:34.984 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish
2023-12-17T01:30:35.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:30:51.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:30:54.354 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2023-12-17T01:31:00.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:31:03.409 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2023-12-17T01:31:09.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:31:09.457 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-12-17T01:31:12.465 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2023-12-17T01:31:15.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:31:18.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:31:18.513 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-12-17T01:31:21.525 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2023-12-17T01:31:24.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:31:27.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:31:27.569 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-12-17T01:31:33.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:31:36.625 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-12-17T01:31:42.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:31:45.681 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-12-17T01:31:51.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:32:27.568 WARNING:teuthology.provision.fog.smithi040:timed out
2023-12-17T01:32:33.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:32:33.577 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40
2023-12-17T01:32:39.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:32:39.789 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-17T01:32:39.790 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-17T01:32:40.226 INFO:teuthology.provision.fog.smithi040:Node is ready
2023-12-17T01:32:40.226 DEBUG:teuthology.orchestra.run.smithi040:> hostname
2023-12-17T01:32:40.275 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com
2023-12-17T01:32:40.276 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts
2023-12-17T01:32:40.323 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040
2023-12-17T01:32:40.323 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040
2023-12-17T01:32:40.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts
2023-12-17T01:32:40.457 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts
2023-12-17T01:32:40.511 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname
2023-12-17T01:32:40.568 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040
2023-12-17T01:32:40.623 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release
2023-12-17T01:32:40.671 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-17T01:32:40.671 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu"
2023-12-17T01:32:40.671 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="22.04"
2023-12-17T01:32:40.671 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-17T01:32:40.672 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=jammy
2023-12-17T01:32:40.672 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu
2023-12-17T01:32:40.672 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian
2023-12-17T01:32:40.672 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-17T01:32:40.672 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-17T01:32:40.672 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-17T01:32:40.672 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-17T01:32:40.672 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=jammy
2023-12-17T01:32:40.673 INFO:teuthology.provision.fog.smithi040:Deploy complete!
2023-12-17T01:32:40.675 DEBUG:teuthology.parallel:result is None
2023-12-17T01:32:51.699 WARNING:teuthology.provision.fog.smithi097:timed out
2023-12-17T01:32:57.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:32:57.902 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-17T01:32:57.902 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-17T01:32:58.355 INFO:teuthology.provision.fog.smithi097:Node is ready
2023-12-17T01:32:58.356 DEBUG:teuthology.orchestra.run.smithi097:> hostname
2023-12-17T01:32:58.402 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com
2023-12-17T01:32:58.402 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts
2023-12-17T01:32:58.450 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097
2023-12-17T01:32:58.451 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2023-12-17T01:32:58.584 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts
2023-12-17T01:32:58.598 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts
2023-12-17T01:32:58.658 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname
2023-12-17T01:32:58.714 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2023-12-17T01:32:58.770 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2023-12-17T01:32:58.822 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-17T01:32:58.823 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu"
2023-12-17T01:32:58.823 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="22.04"
2023-12-17T01:32:58.823 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-17T01:32:58.823 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=jammy
2023-12-17T01:32:58.823 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu
2023-12-17T01:32:58.823 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian
2023-12-17T01:32:58.823 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-17T01:32:58.823 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-17T01:32:58.823 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-17T01:32:58.823 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-17T01:32:58.823 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=jammy
2023-12-17T01:32:58.824 INFO:teuthology.provision.fog.smithi097:Deploy complete!
2023-12-17T01:32:58.824 DEBUG:teuthology.parallel:result is None
2023-12-17T01:32:59.003 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com
2023-12-17T01:32:59.003 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-17T01:32:59.028 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com
2023-12-17T01:32:59.028 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-17T01:32:59.054 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server
2023-12-17T01:32:59.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com'
2023-12-17T01:32:59.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:32:59.133 DEBUG:teuthology.orchestra.run.smithi040:> true
2023-12-17T01:32:59.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com'
2023-12-17T01:32:59.378 DEBUG:teuthology.orchestra.run.smithi040:> uname -m
2023-12-17T01:32:59.423 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64
2023-12-17T01:32:59.423 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release
2023-12-17T01:32:59.470 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-17T01:32:59.470 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu"
2023-12-17T01:32:59.470 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="22.04"
2023-12-17T01:32:59.471 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-17T01:32:59.471 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=jammy
2023-12-17T01:32:59.471 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu
2023-12-17T01:32:59.471 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian
2023-12-17T01:32:59.471 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-17T01:32:59.471 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-17T01:32:59.471 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-17T01:32:59.471 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-17T01:32:59.471 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=jammy
2023-12-17T01:32:59.471 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server
2023-12-17T01:32:59.495 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server
2023-12-17T01:32:59.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com'
2023-12-17T01:32:59.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-17T01:32:59.572 DEBUG:teuthology.orchestra.run.smithi097:> true
2023-12-17T01:32:59.686 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com'
2023-12-17T01:32:59.686 DEBUG:teuthology.orchestra.run.smithi097:> uname -m
2023-12-17T01:32:59.737 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64
2023-12-17T01:32:59.738 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2023-12-17T01:32:59.786 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-17T01:32:59.786 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu"
2023-12-17T01:32:59.786 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="22.04"
2023-12-17T01:32:59.786 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-17T01:32:59.786 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=jammy
2023-12-17T01:32:59.787 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu
2023-12-17T01:32:59.787 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian
2023-12-17T01:32:59.787 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-17T01:32:59.787 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-17T01:32:59.787 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-17T01:32:59.787 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-17T01:32:59.787 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=jammy
2023-12-17T01:32:59.787 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2023-12-17T01:32:59.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T01:32:59.889 INFO:teuthology.dispatcher.supervisor:Running job 7495127
2023-12-17T01:32:59.889 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-16_15:51:27-rgw-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7495127 --name yuriw-2023-12-16_15:51:27-rgw-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/yuriw-2023-12-16_15:51:27-rgw-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7495127/orig.config.yaml
2023-12-17T01:32:59.893 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-16_15:51:27-rgw-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7495127
2023-12-17T01:32:59.893 INFO:teuthology.dispatcher.supervisor:Job PID: 2930572
2023-12-17T01:32:59.893 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-17T01:34:59.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T01:37:00.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T01:39:00.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T01:41:00.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T01:43:00.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T01:45:00.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T01:47:00.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T01:49:01.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T01:51:01.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T01:53:01.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T01:55:01.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T01:57:01.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T01:59:01.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:01:02.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:03:02.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:05:02.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:07:02.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:09:02.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:11:03.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:13:03.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:15:03.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:17:03.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:19:03.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:21:03.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:23:04.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:25:04.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:27:04.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:29:04.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:31:04.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:33:04.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:35:04.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:37:05.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:39:05.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:41:05.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:43:05.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:45:05.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:47:06.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:49:06.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:51:06.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:53:06.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:55:06.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:57:06.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T02:59:06.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:01:07.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:03:07.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:05:07.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:07:07.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:09:07.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:11:07.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:13:08.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:15:08.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:17:08.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:19:08.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:21:08.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:23:08.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:25:09.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:27:09.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:29:09.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:31:09.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:33:09.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:35:10.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:37:10.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:39:10.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-17T03:39:10.525 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-17T03:39:10.681 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-17T03:39:10.682 INFO:teuthology.nuke:Checking targets against current locks
2023-12-17T03:39:10.728 DEBUG:teuthology.nuke:shortname: smithi040
2023-12-17T03:39:10.728 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-17T03:39:10.752 DEBUG:teuthology.nuke:shortname: smithi097
2023-12-17T03:39:10.752 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-17T03:39:10.755 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_15:51:27-rgw-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7495127', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 01:27:16.631980', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPeUqKczPiEpU1y598oFHqflYGp5Rq1wVnJROOQTuuuhj4ry9TsijSETgwTmGdMW3BGCSac6diCUeYN1z9s2ffM='}
2023-12-17T03:39:10.776 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-16_15:51:27-rgw-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7495127', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 01:27:16.630213', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBagU8m4sRO3wceddoY9uPHmlRT8LYIYI2soojz3N63zCjcmjdX1Zpk6pPYCf9k2NHPRYuO3rneh1ANAbb968kM='}
2023-12-17T03:39:10.806 INFO:teuthology.orchestra.console.smithi040:Power off
2023-12-17T03:39:10.806 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-17T03:39:10.825 INFO:teuthology.orchestra.console.smithi097:Power off
2023-12-17T03:39:10.825 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-17T03:39:10.833 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off
2023-12-17T03:39:10.833 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-17T03:39:10.844 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off
2023-12-17T03:39:10.844 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-17T03:39:10.853 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off
2023-12-17T03:39:10.863 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2023-12-17T03:39:10.953 INFO:teuthology.orchestra.console.smithi040:Power off completed
2023-12-17T03:39:10.964 INFO:teuthology.orchestra.console.smithi097:Power off completed
2023-12-17T03:39:11.105 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com
2023-12-17T03:39:11.113 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com