2024-03-15T06:16:45.053 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-15T06:16:45.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:16:45.198 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fcaaa518f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fcaab58cc10>, signals=[15])
2024-03-15T06:16:45.198 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging
2024-03-15T06:16:45.198 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server
2024-03-15T06:16:45.199 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2024-03-15T06:16:45.222 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging
2024-03-15T06:16:45.222 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server
2024-03-15T06:16:45.222 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server
2024-03-15T06:16:45.329 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-03-15T06:16:45.364 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-03-15T06:16:45.375 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of ubuntu 22.04
2024-03-15T06:16:45.421 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of ubuntu 22.04
2024-03-15T06:16:45.830 INFO:teuthology.orchestra.console.smithi022:Power off
2024-03-15T06:16:45.830 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-15T06:16:45.842 INFO:teuthology.orchestra.console.smithi121:Power off
2024-03-15T06:16:45.842 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-15T06:16:45.852 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off
2024-03-15T06:16:45.853 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T06:16:45.863 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off
2024-03-15T06:16:45.863 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T06:16:45.872 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on
2024-03-15T06:16:45.882 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on
2024-03-15T06:16:49.874 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T06:16:49.883 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T06:16:49.983 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on
2024-03-15T06:16:49.991 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on
2024-03-15T06:16:53.988 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T06:16:53.994 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T06:16:54.097 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2024-03-15T06:16:54.103 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off
2024-03-15T06:16:54.198 INFO:teuthology.orchestra.console.smithi022:Power off completed
2024-03-15T06:16:54.204 INFO:teuthology.orchestra.console.smithi121:Power off completed
2024-03-15T06:16:54.299 INFO:teuthology.orchestra.console.smithi022:Power on
2024-03-15T06:16:54.299 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-15T06:16:54.306 INFO:teuthology.orchestra.console.smithi121:Power on
2024-03-15T06:16:54.306 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-15T06:16:54.320 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On
2024-03-15T06:16:54.320 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T06:16:54.328 DEBUG:teuthology.orchestra.console.smithi121:power on output: Chassis Power Control: Up/On
2024-03-15T06:16:54.329 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T06:16:54.342 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2024-03-15T06:16:54.348 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off
2024-03-15T06:16:58.346 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T06:16:58.352 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T06:16:58.454 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2024-03-15T06:16:58.460 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off
2024-03-15T06:17:02.458 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T06:17:02.465 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-15T06:17:02.568 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on
2024-03-15T06:17:02.573 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on
2024-03-15T06:17:02.669 INFO:teuthology.orchestra.console.smithi022:Power on completed
2024-03-15T06:17:02.674 INFO:teuthology.orchestra.console.smithi121:Power on completed
2024-03-15T06:17:02.770 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish
2024-03-15T06:17:02.775 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish
2024-03-15T06:20:03.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T06:20:18.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T06:20:22.174 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2024-03-15T06:20:28.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T06:20:31.262 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2024-03-15T06:20:37.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T06:20:37.278 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2024-03-15T06:20:40.350 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2024-03-15T06:20:43.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T06:20:46.334 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2024-03-15T06:20:46.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T06:20:49.410 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2024-03-15T06:20:52.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T06:20:55.394 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2024-03-15T06:20:55.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T06:21:01.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T06:21:04.482 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2024-03-15T06:21:10.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T06:21:55.459 WARNING:teuthology.provision.fog.smithi022:timed out
2024-03-15T06:22:01.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T06:22:01.469 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2024-03-15T06:22:07.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T06:22:07.682 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-15T06:22:07.682 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-15T06:22:08.159 INFO:teuthology.provision.fog.smithi022:Node is ready
2024-03-15T06:22:08.159 DEBUG:teuthology.orchestra.run.smithi022:> hostname
2024-03-15T06:22:08.207 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com
2024-03-15T06:22:08.208 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts
2024-03-15T06:22:08.256 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2024-03-15T06:22:08.256 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022
2024-03-15T06:22:08.390 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts
2024-03-15T06:22:08.405 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts
2024-03-15T06:22:08.460 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname
2024-03-15T06:22:08.516 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022
2024-03-15T06:22:08.573 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release
2024-03-15T06:22:08.620 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-15T06:22:08.620 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Ubuntu"
2024-03-15T06:22:08.620 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="22.04"
2024-03-15T06:22:08.620 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-15T06:22:08.620 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_CODENAME=jammy
2024-03-15T06:22:08.620 INFO:teuthology.orchestra.run.smithi022.stdout:ID=ubuntu
2024-03-15T06:22:08.621 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE=debian
2024-03-15T06:22:08.621 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-15T06:22:08.621 INFO:teuthology.orchestra.run.smithi022.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-15T06:22:08.621 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-15T06:22:08.621 INFO:teuthology.orchestra.run.smithi022.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-15T06:22:08.621 INFO:teuthology.orchestra.run.smithi022.stdout:UBUNTU_CODENAME=jammy
2024-03-15T06:22:08.622 INFO:teuthology.provision.fog.smithi022:Deploy complete!
2024-03-15T06:22:08.623 DEBUG:teuthology.parallel:result is None
2024-03-15T06:22:10.487 WARNING:teuthology.provision.fog.smithi121:timed out
2024-03-15T06:22:16.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T06:22:16.717 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-15T06:22:16.717 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-15T06:22:17.228 INFO:teuthology.provision.fog.smithi121:Node is ready
2024-03-15T06:22:17.228 DEBUG:teuthology.orchestra.run.smithi121:> hostname
2024-03-15T06:22:17.276 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com
2024-03-15T06:22:17.277 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121.front.sepia.ceph.com /etc/hosts
2024-03-15T06:22:17.324 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121
2024-03-15T06:22:17.325 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121
2024-03-15T06:22:17.471 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hosts
2024-03-15T06:22:17.486 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts
2024-03-15T06:22:17.540 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hostname
2024-03-15T06:22:17.597 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121
2024-03-15T06:22:17.652 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release
2024-03-15T06:22:17.700 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-15T06:22:17.701 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Ubuntu"
2024-03-15T06:22:17.701 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="22.04"
2024-03-15T06:22:17.701 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-15T06:22:17.701 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_CODENAME=jammy
2024-03-15T06:22:17.701 INFO:teuthology.orchestra.run.smithi121.stdout:ID=ubuntu
2024-03-15T06:22:17.701 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE=debian
2024-03-15T06:22:17.701 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-15T06:22:17.701 INFO:teuthology.orchestra.run.smithi121.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-15T06:22:17.701 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-15T06:22:17.701 INFO:teuthology.orchestra.run.smithi121.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-15T06:22:17.701 INFO:teuthology.orchestra.run.smithi121.stdout:UBUNTU_CODENAME=jammy
2024-03-15T06:22:17.701 INFO:teuthology.provision.fog.smithi121:Deploy complete!
2024-03-15T06:22:17.702 DEBUG:teuthology.parallel:result is None
2024-03-15T06:22:17.894 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com
2024-03-15T06:22:17.894 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-15T06:22:17.915 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com
2024-03-15T06:22:17.915 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-15T06:22:17.934 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server
2024-03-15T06:22:17.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com'
2024-03-15T06:22:17.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T06:22:18.020 DEBUG:teuthology.orchestra.run.smithi022:> true
2024-03-15T06:22:18.119 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com'
2024-03-15T06:22:18.119 DEBUG:teuthology.orchestra.run.smithi022:> uname -m
2024-03-15T06:22:18.167 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64
2024-03-15T06:22:18.167 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release
2024-03-15T06:22:18.215 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-15T06:22:18.215 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Ubuntu"
2024-03-15T06:22:18.216 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="22.04"
2024-03-15T06:22:18.216 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-15T06:22:18.216 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_CODENAME=jammy
2024-03-15T06:22:18.216 INFO:teuthology.orchestra.run.smithi022.stdout:ID=ubuntu
2024-03-15T06:22:18.216 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE=debian
2024-03-15T06:22:18.216 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-15T06:22:18.216 INFO:teuthology.orchestra.run.smithi022.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-15T06:22:18.216 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-15T06:22:18.216 INFO:teuthology.orchestra.run.smithi022.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-15T06:22:18.216 INFO:teuthology.orchestra.run.smithi022.stdout:UBUNTU_CODENAME=jammy
2024-03-15T06:22:18.216 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2024-03-15T06:22:18.241 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server
2024-03-15T06:22:18.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com'
2024-03-15T06:22:18.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-15T06:22:18.325 DEBUG:teuthology.orchestra.run.smithi121:> true
2024-03-15T06:22:18.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com'
2024-03-15T06:22:18.419 DEBUG:teuthology.orchestra.run.smithi121:> uname -m
2024-03-15T06:22:18.465 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64
2024-03-15T06:22:18.465 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release
2024-03-15T06:22:18.512 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-03-15T06:22:18.513 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Ubuntu"
2024-03-15T06:22:18.513 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="22.04"
2024-03-15T06:22:18.513 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-03-15T06:22:18.513 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_CODENAME=jammy
2024-03-15T06:22:18.513 INFO:teuthology.orchestra.run.smithi121.stdout:ID=ubuntu
2024-03-15T06:22:18.513 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE=debian
2024-03-15T06:22:18.513 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.ubuntu.com/"
2024-03-15T06:22:18.513 INFO:teuthology.orchestra.run.smithi121.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-03-15T06:22:18.514 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-03-15T06:22:18.514 INFO:teuthology.orchestra.run.smithi121.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-03-15T06:22:18.514 INFO:teuthology.orchestra.run.smithi121.stdout:UBUNTU_CODENAME=jammy
2024-03-15T06:22:18.514 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server
2024-03-15T06:22:18.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:22:18.624 INFO:teuthology.dispatcher.supervisor:Running job 7597714
2024-03-15T06:22:18.624 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2024-03-13_18:56:46-rgw:multisite-wip-rgw-account-v3-distro-default-smithi/7597714 --name cbodley-2024-03-13_18:56:46-rgw:multisite-wip-rgw-account-v3-distro-default-smithi --description rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2024-03-13_18:56:46-rgw:multisite-wip-rgw-account-v3-distro-default-smithi/7597714/orig.config.yaml
2024-03-15T06:22:18.627 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2024-03-13_18:56:46-rgw:multisite-wip-rgw-account-v3-distro-default-smithi/7597714
2024-03-15T06:22:18.628 INFO:teuthology.dispatcher.supervisor:Job PID: 283540
2024-03-15T06:22:18.628 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-15T06:24:18.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:26:18.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:28:19.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:30:19.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:32:19.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:34:19.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:36:19.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:38:19.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:40:20.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:42:20.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:44:20.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:46:20.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:48:20.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:50:21.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:52:21.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:54:21.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:56:21.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T06:58:21.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:00:21.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:02:22.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:04:22.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:06:22.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:08:22.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:10:22.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:12:22.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:14:23.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:16:23.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:18:23.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:20:23.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:22:23.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:24:23.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:26:24.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:28:24.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:30:24.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:32:24.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:34:24.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:36:24.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:38:25.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:40:25.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:42:25.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:44:25.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:46:25.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:48:25.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:50:26.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:52:26.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:54:26.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:56:26.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T07:58:26.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:00:27.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:02:27.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:04:27.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:06:27.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:08:27.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:10:27.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:12:28.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:14:28.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:16:28.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:18:28.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:20:28.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:22:28.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:24:29.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:26:29.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:28:29.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:30:29.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:32:29.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:34:29.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:36:30.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:38:30.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:40:30.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:42:30.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:44:30.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:46:30.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:48:31.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:50:31.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:52:31.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:54:31.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:56:31.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T08:58:31.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:00:32.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:02:32.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:04:32.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:06:32.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:08:32.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:10:32.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:12:33.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:14:33.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:16:33.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:18:33.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:20:33.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:22:33.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:24:34.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:26:34.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:28:34.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:30:34.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:32:34.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:34:34.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:36:34.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:38:35.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:40:35.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:42:35.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:44:35.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:46:35.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:48:36.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:50:36.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:52:36.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-15T09:52:36.435 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1