2024-02-12T01:59:22.415 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22
2024-02-12T01:59:22.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T01:59:22.538 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fe516fd4f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fe517f35c10>, signals=[15])
2024-02-12T01:59:22.538 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2024-02-12T01:59:22.539 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2024-02-12T01:59:22.539 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2024-02-12T01:59:22.560 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging
2024-02-12T01:59:22.560 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server
2024-02-12T01:59:22.561 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2024-02-12T01:59:22.662 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-02-12T01:59:22.703 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of ubuntu 22.04
2024-02-12T01:59:22.962 INFO:teuthology.orchestra.console.smithi111:Power off
2024-02-12T01:59:22.962 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-12T01:59:22.983 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2024-02-12T01:59:22.984 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T01:59:23.005 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-02-12T01:59:24.162 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-02-12T01:59:24.213 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of ubuntu 22.04
2024-02-12T01:59:24.471 INFO:teuthology.orchestra.console.smithi145:Power off
2024-02-12T01:59:24.472 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-12T01:59:24.496 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off
2024-02-12T01:59:24.496 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T01:59:24.519 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-02-12T01:59:27.008 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T01:59:27.117 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-02-12T01:59:28.521 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T01:59:28.631 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-02-12T01:59:31.120 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T01:59:31.230 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-02-12T01:59:31.331 INFO:teuthology.orchestra.console.smithi111:Power off completed
2024-02-12T01:59:31.432 INFO:teuthology.orchestra.console.smithi111:Power on
2024-02-12T01:59:31.432 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-12T01:59:31.452 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2024-02-12T01:59:31.453 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T01:59:31.474 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-02-12T01:59:32.633 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T01:59:32.742 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-02-12T01:59:35.476 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T01:59:35.586 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2024-02-12T01:59:36.744 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T01:59:36.853 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off
2024-02-12T01:59:36.953 INFO:teuthology.orchestra.console.smithi145:Power off completed
2024-02-12T01:59:37.054 INFO:teuthology.orchestra.console.smithi145:Power on
2024-02-12T01:59:37.054 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-12T01:59:37.077 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On
2024-02-12T01:59:37.078 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T01:59:37.098 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off
2024-02-12T01:59:39.589 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T01:59:39.697 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2024-02-12T01:59:39.798 INFO:teuthology.orchestra.console.smithi111:Power on completed
2024-02-12T01:59:39.899 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2024-02-12T01:59:41.100 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T01:59:41.208 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-02-12T01:59:41.309 INFO:teuthology.orchestra.console.smithi145:Power on completed
2024-02-12T01:59:41.409 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish
2024-02-12T02:05:33.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:05:36.316 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-02-12T02:05:42.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:05:45.404 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-02-12T02:05:51.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:05:54.492 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-02-12T02:06:00.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:06:03.580 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-02-12T02:06:09.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:06:12.640 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-02-12T02:06:16.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:06:18.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:06:19.516 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-02-12T02:06:21.724 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-02-12T02:06:25.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:06:27.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:06:28.576 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-02-12T02:06:34.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:06:37.660 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-02-12T02:06:43.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:06:46.716 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-02-12T02:06:52.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:06:55.772 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-02-12T02:07:01.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:07:04.864 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-02-12T02:07:10.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:07:13.948 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-02-12T02:07:19.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:07:23.036 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-02-12T02:07:27.732 WARNING:teuthology.provision.fog.smithi145:timed out
2024-02-12T02:07:29.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:07:33.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:07:33.907 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-12T02:07:33.907 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-12T02:07:34.325 INFO:teuthology.provision.fog.smithi145:Node is ready
2024-02-12T02:07:34.326 DEBUG:teuthology.orchestra.run.smithi145:> hostname
2024-02-12T02:07:34.373 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com
2024-02-12T02:07:34.374 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts
2024-02-12T02:07:34.422 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145
2024-02-12T02:07:34.422 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145
2024-02-12T02:07:34.551 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts
2024-02-12T02:07:34.564 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts
2024-02-12T02:07:34.619 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname
2024-02-12T02:07:34.673 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145
2024-02-12T02:07:34.728 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release
2024-02-12T02:07:34.774 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-02-12T02:07:34.774 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Ubuntu"
2024-02-12T02:07:34.774 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="22.04"
2024-02-12T02:07:34.774 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-02-12T02:07:34.774 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_CODENAME=jammy
2024-02-12T02:07:34.774 INFO:teuthology.orchestra.run.smithi145.stdout:ID=ubuntu
2024-02-12T02:07:34.774 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE=debian
2024-02-12T02:07:34.774 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.ubuntu.com/"
2024-02-12T02:07:34.775 INFO:teuthology.orchestra.run.smithi145.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-02-12T02:07:34.775 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-02-12T02:07:34.775 INFO:teuthology.orchestra.run.smithi145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-02-12T02:07:34.775 INFO:teuthology.orchestra.run.smithi145.stdout:UBUNTU_CODENAME=jammy
2024-02-12T02:07:34.775 INFO:teuthology.provision.fog.smithi145:Deploy complete!
2024-02-12T02:07:34.777 DEBUG:teuthology.parallel:result is None
2024-02-12T02:07:47.516 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-02-12T02:07:53.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:07:56.572 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-02-12T02:08:02.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:08:02.580 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-02-12T02:08:08.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:08:08.589 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-02-12T02:08:14.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:08:14.598 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-02-12T02:08:20.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:08:20.606 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-02-12T02:08:26.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:08:26.614 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2024-02-12T02:08:32.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:08:32.811 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-12T02:08:32.811 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-12T02:08:33.226 INFO:teuthology.provision.fog.smithi111:Node is ready
2024-02-12T02:08:33.226 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2024-02-12T02:08:33.275 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2024-02-12T02:08:33.275 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts
2024-02-12T02:08:33.328 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2024-02-12T02:08:33.328 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2024-02-12T02:08:33.488 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts
2024-02-12T02:08:33.503 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2024-02-12T02:08:33.559 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname
2024-02-12T02:08:33.619 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2024-02-12T02:08:33.678 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2024-02-12T02:08:33.722 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-02-12T02:08:33.723 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu"
2024-02-12T02:08:33.723 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04"
2024-02-12T02:08:33.723 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-02-12T02:08:33.723 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy
2024-02-12T02:08:33.723 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu
2024-02-12T02:08:33.723 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian
2024-02-12T02:08:33.723 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/"
2024-02-12T02:08:33.723 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-02-12T02:08:33.723 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-02-12T02:08:33.723 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-02-12T02:08:33.723 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy
2024-02-12T02:08:33.724 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2024-02-12T02:08:33.725 DEBUG:teuthology.parallel:result is None
2024-02-12T02:08:33.935 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2024-02-12T02:08:33.935 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-12T02:08:33.954 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com
2024-02-12T02:08:33.954 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-12T02:08:33.972 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2024-02-12T02:08:33.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2024-02-12T02:08:33.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:08:34.053 DEBUG:teuthology.orchestra.run.smithi111:> true
2024-02-12T02:08:34.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2024-02-12T02:08:34.144 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2024-02-12T02:08:34.191 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2024-02-12T02:08:34.191 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2024-02-12T02:08:34.239 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-02-12T02:08:34.239 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu"
2024-02-12T02:08:34.239 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04"
2024-02-12T02:08:34.239 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-02-12T02:08:34.239 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy
2024-02-12T02:08:34.239 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu
2024-02-12T02:08:34.240 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian
2024-02-12T02:08:34.240 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/"
2024-02-12T02:08:34.240 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-02-12T02:08:34.240 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-02-12T02:08:34.240 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-02-12T02:08:34.240 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy
2024-02-12T02:08:34.241 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2024-02-12T02:08:34.263 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server
2024-02-12T02:08:34.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com'
2024-02-12T02:08:34.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T02:08:34.342 DEBUG:teuthology.orchestra.run.smithi145:> true
2024-02-12T02:08:34.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com'
2024-02-12T02:08:34.540 DEBUG:teuthology.orchestra.run.smithi145:> uname -m
2024-02-12T02:08:34.585 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64
2024-02-12T02:08:34.585 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release
2024-02-12T02:08:34.633 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-02-12T02:08:34.633 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Ubuntu"
2024-02-12T02:08:34.633 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="22.04"
2024-02-12T02:08:34.633 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-02-12T02:08:34.633 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_CODENAME=jammy
2024-02-12T02:08:34.633 INFO:teuthology.orchestra.run.smithi145.stdout:ID=ubuntu
2024-02-12T02:08:34.634 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE=debian
2024-02-12T02:08:34.634 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.ubuntu.com/"
2024-02-12T02:08:34.634 INFO:teuthology.orchestra.run.smithi145.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-02-12T02:08:34.634 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-02-12T02:08:34.635 INFO:teuthology.orchestra.run.smithi145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-02-12T02:08:34.635 INFO:teuthology.orchestra.run.smithi145.stdout:UBUNTU_CODENAME=jammy
2024-02-12T02:08:34.635 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2024-02-12T02:08:34.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:08:34.736 INFO:teuthology.dispatcher.supervisor:Running job 7556334
2024-02-12T02:08:34.736 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2024-02-12_01:58:15-rgw-wip-rgw-account-v3-distro-default-smithi/7556334 --name cbodley-2024-02-12_01:58:15-rgw-wip-rgw-account-v3-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2024-02-12_01:58:15-rgw-wip-rgw-account-v3-distro-default-smithi/7556334/orig.config.yaml
2024-02-12T02:08:34.739 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2024-02-12_01:58:15-rgw-wip-rgw-account-v3-distro-default-smithi/7556334
2024-02-12T02:08:34.740 INFO:teuthology.dispatcher.supervisor:Job PID: 3430046
2024-02-12T02:08:34.740 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-12T02:10:34.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:12:35.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:14:35.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:16:35.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:18:35.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:20:35.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:22:35.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:24:36.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:26:36.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:28:36.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:30:36.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:32:36.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:34:36.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:36:37.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:38:37.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:40:37.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:42:37.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:44:37.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:46:37.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:48:38.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:50:38.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:52:38.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:54:38.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:56:38.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T02:58:38.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:00:39.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:02:39.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:04:39.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:06:39.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:08:39.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:10:39.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:12:40.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:14:40.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:16:40.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:18:40.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:20:40.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:22:41.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:24:41.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:26:41.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:28:41.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:30:41.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:32:41.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:34:42.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:36:42.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:38:42.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:40:42.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:42:42.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:44:42.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:46:43.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:48:43.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:50:43.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:52:43.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:54:43.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:56:43.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T03:58:44.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:00:44.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:02:44.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:04:44.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:06:44.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:08:45.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:10:45.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:12:45.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:14:45.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:16:45.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:18:45.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:20:46.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:22:46.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:24:46.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:26:46.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:28:46.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:30:46.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:32:46.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:34:47.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:36:47.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:38:47.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:40:47.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:42:47.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:44:47.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:46:48.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:48:48.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:50:48.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:52:48.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:54:48.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:56:48.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T04:58:49.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:00:49.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:02:49.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:04:49.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:06:49.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:08:49.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:10:50.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:12:50.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:14:50.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:16:50.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:18:50.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:20:50.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:22:51.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:24:51.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:26:51.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:28:51.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:30:51.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:32:51.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:34:52.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:36:52.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:38:52.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:40:52.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:42:52.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:44:52.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:46:52.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:48:53.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:50:53.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:52:53.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:54:53.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:56:53.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T05:58:53.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T06:00:54.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T06:02:54.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T06:04:54.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T06:06:54.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T06:08:54.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T06:10:54.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T06:12:55.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T06:14:55.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T06:16:55.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T06:18:55.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T06:20:55.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T06:20:56.018 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1