2024-01-27T18:27:42.117 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-27T18:27:42.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T18:27:42.251 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ffac5a5af40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ffac6ac0c10>, signals=[15])
2024-01-27T18:27:42.252 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging
2024-01-27T18:27:42.252 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server
2024-01-27T18:27:42.252 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server
2024-01-27T18:27:42.276 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging
2024-01-27T18:27:42.277 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server
2024-01-27T18:27:42.277 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2024-01-27T18:27:42.412 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-27T18:27:42.415 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-27T18:27:42.464 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of ubuntu 22.04
2024-01-27T18:27:42.467 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of ubuntu 22.04
2024-01-27T18:27:42.720 INFO:teuthology.orchestra.console.smithi046:Power off
2024-01-27T18:27:42.720 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T18:27:42.733 INFO:teuthology.orchestra.console.smithi123:Power off
2024-01-27T18:27:42.734 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T18:27:42.743 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off
2024-01-27T18:27:42.743 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T18:27:42.753 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off
2024-01-27T18:27:42.754 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T18:27:42.763 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on
2024-01-27T18:27:42.774 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2024-01-27T18:27:46.767 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T18:27:46.774 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T18:27:46.877 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on
2024-01-27T18:27:46.883 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2024-01-27T18:27:50.882 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T18:27:50.889 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T18:27:50.992 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-01-27T18:27:50.997 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2024-01-27T18:27:51.093 INFO:teuthology.orchestra.console.smithi046:Power off completed
2024-01-27T18:27:51.097 INFO:teuthology.orchestra.console.smithi123:Power off completed
2024-01-27T18:27:51.194 INFO:teuthology.orchestra.console.smithi046:Power on
2024-01-27T18:27:51.194 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-27T18:27:51.201 INFO:teuthology.orchestra.console.smithi123:Power on
2024-01-27T18:27:51.201 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-27T18:27:51.215 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On
2024-01-27T18:27:51.215 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T18:27:51.224 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On
2024-01-27T18:27:51.225 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T18:27:51.237 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-01-27T18:27:51.245 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2024-01-27T18:27:55.243 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T18:27:55.250 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T18:27:55.353 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-01-27T18:27:55.358 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2024-01-27T18:27:59.358 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T18:27:59.365 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T18:27:59.468 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on
2024-01-27T18:27:59.569 INFO:teuthology.orchestra.console.smithi046:Power on completed
2024-01-27T18:27:59.581 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2024-01-27T18:27:59.669 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish
2024-01-27T18:27:59.682 INFO:teuthology.orchestra.console.smithi123:Power on completed
2024-01-27T18:27:59.782 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2024-01-27T18:31:00.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T18:31:00.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T18:31:00.823 ERROR:teuthology.orchestra.connection:Error authenticating with smithi123.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-27T18:31:00.995 ERROR:teuthology.orchestra.connection:Error authenticating with smithi046.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-27T18:32:04.826 WARNING:teuthology.provision.fog.smithi123:timed out
2024-01-27T18:32:04.998 WARNING:teuthology.provision.fog.smithi046:timed out
2024-01-27T18:32:10.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T18:32:10.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T18:32:29.244 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-01-27T18:32:35.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T18:32:38.304 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-01-27T18:32:44.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T18:32:44.307 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-01-27T18:32:50.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T18:32:50.311 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-01-27T18:32:56.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T18:32:56.315 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-01-27T18:33:02.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T18:33:02.318 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-01-27T18:33:08.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T18:33:08.518 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-27T18:33:08.518 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-27T18:33:08.983 INFO:teuthology.provision.fog.smithi123:Node is ready
2024-01-27T18:33:08.983 DEBUG:teuthology.orchestra.run.smithi123:> hostname
2024-01-27T18:33:09.028 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com
2024-01-27T18:33:09.029 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts
2024-01-27T18:33:09.077 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123
2024-01-27T18:33:09.077 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2024-01-27T18:33:09.212 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts
2024-01-27T18:33:09.227 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts
2024-01-27T18:33:09.284 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname
2024-01-27T18:33:09.340 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2024-01-27T18:33:09.395 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2024-01-27T18:33:09.444 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-27T18:33:09.444 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu"
2024-01-27T18:33:09.444 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="22.04"
2024-01-27T18:33:09.445 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-27T18:33:09.445 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=jammy
2024-01-27T18:33:09.445 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu
2024-01-27T18:33:09.445 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian
2024-01-27T18:33:09.445 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-27T18:33:09.445 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-27T18:33:09.445 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-27T18:33:09.445 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-27T18:33:09.445 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=jammy
2024-01-27T18:33:09.446 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2024-01-27T18:33:09.447 DEBUG:teuthology.parallel:result is None
2024-01-27T18:33:11.002 WARNING:teuthology.provision.fog.smithi046:timed out
2024-01-27T18:33:17.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T18:33:17.280 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-27T18:33:17.280 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-27T18:33:17.736 INFO:teuthology.provision.fog.smithi046:Node is ready
2024-01-27T18:33:17.736 DEBUG:teuthology.orchestra.run.smithi046:> hostname
2024-01-27T18:33:17.785 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com
2024-01-27T18:33:17.785 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts
2024-01-27T18:33:17.838 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2024-01-27T18:33:17.839 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046
2024-01-27T18:33:17.970 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts
2024-01-27T18:33:17.985 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts
2024-01-27T18:33:18.044 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname
2024-01-27T18:33:18.104 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046
2024-01-27T18:33:18.164 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release
2024-01-27T18:33:18.213 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-27T18:33:18.213 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Ubuntu"
2024-01-27T18:33:18.213 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="22.04"
2024-01-27T18:33:18.213 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-27T18:33:18.213 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_CODENAME=jammy
2024-01-27T18:33:18.214 INFO:teuthology.orchestra.run.smithi046.stdout:ID=ubuntu
2024-01-27T18:33:18.214 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE=debian
2024-01-27T18:33:18.214 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-27T18:33:18.214 INFO:teuthology.orchestra.run.smithi046.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-27T18:33:18.214 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-27T18:33:18.214 INFO:teuthology.orchestra.run.smithi046.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-27T18:33:18.214 INFO:teuthology.orchestra.run.smithi046.stdout:UBUNTU_CODENAME=jammy
2024-01-27T18:33:18.214 INFO:teuthology.provision.fog.smithi046:Deploy complete!
2024-01-27T18:33:18.215 DEBUG:teuthology.parallel:result is None
2024-01-27T18:33:18.421 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com
2024-01-27T18:33:18.422 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-27T18:33:18.452 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com
2024-01-27T18:33:18.453 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-27T18:33:18.470 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server
2024-01-27T18:33:18.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com'
2024-01-27T18:33:18.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T18:33:18.547 DEBUG:teuthology.orchestra.run.smithi046:> true
2024-01-27T18:33:18.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com'
2024-01-27T18:33:18.652 DEBUG:teuthology.orchestra.run.smithi046:> uname -m
2024-01-27T18:33:18.700 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64
2024-01-27T18:33:18.701 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release
2024-01-27T18:33:18.748 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-27T18:33:18.748 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Ubuntu"
2024-01-27T18:33:18.748 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="22.04"
2024-01-27T18:33:18.748 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-27T18:33:18.749 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_CODENAME=jammy
2024-01-27T18:33:18.749 INFO:teuthology.orchestra.run.smithi046.stdout:ID=ubuntu
2024-01-27T18:33:18.749 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE=debian
2024-01-27T18:33:18.749 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-27T18:33:18.749 INFO:teuthology.orchestra.run.smithi046.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-27T18:33:18.749 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-27T18:33:18.749 INFO:teuthology.orchestra.run.smithi046.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-27T18:33:18.749 INFO:teuthology.orchestra.run.smithi046.stdout:UBUNTU_CODENAME=jammy
2024-01-27T18:33:18.750 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server
2024-01-27T18:33:18.769 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server
2024-01-27T18:33:18.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2024-01-27T18:33:18.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T18:33:18.849 DEBUG:teuthology.orchestra.run.smithi123:> true
2024-01-27T18:33:18.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com'
2024-01-27T18:33:18.952 DEBUG:teuthology.orchestra.run.smithi123:> uname -m
2024-01-27T18:33:18.999 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64
2024-01-27T18:33:19.000 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2024-01-27T18:33:19.048 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-27T18:33:19.048 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu"
2024-01-27T18:33:19.048 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="22.04"
2024-01-27T18:33:19.048 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-27T18:33:19.048 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=jammy
2024-01-27T18:33:19.048 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu
2024-01-27T18:33:19.048 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian
2024-01-27T18:33:19.049 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-27T18:33:19.049 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-27T18:33:19.049 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-27T18:33:19.049 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-27T18:33:19.049 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=jammy
2024-01-27T18:33:19.049 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2024-01-27T18:33:19.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T18:33:19.173 INFO:teuthology.dispatcher.supervisor:Running job 7534807
2024-01-27T18:33:19.173 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-26_15:12:18-rgw-main-distro-default-smithi/7534807 --name yuriw-2024-01-26_15:12:18-rgw-main-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/yuriw-2024-01-26_15:12:18-rgw-main-distro-default-smithi/7534807/orig.config.yaml
2024-01-27T18:33:19.177 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-26_15:12:18-rgw-main-distro-default-smithi/7534807
2024-01-27T18:33:19.177 INFO:teuthology.dispatcher.supervisor:Job PID: 1415941
2024-01-27T18:33:19.177 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-27T18:35:19.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T18:37:19.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T18:39:19.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T18:41:19.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T18:43:19.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T18:45:19.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T18:47:19.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T18:49:19.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T18:51:19.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T18:53:19.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T18:55:19.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T18:57:19.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T18:59:20.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:01:20.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:03:20.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:05:20.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:07:20.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:09:20.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:11:20.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:13:20.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:15:20.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:17:20.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:19:20.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:21:20.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:23:20.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:25:20.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:27:21.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:29:21.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:31:21.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:33:21.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:35:21.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:37:21.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:39:21.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:41:21.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:43:21.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:45:21.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:47:21.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:49:21.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:51:21.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:53:21.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:55:22.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:57:22.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T19:59:22.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:01:22.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:03:22.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:05:22.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:07:22.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:09:22.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:11:22.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:13:22.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:15:22.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:17:22.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:19:22.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:21:22.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:23:22.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:25:23.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:27:23.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:29:23.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:31:23.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:33:23.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:35:23.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:37:23.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:39:23.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:41:23.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:43:23.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:45:23.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:47:23.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:49:23.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:51:23.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:53:24.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:55:24.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:57:24.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T20:59:24.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:01:24.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:03:24.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:05:24.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:07:24.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:09:24.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:11:24.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:13:24.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:15:24.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:17:24.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:19:24.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:21:24.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:23:25.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:25:25.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:27:25.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:29:25.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:31:25.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:33:25.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:35:25.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:37:25.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:39:25.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:41:25.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:41:25.791 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-27T21:41:26.016 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-27T21:41:26.017 INFO:teuthology.nuke:Checking targets against current locks
2024-01-27T21:41:26.057 DEBUG:teuthology.nuke:shortname: smithi046
2024-01-27T21:41:26.057 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-27T21:41:26.071 DEBUG:teuthology.nuke:shortname: smithi123
2024-01-27T21:41:26.071 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-27T21:41:26.076 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_15:12:18-rgw-main-distro-default-smithi/7534807', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 18:27:41.109266', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE2lwJXSiZ0EyazKc0BEGp+I26UzP68cbybKDpZvuE0H49ARwMvE1KSQj3gtFYq/yz9762vUmdKvjE+qaylR/l8='}
2024-01-27T21:41:26.091 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_15:12:18-rgw-main-distro-default-smithi/7534807', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 18:27:41.107465', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIIYMgTIToeADDNTffWoabMsa61tji9fMuabbf4SA+gbb39UrQDeICb0kGJ/xyo0tmBG63T+MV9dNJxZY2GLkFk='}
2024-01-27T21:41:26.126 INFO:teuthology.orchestra.console.smithi046:Power off
2024-01-27T21:41:26.126 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T21:41:26.141 INFO:teuthology.orchestra.console.smithi123:Power off
2024-01-27T21:41:26.141 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T21:41:26.149 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off
2024-01-27T21:41:26.149 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T21:41:26.160 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off
2024-01-27T21:41:26.160 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T21:41:26.168 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off
2024-01-27T21:41:26.182 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2024-01-27T21:41:26.270 INFO:teuthology.orchestra.console.smithi046:Power off completed
2024-01-27T21:41:26.282 INFO:teuthology.orchestra.console.smithi123:Power off completed
2024-01-27T21:41:26.416 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com
2024-01-27T21:41:26.423 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com