2023-11-28T21:30:19.494 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5
2023-11-28T21:30:19.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T21:30:19.638 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f6f42f9e460>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f6f42b14dc0>, signals=[15])
2023-11-28T21:30:19.639 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging
2023-11-28T21:30:19.639 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server
2023-11-28T21:30:19.640 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2023-11-28T21:30:19.666 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging
2023-11-28T21:30:19.666 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server
2023-11-28T21:30:19.666 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2023-11-28T21:30:19.781 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-11-28T21:30:19.787 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-11-28T21:30:19.820 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of ubuntu 22.04
2023-11-28T21:30:19.838 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of ubuntu 22.04
2023-11-28T21:30:20.077 INFO:teuthology.orchestra.console.smithi125:Power off
2023-11-28T21:30:20.078 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-28T21:30:20.091 INFO:teuthology.orchestra.console.smithi037:Power off
2023-11-28T21:30:20.091 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-28T21:30:20.102 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off
2023-11-28T21:30:20.102 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T21:30:20.115 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off
2023-11-28T21:30:20.116 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T21:30:20.126 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on
2023-11-28T21:30:20.139 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on
2023-11-28T21:30:24.130 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T21:30:28.159 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T21:30:28.262 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on
2023-11-28T21:30:28.268 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on
2023-11-28T21:30:32.266 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T21:30:32.273 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T21:30:32.375 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2023-11-28T21:30:32.383 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off
2023-11-28T21:30:32.477 INFO:teuthology.orchestra.console.smithi125:Power off completed
2023-11-28T21:30:32.484 INFO:teuthology.orchestra.console.smithi037:Power off completed
2023-11-28T21:30:32.578 INFO:teuthology.orchestra.console.smithi125:Power on
2023-11-28T21:30:32.578 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-28T21:30:32.586 INFO:teuthology.orchestra.console.smithi037:Power on
2023-11-28T21:30:32.587 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-28T21:30:32.600 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On
2023-11-28T21:30:32.600 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T21:30:32.609 DEBUG:teuthology.orchestra.console.smithi037:power on output: Chassis Power Control: Up/On
2023-11-28T21:30:32.609 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T21:30:32.623 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2023-11-28T21:30:32.634 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off
2023-11-28T21:30:36.626 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T21:30:36.635 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T21:30:36.735 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2023-11-28T21:30:36.744 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off
2023-11-28T21:30:40.738 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T21:30:40.746 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T21:30:40.849 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on
2023-11-28T21:30:40.854 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on
2023-11-28T21:30:40.950 INFO:teuthology.orchestra.console.smithi125:Power on completed
2023-11-28T21:30:40.955 INFO:teuthology.orchestra.console.smithi037:Power on completed
2023-11-28T21:30:41.051 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish
2023-11-28T21:30:41.056 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish
2023-11-28T21:33:27.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:33:27.205 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-28T21:33:57.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:34:00.322 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-11-28T21:34:06.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:34:09.378 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-11-28T21:34:15.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:34:18.438 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-11-28T21:34:24.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:34:27.495 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-11-28T21:34:31.208 WARNING:teuthology.provision.fog.smithi037:timed out
2023-11-28T21:34:33.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:34:36.546 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-11-28T21:34:37.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:34:42.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:34:45.606 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-11-28T21:34:51.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:34:55.586 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2023-11-28T21:35:01.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:35:01.590 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2023-11-28T21:35:07.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:35:07.593 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2023-11-28T21:35:13.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:35:25.796 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2023-11-28T21:35:31.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:35:31.997 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-28T21:35:31.998 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-28T21:35:32.400 INFO:teuthology.provision.fog.smithi037:Node is ready
2023-11-28T21:35:32.400 DEBUG:teuthology.orchestra.run.smithi037:> hostname
2023-11-28T21:35:32.447 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com
2023-11-28T21:35:32.448 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts
2023-11-28T21:35:32.497 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037
2023-11-28T21:35:32.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037
2023-11-28T21:35:32.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts
2023-11-28T21:35:32.639 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts
2023-11-28T21:35:32.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname
2023-11-28T21:35:32.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037
2023-11-28T21:35:32.808 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release
2023-11-28T21:35:32.856 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-11-28T21:35:32.856 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu"
2023-11-28T21:35:32.856 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="22.04"
2023-11-28T21:35:32.857 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-11-28T21:35:32.857 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=jammy
2023-11-28T21:35:32.857 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu
2023-11-28T21:35:32.857 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian
2023-11-28T21:35:32.857 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/"
2023-11-28T21:35:32.857 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-11-28T21:35:32.857 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-11-28T21:35:32.857 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-11-28T21:35:32.857 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=jammy
2023-11-28T21:35:32.858 INFO:teuthology.provision.fog.smithi037:Deploy complete!
2023-11-28T21:35:32.859 DEBUG:teuthology.parallel:result is None
2023-11-28T21:35:51.609 WARNING:teuthology.provision.fog.smithi125:timed out
2023-11-28T21:35:57.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:35:57.813 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-28T21:35:57.813 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-28T21:35:58.257 INFO:teuthology.provision.fog.smithi125:Node is ready
2023-11-28T21:35:58.257 DEBUG:teuthology.orchestra.run.smithi125:> hostname
2023-11-28T21:35:58.304 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com
2023-11-28T21:35:58.304 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts
2023-11-28T21:35:58.353 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125
2023-11-28T21:35:58.353 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125
2023-11-28T21:35:58.488 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts
2023-11-28T21:35:58.502 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts
2023-11-28T21:35:58.556 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname
2023-11-28T21:35:58.613 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125
2023-11-28T21:35:58.668 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release
2023-11-28T21:35:58.716 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-11-28T21:35:58.717 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Ubuntu"
2023-11-28T21:35:58.717 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="22.04"
2023-11-28T21:35:58.717 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-11-28T21:35:58.717 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_CODENAME=jammy
2023-11-28T21:35:58.717 INFO:teuthology.orchestra.run.smithi125.stdout:ID=ubuntu
2023-11-28T21:35:58.717 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE=debian
2023-11-28T21:35:58.717 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.ubuntu.com/"
2023-11-28T21:35:58.717 INFO:teuthology.orchestra.run.smithi125.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-11-28T21:35:58.717 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-11-28T21:35:58.717 INFO:teuthology.orchestra.run.smithi125.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-11-28T21:35:58.717 INFO:teuthology.orchestra.run.smithi125.stdout:UBUNTU_CODENAME=jammy
2023-11-28T21:35:58.718 INFO:teuthology.provision.fog.smithi125:Deploy complete!
2023-11-28T21:35:58.718 DEBUG:teuthology.parallel:result is None
2023-11-28T21:35:58.899 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com
2023-11-28T21:35:58.899 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-28T21:35:58.917 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com
2023-11-28T21:35:58.918 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-28T21:35:58.935 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server
2023-11-28T21:35:58.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com'
2023-11-28T21:35:58.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:35:59.009 DEBUG:teuthology.orchestra.run.smithi037:> true
2023-11-28T21:35:59.119 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com'
2023-11-28T21:35:59.119 DEBUG:teuthology.orchestra.run.smithi037:> uname -m
2023-11-28T21:35:59.164 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64
2023-11-28T21:35:59.164 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release
2023-11-28T21:35:59.212 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-11-28T21:35:59.212 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu"
2023-11-28T21:35:59.212 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="22.04"
2023-11-28T21:35:59.212 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-11-28T21:35:59.212 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=jammy
2023-11-28T21:35:59.212 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu
2023-11-28T21:35:59.212 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian
2023-11-28T21:35:59.212 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/"
2023-11-28T21:35:59.212 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-11-28T21:35:59.213 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-11-28T21:35:59.213 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-11-28T21:35:59.213 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=jammy
2023-11-28T21:35:59.213 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2023-11-28T21:35:59.234 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server
2023-11-28T21:35:59.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com'
2023-11-28T21:35:59.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T21:35:59.310 DEBUG:teuthology.orchestra.run.smithi125:> true
2023-11-28T21:35:59.405 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com'
2023-11-28T21:35:59.406 DEBUG:teuthology.orchestra.run.smithi125:> uname -m
2023-11-28T21:35:59.451 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64
2023-11-28T21:35:59.452 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release
2023-11-28T21:35:59.500 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-11-28T21:35:59.500 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Ubuntu"
2023-11-28T21:35:59.500 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="22.04"
2023-11-28T21:35:59.500 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-11-28T21:35:59.500 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_CODENAME=jammy
2023-11-28T21:35:59.501 INFO:teuthology.orchestra.run.smithi125.stdout:ID=ubuntu
2023-11-28T21:35:59.501 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE=debian
2023-11-28T21:35:59.501 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.ubuntu.com/"
2023-11-28T21:35:59.501 INFO:teuthology.orchestra.run.smithi125.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-11-28T21:35:59.501 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-11-28T21:35:59.501 INFO:teuthology.orchestra.run.smithi125.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-11-28T21:35:59.501 INFO:teuthology.orchestra.run.smithi125.stdout:UBUNTU_CODENAME=jammy
2023-11-28T21:35:59.501 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2023-11-28T21:35:59.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T21:35:59.618 INFO:teuthology.dispatcher.supervisor:Running job 7470299
2023-11-28T21:35:59.619 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/bin/teuthology -v --owner scheduled_rraja@teuthology --archive /home/teuthworker/archive/rraja-2023-11-28_21:28:07-rbd:mirror-compare-wip-ajarr-61617-distro-default-smithi/7470299 --name rraja-2023-11-28_21:28:07-rbd:mirror-compare-wip-ajarr-61617-distro-default-smithi --description rbd:mirror-compare/{clusters/2-node conf install/ceph tasks/rbd_nbd_mirror_compare} -- /home/teuthworker/archive/rraja-2023-11-28_21:28:07-rbd:mirror-compare-wip-ajarr-61617-distro-default-smithi/7470299/orig.config.yaml
2023-11-28T21:35:59.622 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rraja-2023-11-28_21:28:07-rbd:mirror-compare-wip-ajarr-61617-distro-default-smithi/7470299
2023-11-28T21:35:59.622 INFO:teuthology.dispatcher.supervisor:Job PID: 2888085
2023-11-28T21:35:59.622 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-28T21:37:59.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T21:39:59.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T21:41:59.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T21:43:59.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T21:45:59.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T21:48:00.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T21:50:00.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T21:52:00.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T21:54:00.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T21:56:00.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T21:58:00.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T22:00:00.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T22:02:00.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T22:02:00.607 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-28T22:02:00.705 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-28T22:02:00.705 INFO:teuthology.nuke:Checking targets against current locks
2023-11-28T22:02:00.759 DEBUG:teuthology.nuke:shortname: smithi037
2023-11-28T22:02:00.759 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-28T22:02:00.782 DEBUG:teuthology.nuke:shortname: smithi125
2023-11-28T22:02:00.783 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-28T22:02:00.786 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rraja-2023-11-28_21:28:07-rbd:mirror-compare-wip-ajarr-61617-distro-default-smithi/7470299', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 21:30:18.672269', 'locked_by': 'scheduled_rraja@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD07RyuJY75EnYMVdjHB3R3nBhHE50En5/XQi7CeQFEe11376Z35qrj/Th8H8wDO+Mal6OA/FSO5wswt1bXu3E0='}
2023-11-28T22:02:00.807 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rraja-2023-11-28_21:28:07-rbd:mirror-compare-wip-ajarr-61617-distro-default-smithi/7470299', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 21:30:18.670432', 'locked_by': 'scheduled_rraja@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA+vmzwTa1EdZyDGhJ0Hic7v9XRX3n3OypdIqj43etz2dafT7v7JoQd3D59gRrX40H19jr6UXVEtYm9rRJd07cs='}
2023-11-28T22:02:00.841 INFO:teuthology.orchestra.console.smithi037:Power off
2023-11-28T22:02:00.841 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-28T22:02:00.864 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off
2023-11-28T22:02:00.864 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T22:02:00.884 INFO:teuthology.orchestra.console.smithi125:Power off
2023-11-28T22:02:00.884 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-28T22:02:00.894 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off
2023-11-28T22:02:00.907 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off
2023-11-28T22:02:00.908 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T22:02:00.935 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2023-11-28T22:02:00.995 INFO:teuthology.orchestra.console.smithi037:Power off completed
2023-11-28T22:02:01.036 INFO:teuthology.orchestra.console.smithi125:Power off completed
2023-11-28T22:02:01.153 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com
2023-11-28T22:02:01.189 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com